Jobsub ID 270039.1@dunegpschedd01.fnal.gov
| Jobsub ID | 270039.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11329 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-24 20:39:27 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce512 |
| Last heartbeat | 2025-12-25 01:05:08 |
| From worker node | Hostname | b9p06p4369.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-12-24 20:40:14 |
| Input files | monte-carlo-011329-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15867s) |
| CPU time | 4h (15068s = 94%) |
| Max RSS bytes | 4373127168 (4170 MiB) |
| Outputting started | 2025-12-25 01:04:42 |
| Output files | |
| Finished | 2025-12-25 01:05:08 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
icks
wclsFrameSaver: saving 131501 traces tagged "gauss"
FrameSaver: q=4.50411e+06 n=2396340 tag=gauss
wclsFrameSaver: saving 169021 traces tagged "wiener"
FrameSaver: q=4.75527e+06 n=2142271 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 61634 XUs and 49692 XVs -> 1120 XUVs
C:0 T:1 146508 XUs and 162837 XVs -> 15942 XUVs
C:0 T:2 100779 XUs and 132936 XVs -> 5022 XUVs
C:0 T:3 51796 XUs and 58080 XVs -> 491 XUVs
C:0 T:4 19006 XUs and 18462 XVs -> 264 XUVs
C:0 T:5 107828 XUs and 150308 XVs -> 21110 XUVs
C:0 T:6 78312 XUs and 88240 XVs -> 2703 XUVs
C:0 T:7 33724 XUs and 36663 XVs -> 189 XUVs
C:0 T:8 13848 XUs and 13138 XVs -> 300 XUVs
C:0 T:9 105891 XUs and 123204 XVs -> 9518 XUVs
C:0 T:10 25689 XUs and 31020 XVs -> 4353 XUVs
C:0 T:11 184 XUs and 119 XVs -> 35 XUVs
61047 XUVs total
15757 collection wire objects
54992 potential space points
Neighbour search...
7986976 tests to find 3585530 neighbours
Iterating with no regularization...
Begin: 8.79002e+07
0 7.30973e+07
1 7.20404e+07
2 7.18957e+07
3 7.18525e+07
Now with regularization...
Begin: 6.00244e+07
0 5.99732e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
run: 1 ; subrun: 0 ; event: 10
evttime: 411320466
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411320466
fLifetime: 30000 [us]
25-Dec-2025 02:04:40 CET Closed output file "reco_stage1.root"
25-Dec-2025 02:04:40 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 319.592 422.639 539.481 415.304 70.0448 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00118381 0.00437829 0.00665493 0.00471351 0.00195247 10
reco:ophit:OpHitFinder 0.293281 0.3894 0.465114 0.398087 0.0490314 10
reco:opflash:OpFlashFinder 0.165425 0.226992 0.278278 0.235312 0.0341494 10
reco:opslicer:OpSlicer 0.690225 0.958146 1.20866 0.975687 0.155541 10
reco:caldata:DataPrepModule 5.7945 6.89447 7.20362 7.00301 0.388327 10
reco:wclsdatasp:WireCellToolkit 34.6075 38.7376 42.5514 39.1231 2.21493 10
reco:gaushit:GausHitFinder 1.18328 1.62782 2.29095 1.6174 0.312476 10
reco:nhitsfilter:NumberOfHitsFilter 0.000434535 0.000663965 0.000921609 0.000671057 0.000133535 10
reco:reco3d:SpacePointSolver 13.2048 24.5312 49.7464 21.0866 10.2474 10
reco:hitpdune:DisambigFromSpacePoints 0.980095 1.9743 2.65944 2.02383 0.476375 10
reco:pandora:StandardPandora 22.9198 45.0345 82.374 43.9932 16.3942 10
reco:pandoraWriter:StandardPandora 0.404812 0.579093 0.784766 0.569574 0.106616 10
reco:pandoraTrack:LArPandoraTrackCreation 2.48619 4.79359 6.06549 4.75276 1.00983 10
reco:pandoraShower:LArPandoraShowerCreation 2.86593 4.77639 7.64877 4.56926 1.28514 10
reco:pandoracalo:Calorimetry 1.7201 2.6131 3.54971 2.4804 0.510164 10
reco:pandoracalonosce:Calorimetry 1.82311 2.41794 3.13414 2.36208 0.413995 10
reco:pandorapid:Chi2ParticleID 0.00417056 0.00687488 0.00893965 0.00732388 0.00169098 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.046736 0.0661125 0.0872585 0.0669774 0.0113071 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00426018 0.00678034 0.0085133 0.00719885 0.00122149 10
reco:pandoraShowercalo:ShowerCalorimetry 2.76511 5.17874 8.08343 5.10453 1.38524 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.93806 4.74438 6.66086 4.75208 1.15398 10
reco:emtrkmichelid:EmTrackMichelId 176.429 224.463 273.934 222.929 30.6097 10
reco:crttag:SingleCRTMatchingProducer 0.00996678 0.0172311 0.0229204 0.0169801 0.00377063 10
reco:crtreco:TwoCRTMatchingProducer 0.00694401 0.00979659 0.0124599 0.00977562 0.00165199 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.791405 1.07652 1.38296 1.09449 0.15815 10
reco:pandora2Track:LArPandoraTrackCreation 8.56229 14.7797 23.7473 13.8704 4.27624 10
reco:pandora2calo:Calorimetry 4.60332 7.49989 11.7977 7.42411 2.04479 10
reco:pandora2calonosce:Calorimetry 4.97454 7.24228 11.0101 6.60925 2.01124 10
reco:pandora2pid:Chi2ParticleID 0.0104253 0.0177541 0.0266036 0.0180488 0.00492327 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0522211 0.0876361 0.127026 0.0872708 0.0230141 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0103093 0.0171911 0.0253964 0.0174827 0.00434441 10
reco:pandora2Shower:LArPandoraShowerCreation 3.65789 5.31273 7.66168 5.33525 1.02804 10
reco:pandora2Showercalo:ShowerCalorimetry 4.62862 6.69167 9.80578 6.49782 1.40572 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.54073 6.24214 9.03174 6.08286 1.4474 10
[art]:TriggerResults:TriggerResultInserter 6.2471e-05 8.4962e-05 0.000182222 7.5331e-05 3.29634e-05 10
end_path:out1:RootOutput 1.008e-05 1.3364e-05 1.948e-05 1.247e-05 2.46794e-06 10
end_path:out1:RootOutput(write) 2.68056 3.50498 4.71567 3.4505 0.658747 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5206.28 MB
Peak resident set size usage (VmHWM): 4373.13 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.31 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.34 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10930296
-rw-r--r--. 1 duneprd np-comp 2533470867 Dec 25 00:50 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2401707454 Dec 25 00:47 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 2243818404 Dec 25 02:04 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 2003701114 Dec 24 22:05 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1928273771 Dec 24 21:50 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp 81038450 Dec 25 01:58 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp 243882 Dec 25 02:04 jobscript.log
-rw-r--r--. 1 duneprd np-comp 217088 Dec 25 02:04 mem.db
-rw-r--r--. 1 duneprd np-comp 62376 Dec 25 02:04 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp 36864 Dec 25 02:04 time.db
-rw-r--r--. 1 duneprd np-comp 519 Dec 25 00:50 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp 519 Dec 24 22:05 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp 519 Dec 25 02:04 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp 52 Dec 24 21:40 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp 7 Dec 25 02:04 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp 0 Dec 25 00:59 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp 0 Dec 25 00:50 debugprod.log
