Jobsub ID 281534.0@dunegpschedd01.fnal.gov
| Jobsub ID | 281534.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12083 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-18 21:40:10 |
| Site | CZ_FZU |
| Entry | Nova_CZ_FZU_osgce2 |
| Last heartbeat | 2026-01-19 00:37:17 |
| From worker node | Hostname | lupin21.farm.particle.cz |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-18 21:42:45 |
| Input files | monte-carlo-012083-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (10429s) |
| CPU time | 2h (10086s = 96%) |
| Max RSS bytes | 4262428672 (4064 MiB) |
| Outputting started | 2026-01-19 00:36:35 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12083/1/001/reco_stage1.root
|
| Finished | 2026-01-19 00:37:17 |
| Saved logs | justin-logs:281534.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
nning tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 156799 traces, 0 summary
Retagger: tagging trace set: gauss with 119637 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 119637 traces tagged "gauss"
FrameSaver: q=3.96842e+06 n=2101274 tag=gauss
wclsFrameSaver: saving 156799 traces tagged "wiener"
FrameSaver: q=4.23306e+06 n=1858289 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 29267 XUs and 25246 XVs -> 1045 XUVs
C:0 T:1 76301 XUs and 75287 XVs -> 7056 XUVs
C:0 T:2 83869 XUs and 111012 XVs -> 4067 XUVs
C:0 T:3 41196 XUs and 41169 XVs -> 248 XUVs
C:0 T:4 15795 XUs and 11211 XVs -> 114 XUVs
C:0 T:5 77318 XUs and 60826 XVs -> 9552 XUVs
C:0 T:6 106674 XUs and 104399 XVs -> 4776 XUVs
C:0 T:7 40468 XUs and 38280 XVs -> 324 XUVs
C:0 T:8 12943 XUs and 13991 XVs -> 186 XUVs
C:0 T:9 103933 XUs and 159114 XVs -> 12235 XUVs
C:0 T:10 72632 XUs and 52935 XVs -> 6516 XUVs
C:0 T:11 326 XUs and 261 XVs -> 20 XUVs
46139 XUVs total
16050 collection wire objects
41937 potential space points
Neighbour search...
4418821 tests to find 1943886 neighbours
Iterating with no regularization...
Begin: 8.0766e+07
0 5.95452e+07
1 5.78079e+07
2 5.74816e+07
3 5.73787e+07
4 5.73355e+07
Now with regularization...
Begin: 4.40158e+07
0 4.39085e+07
1 4.38565e+07
2 4.38263e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411824331
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411824331
fLifetime: 30000 [us]
19-Jan-2026 01:36:33 CET Closed output file "reco_stage1.root"
19-Jan-2026 01:36:33 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 259.037 361.368 424.026 358.324 50.5981 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00120946 0.00318862 0.00494457 0.00324471 0.00125449 10
reco:ophit:OpHitFinder 0.27154 0.300615 0.316486 0.306115 0.0150562 10
reco:opflash:OpFlashFinder 0.15716 0.198364 0.231064 0.193629 0.0243045 10
reco:opslicer:OpSlicer 0.60637 0.753015 0.878739 0.747752 0.0826291 10
reco:caldata:DataPrepModule 5.2381 5.48364 5.77034 5.45542 0.175444 10
reco:wclsdatasp:WireCellToolkit 31.9006 35.7541 37.5596 36.3186 1.88828 10
reco:gaushit:GausHitFinder 1.05793 1.31095 1.52323 1.30842 0.142457 10
reco:nhitsfilter:NumberOfHitsFilter 0.000486858 0.000586113 0.000805836 0.000563592 9.30384e-05 10
reco:reco3d:SpacePointSolver 8.54551 14.2183 19.1508 14.7873 3.04068 10
reco:hitpdune:DisambigFromSpacePoints 1.02603 1.69349 2.05518 1.81838 0.344462 10
reco:pandora:StandardPandora 23.8538 39.8049 52.449 38.5792 8.21442 10
reco:pandoraWriter:StandardPandora 0.461124 0.643064 0.778435 0.655791 0.102653 10
reco:pandoraTrack:LArPandoraTrackCreation 3.41611 5.47839 7.39756 5.26151 1.27596 10
reco:pandoraShower:LArPandoraShowerCreation 3.05976 6.20346 8.64225 5.91432 1.68064 10
reco:pandoracalo:Calorimetry 1.58527 2.71218 3.5398 2.79348 0.593687 10
reco:pandoracalonosce:Calorimetry 1.44358 2.50893 3.29666 2.63882 0.563309 10
reco:pandorapid:Chi2ParticleID 0.00517817 0.00656817 0.00866137 0.00658892 0.000960256 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0417001 0.0557998 0.0651126 0.0573559 0.00724575 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.005122 0.00618456 0.00697386 0.00623405 0.0006176 10
reco:pandoraShowercalo:ShowerCalorimetry 2.46196 5.60673 7.78194 5.58244 1.53674 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.37852 5.41622 7.60004 5.30203 1.50959 10
reco:emtrkmichelid:EmTrackMichelId 136.556 177.603 203.226 180.573 21.2881 10
reco:crttag:SingleCRTMatchingProducer 0.0104403 0.0152093 0.0213106 0.0149953 0.00303717 10
reco:crtreco:TwoCRTMatchingProducer 0.007835 0.0110348 0.0139001 0.0115502 0.00193073 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.746815 0.901159 1.08986 0.912292 0.0989897 10
reco:pandora2Track:LArPandoraTrackCreation 9.80446 17.7792 24.9537 17.3861 4.43206 10
reco:pandora2calo:Calorimetry 3.90176 7.73504 10.8802 7.68533 1.98282 10
reco:pandora2calonosce:Calorimetry 3.58696 7.27672 10.6643 7.04294 1.91963 10
reco:pandora2pid:Chi2ParticleID 0.0126736 0.0174598 0.0217607 0.0178489 0.00248223 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0499487 0.0723512 0.0904514 0.0736532 0.0104799 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0124681 0.0165945 0.0192297 0.0170121 0.00213664 10
reco:pandora2Shower:LArPandoraShowerCreation 3.74302 6.42293 9.25971 6.16567 1.54164 10
reco:pandora2Showercalo:ShowerCalorimetry 3.25546 6.25548 9.42382 6.05227 1.62506 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.83489 5.51284 8.21314 5.43226 1.41579 10
[art]:TriggerResults:TriggerResultInserter 4.004e-05 5.79899e-05 0.00014767 4.589e-05 3.04938e-05 10
end_path:out1:RootOutput 8.5e-06 1.0037e-05 1.586e-05 9.6e-06 2.02586e-06 10
end_path:out1:RootOutput(write) 2.77824 3.47585 4.00776 3.46674 0.435457 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5075.17 MB
Peak resident set size usage (VmHWM): 4262.43 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.58 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10813100
-rw-r--r-- 1 fermilab users 2519564684 Jan 19 00:33 detsim_stage2.root
-rw-r--r-- 1 fermilab users 2390586534 Jan 19 00:30 detsim_stage1.root
-rw-r--r-- 1 fermilab users 2232521498 Jan 19 01:36 reco_stage1.root
-rw-r--r-- 1 fermilab users 1966386053 Jan 18 23:02 g4_stage2.root
-rw-r--r-- 1 fermilab users 1881702748 Jan 18 22:49 g4_stage1.root
-rw-r--r-- 1 fermilab users 81218520 Jan 19 01:31 Pandora_Events.pndr
-rw-r--r-- 1 fermilab users 242864 Jan 19 01:36 jobscript.log
-rw-r--r-- 1 fermilab users 217088 Jan 19 01:36 mem.db
-rw-r--r-- 1 fermilab users 62376 Jan 19 01:36 Pandora_Geometry.xml
-rw-r--r-- 1 fermilab users 36864 Jan 19 01:36 time.db
-rw-r--r-- 1 fermilab users 519 Jan 19 00:33 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 18 23:02 g4_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 19 01:36 protoDUNE_reco1_hist.root
-rw-r--r-- 1 fermilab users 52 Jan 18 22:42 all-input-dids.txt
-rw-r--r-- 1 fermilab users 7 Jan 19 01:36 justin-processed-pfns.txt
-rw-r--r-- 1 fermilab users 0 Jan 19 00:40 ProtoDUNE.log
-rw-r--r-- 1 fermilab users 0 Jan 19 00:33 debugprod.log
