Jobsub ID 242440.0@dunegpschedd01.fnal.gov
| Jobsub ID | 242440.0@dunegpschedd01.fnal.gov |
| Workflow ID | 9559 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-03 17:01:06 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-03 19:09:54 |
| From worker node | Hostname | dunegli-7472723-0-fnpc23120.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-03 17:03:18 |
| Input files | monte-carlo-009559-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7584s) |
| CPU time | 2h (7491s = 98%) |
| Max RSS bytes | 4423909376 (4218 MiB) |
| Outputting started | 2025-11-03 19:09:42 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09559/1/001/reco_stage1.root
|
| Finished | 2025-11-03 19:09:54 |
| Saved logs | justin-logs:242440.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 149718 traces, 0 summary
Retagger: tagging trace set: gauss with 119586 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 119586 traces tagged "gauss"
FrameSaver: q=4.11168e+06 n=2179134 tag=gauss
wclsFrameSaver: saving 149718 traces tagged "wiener"
FrameSaver: q=4.33293e+06 n=1958451 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 37313 XUs and 40375 XVs -> 419 XUVs
C:0 T:1 67391 XUs and 66224 XVs -> 3735 XUVs
C:0 T:2 179591 XUs and 165867 XVs -> 10080 XUVs
C:0 T:3 69891 XUs and 62392 XVs -> 521 XUVs
C:0 T:4 11366 XUs and 10963 XVs -> 109 XUVs
C:0 T:5 38776 XUs and 27691 XVs -> 3139 XUVs
C:0 T:6 241121 XUs and 208723 XVs -> 17522 XUVs
C:0 T:7 70402 XUs and 73038 XVs -> 933 XUVs
C:0 T:8 7759 XUs and 9221 XVs -> 233 XUVs
C:0 T:9 39169 XUs and 62159 XVs -> 2907 XUVs
C:0 T:10 98381 XUs and 36422 XVs -> 6222 XUVs
C:0 T:11 70 XUs and 38 XVs -> 6 XUVs
45826 XUVs total
13869 collection wire objects
41959 potential space points
Neighbour search...
6020513 tests to find 2549982 neighbours
Iterating with no regularization...
Begin: 9.0701e+07
0 7.40581e+07
1 7.29733e+07
2 7.28018e+07
3 7.27548e+07
Now with regularization...
Begin: 6.09909e+07
0 6.09609e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410291557
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410291557
fLifetime: 30000 [us]
03-Nov-2025 19:09:41 UTC Closed output file "reco_stage1.root"
03-Nov-2025 19:09:41 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 165.002 211.388 266.798 212.612 35.0033 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000568452 0.0027336 0.00483748 0.00290342 0.00129471 10
reco:ophit:OpHitFinder 0.178237 0.22379 0.24824 0.229388 0.0206731 10
reco:opflash:OpFlashFinder 0.104786 0.157234 0.177453 0.167688 0.0230915 10
reco:opslicer:OpSlicer 0.32025 0.421628 0.50336 0.427155 0.0459738 10
reco:caldata:DataPrepModule 3.06671 3.19913 3.38206 3.17967 0.0854338 10
reco:wclsdatasp:WireCellToolkit 20.0127 20.94 21.7148 20.9858 0.617393 10
reco:gaushit:GausHitFinder 0.507395 0.654864 0.762321 0.650479 0.0897881 10
reco:nhitsfilter:NumberOfHitsFilter 0.000190108 0.000251096 0.000353466 0.000248547 4.32015e-05 10
reco:reco3d:SpacePointSolver 6.09581 10.3011 17.1103 10.0898 3.53274 10
reco:hitpdune:DisambigFromSpacePoints 0.638333 0.917995 1.30724 0.911055 0.226654 10
reco:pandora:StandardPandora 12.4708 24.479 38.8981 23.7275 9.16131 10
reco:pandoraWriter:StandardPandora 0.183379 0.245149 0.326221 0.247752 0.0430396 10
reco:pandoraTrack:LArPandoraTrackCreation 1.5701 2.17546 3.25394 2.23344 0.469596 10
reco:pandoraShower:LArPandoraShowerCreation 1.44361 2.45137 3.49748 2.41129 0.719755 10
reco:pandoracalo:Calorimetry 0.962822 1.27189 1.89866 1.26396 0.274963 10
reco:pandoracalonosce:Calorimetry 0.89259 1.18613 1.79137 1.16854 0.263188 10
reco:pandorapid:Chi2ParticleID 0.00261463 0.00329566 0.00404927 0.00324648 0.000396857 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0220797 0.0277302 0.0329439 0.0288579 0.0035561 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00248431 0.00297359 0.00354718 0.00296502 0.00028746 10
reco:pandoraShowercalo:ShowerCalorimetry 1.35073 2.66093 3.8887 2.67889 0.85172 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.323 2.596 3.81768 2.61961 0.835616 10
reco:emtrkmichelid:EmTrackMichelId 89.5977 112.351 140.415 112.688 16.3526 10
reco:crttag:SingleCRTMatchingProducer 0.00538782 0.0073178 0.0108182 0.00719524 0.00167272 10
reco:crtreco:TwoCRTMatchingProducer 0.00338763 0.0043341 0.00523761 0.00441538 0.000592281 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.423492 0.513637 0.601789 0.509569 0.0596632 10
reco:pandora2Track:LArPandoraTrackCreation 4.3308 6.8391 9.70637 6.91407 1.81339 10
reco:pandora2calo:Calorimetry 2.31575 3.70018 5.30912 3.76448 1.04315 10
reco:pandora2calonosce:Calorimetry 2.19487 3.54203 5.08359 3.61878 1.01191 10
reco:pandora2pid:Chi2ParticleID 0.00596165 0.00743817 0.00872734 0.00748256 0.0009588 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0269364 0.0344889 0.0419271 0.0358198 0.00485761 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00584118 0.00734176 0.00862634 0.00736288 0.000981666 10
reco:pandora2Shower:LArPandoraShowerCreation 1.55588 2.51649 3.57995 2.57741 0.647164 10
reco:pandora2Showercalo:ShowerCalorimetry 1.91569 3.19515 4.53342 3.29607 0.900139 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.75228 2.90692 4.12012 3.01314 0.806186 10
[art]:TriggerResults:TriggerResultInserter 2.5569e-05 3.74239e-05 0.000101635 3.1753e-05 2.17063e-05 10
end_path:out1:RootOutput 5.989e-06 8.7641e-06 1.2989e-05 8.568e-06 1.63607e-06 10
end_path:out1:RootOutput(write) 1.40232 1.78163 2.45752 1.79241 0.312391 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5232.9 MB
Peak resident set size usage (VmHWM): 4423.91 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 1.91 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11480404
-rw-r--r-- 1 dunegli fnalgrid 2663422992 Nov 3 18:33 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2527885468 Nov 3 18:31 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2363249680 Nov 3 19:09 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2114523201 Nov 3 17:15 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2007221367 Nov 3 17:06 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 79006750 Nov 3 19:06 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243036 Nov 3 19:09 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 3 19:09 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 3 19:09 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 3 19:09 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 18:33 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 17:15 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 19:09 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 3 17:03 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 3 19:09 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 18:35 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 18:33 debugprod.log
