Jobsub ID 248641.0@dunegpschedd01.fnal.gov
| Jobsub ID | 248641.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10091 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-13 09:39:17 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-13 12:08:44 |
| From worker node | Hostname | dunegli-7572300-0-fnpc22004.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-13 09:39:45 |
| Input files | monte-carlo-010091-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8925s) |
| CPU time | 2h (8679s = 97%) |
| Max RSS bytes | 4195930112 (4001 MiB) |
| Outputting started | 2025-11-13 12:08:30 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10091/1/001/reco_stage1.root
|
| Finished | 2025-11-13 12:08:44 |
| Saved logs | justin-logs:248641.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
cScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 127831 traces, 0 summary
Retagger: tagging trace set: gauss with 98254 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 98254 traces tagged "gauss"
FrameSaver: q=3.45968e+06 n=1780875 tag=gauss
wclsFrameSaver: saving 127831 traces tagged "wiener"
FrameSaver: q=3.66127e+06 n=1586254 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 33596 XUs and 28753 XVs -> 233 XUVs
C:0 T:1 57744 XUs and 47674 XVs -> 3444 XUVs
C:0 T:2 73036 XUs and 89376 XVs -> 2913 XUVs
C:0 T:3 39017 XUs and 40551 XVs -> 244 XUVs
C:0 T:4 16065 XUs and 14297 XVs -> 130 XUVs
C:0 T:5 73508 XUs and 55094 XVs -> 9565 XUVs
C:0 T:6 137732 XUs and 175816 XVs -> 21278 XUVs
C:0 T:7 42318 XUs and 35185 XVs -> 674 XUVs
C:0 T:8 8392 XUs and 8008 XVs -> 123 XUVs
C:0 T:9 71786 XUs and 90182 XVs -> 8782 XUVs
C:0 T:10 59903 XUs and 79220 XVs -> 28293 XUVs
C:0 T:11 79 XUs and 76 XVs -> 18 XUVs
75697 XUVs total
11590 collection wire objects
71562 potential space points
Neighbour search...
17283362 tests to find 7074098 neighbours
Iterating with no regularization...
Begin: 8.14073e+07
0 6.80899e+07
1 6.72662e+07
2 6.71584e+07
3 6.71248e+07
Now with regularization...
Begin: 5.76217e+07
0 5.75379e+07
1 5.74784e+07
2 5.74311e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410486562
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410486562
fLifetime: 30000 [us]
13-Nov-2025 12:08:29 UTC Closed output file "reco_stage1.root"
13-Nov-2025 12:08:29 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 177.194 265.681 355.209 256.632 60.4458 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000655084 0.00359117 0.0058605 0.00391625 0.00158168 10
reco:ophit:OpHitFinder 0.18522 0.24825 0.301792 0.25269 0.0338045 10
reco:opflash:OpFlashFinder 0.101926 0.131738 0.176105 0.132207 0.0225966 10
reco:opslicer:OpSlicer 0.414695 0.558559 0.744822 0.542846 0.112752 10
reco:caldata:DataPrepModule 3.50851 4.63273 5.95306 4.12243 0.924813 10
reco:wclsdatasp:WireCellToolkit 22.7586 27.24 32.6481 27.5404 3.45438 10
reco:gaushit:GausHitFinder 0.596191 1.03864 1.49902 1.04112 0.276933 10
reco:nhitsfilter:NumberOfHitsFilter 0.00026375 0.000433967 0.000563701 0.000461101 8.91595e-05 10
reco:reco3d:SpacePointSolver 6.46836 12.7122 27.1265 12.0026 5.63196 10
reco:hitpdune:DisambigFromSpacePoints 0.718203 1.36213 2.05001 1.38962 0.392759 10
reco:pandora:StandardPandora 13.5616 27.7165 49.0944 23.4618 11.2965 10
reco:pandoraWriter:StandardPandora 0.204098 0.377667 0.800269 0.33533 0.164345 10
reco:pandoraTrack:LArPandoraTrackCreation 1.44757 2.29927 4.13419 2.25201 0.758506 10
reco:pandoraShower:LArPandoraShowerCreation 1.56609 3.00381 5.7397 2.7444 1.24272 10
reco:pandoracalo:Calorimetry 0.840056 1.46313 2.54915 1.4457 0.499065 10
reco:pandoracalonosce:Calorimetry 0.766485 1.35038 2.2949 1.31156 0.426873 10
reco:pandorapid:Chi2ParticleID 0.00280107 0.00456615 0.0069201 0.00460867 0.00121014 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0259331 0.0473346 0.0840343 0.0503084 0.0160723 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00259341 0.00418527 0.00643284 0.00431383 0.00123549 10
reco:pandoraShowercalo:ShowerCalorimetry 1.51747 3.35102 6.32353 3.21823 1.23434 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.48205 3.23309 6.20055 3.11023 1.19568 10
reco:emtrkmichelid:EmTrackMichelId 96.7707 143.708 188.083 143.592 31.3331 10
reco:crttag:SingleCRTMatchingProducer 0.00669267 0.0159093 0.0598553 0.0112381 0.0147615 10
reco:crtreco:TwoCRTMatchingProducer 0.00400423 0.00613539 0.00758609 0.00618815 0.00109717 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.467252 0.678311 0.863712 0.693639 0.106318 10
reco:pandora2Track:LArPandoraTrackCreation 5.19788 8.45692 12.488 7.51671 2.51142 10
reco:pandora2calo:Calorimetry 2.92627 4.52217 6.57969 4.03016 1.29236 10
reco:pandora2calonosce:Calorimetry 2.84774 4.3131 6.21127 3.82147 1.22035 10
reco:pandora2pid:Chi2ParticleID 0.00708037 0.0126521 0.0219069 0.0123578 0.00430853 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0375434 0.0602755 0.104502 0.0614657 0.0198076 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00649969 0.0105554 0.0150396 0.0106758 0.00278566 10
reco:pandora2Shower:LArPandoraShowerCreation 2.00969 3.12959 4.5364 2.76934 0.917318 10
reco:pandora2Showercalo:ShowerCalorimetry 2.59678 3.92914 5.70936 3.54059 1.16202 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.39735 3.65794 5.22405 3.27466 1.04644 10
[art]:TriggerResults:TriggerResultInserter 4.1279e-05 7.18384e-05 0.000145837 5.6688e-05 3.07037e-05 10
end_path:out1:RootOutput 9.158e-06 1.71518e-05 4.9284e-05 1.14065e-05 1.19573e-05 10
end_path:out1:RootOutput(write) 1.77335 2.33931 3.03302 2.26495 0.406599 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5012.54 MB
Peak resident set size usage (VmHWM): 4195.93 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.79 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10043452
-rw-r--r-- 1 dunegli fnalgrid 2369961736 Nov 13 11:22 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2251985639 Nov 13 11:20 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2055171265 Nov 13 12:08 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1807550373 Nov 13 09:52 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1724341425 Nov 13 09:44 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 74871960 Nov 13 12:04 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242954 Nov 13 12:08 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 13 12:08 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 13 12:08 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 13 12:08 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 11:22 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 09:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 12:08 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 13 09:39 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 13 12:08 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 13 11:26 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 13 11:22 debugprod.log
