Jobsub ID 301517.0@dunegpschedd01.fnal.gov
| Jobsub ID | 301517.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12445 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-27 14:23:30 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-27 16:19:48 |
| From worker node | Hostname | dunegli-8295194-0-fnpc23002.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-27 14:23:56 |
| Input files | monte-carlo-012445-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6941s) |
| CPU time | 1h (6869s = 98%) |
| Max RSS bytes | 4013785088 (3827 MiB) |
| Outputting started | 2026-01-27 16:19:38 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12445/1/001/reco_stage1.root
|
| Finished | 2026-01-27 16:19:48 |
| Saved logs | justin-logs:301517.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 122696 traces, 0 summary
Retagger: tagging trace set: gauss with 95853 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95853 traces tagged "gauss"
FrameSaver: q=3.47673e+06 n=1764186 tag=gauss
wclsFrameSaver: saving 122696 traces tagged "wiener"
FrameSaver: q=3.67161e+06 n=1583195 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 11401 XUs and 16043 XVs -> 112 XUVs
C:0 T:1 24164 XUs and 30925 XVs -> 2467 XUVs
C:0 T:2 85527 XUs and 83346 XVs -> 4766 XUVs
C:0 T:3 45976 XUs and 31583 XVs -> 232 XUVs
C:0 T:4 8292 XUs and 9189 XVs -> 81 XUVs
C:0 T:5 72701 XUs and 20795 XVs -> 5040 XUVs
C:0 T:6 88978 XUs and 70604 XVs -> 5433 XUVs
C:0 T:7 36821 XUs and 28200 XVs -> 276 XUVs
C:0 T:8 12149 XUs and 15019 XVs -> 200 XUVs
C:0 T:9 89644 XUs and 128035 XVs -> 10921 XUVs
C:0 T:10 69593 XUs and 38762 XVs -> 4741 XUVs
C:0 T:11 520 XUs and 401 XVs -> 64 XUVs
34333 XUVs total
11302 collection wire objects
31839 potential space points
Neighbour search...
2633153 tests to find 1366576 neighbours
Iterating with no regularization...
Begin: 8.9398e+07
0 7.22143e+07
1 7.10909e+07
2 7.09265e+07
3 7.08744e+07
Now with regularization...
Begin: 5.89393e+07
0 5.88781e+07
1 5.88448e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411999276
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411999276
fLifetime: 30000 [us]
27-Jan-2026 16:19:37 UTC Closed output file "reco_stage1.root"
27-Jan-2026 16:19:37 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 139.901 199.211 275.384 200.237 36.5086 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000689065 0.00285893 0.00595559 0.00300497 0.00148576 10
reco:ophit:OpHitFinder 0.181244 0.19865 0.232671 0.195974 0.0157503 10
reco:opflash:OpFlashFinder 0.100995 0.120308 0.165826 0.11681 0.0181275 10
reco:opslicer:OpSlicer 0.33719 0.426476 0.522782 0.421699 0.0637022 10
reco:caldata:DataPrepModule 3.37617 3.48907 3.72703 3.46227 0.10097 10
reco:wclsdatasp:WireCellToolkit 22.0391 23.4524 24.6641 23.4274 0.694689 10
reco:gaushit:GausHitFinder 0.602942 0.778097 0.947061 0.79396 0.112069 10
reco:nhitsfilter:NumberOfHitsFilter 0.000220741 0.000321319 0.000443095 0.000312967 6.62328e-05 10
reco:reco3d:SpacePointSolver 4.92414 8.50967 13.1636 8.09151 2.59017 10
reco:hitpdune:DisambigFromSpacePoints 0.548946 0.972283 1.51433 0.951559 0.279803 10
reco:pandora:StandardPandora 8.25502 18.9381 31.5442 17.9294 6.54125 10
reco:pandoraWriter:StandardPandora 0.174864 0.237692 0.324137 0.23525 0.0409993 10
reco:pandoraTrack:LArPandoraTrackCreation 1.09849 1.88716 2.59007 1.87469 0.383695 10
reco:pandoraShower:LArPandoraShowerCreation 1.06022 2.20198 3.86377 2.0451 0.75924 10
reco:pandoracalo:Calorimetry 0.66391 1.16358 1.61363 1.17005 0.250799 10
reco:pandoracalonosce:Calorimetry 0.593221 1.07433 1.49394 1.07409 0.235433 10
reco:pandorapid:Chi2ParticleID 0.00262248 0.00324137 0.00414708 0.00314359 0.000433665 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0256805 0.030523 0.0421355 0.028911 0.00476031 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00243471 0.00298164 0.00346048 0.00294653 0.000291673 10
reco:pandoraShowercalo:ShowerCalorimetry 1.09642 2.49276 4.44235 2.38197 0.940033 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.06563 2.43029 4.33163 2.32016 0.921606 10
reco:emtrkmichelid:EmTrackMichelId 79.8037 107.121 142.099 107.172 16.6119 10
reco:crttag:SingleCRTMatchingProducer 0.00568166 0.0082775 0.0120451 0.00800878 0.00168324 10
reco:crtreco:TwoCRTMatchingProducer 0.00362455 0.00464912 0.00594377 0.00476351 0.000681461 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.409389 0.546741 0.767303 0.533738 0.116295 10
reco:pandora2Track:LArPandoraTrackCreation 3.17784 6.2773 10.6703 5.90924 1.98464 10
reco:pandora2calo:Calorimetry 1.66565 3.45516 5.69967 3.36132 1.10661 10
reco:pandora2calonosce:Calorimetry 1.56871 3.30238 5.47222 3.19935 1.07008 10
reco:pandora2pid:Chi2ParticleID 0.00535958 0.00774648 0.00992544 0.00744053 0.00126906 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.029308 0.0379802 0.0516566 0.036657 0.00609616 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00529306 0.00756785 0.0102067 0.00730446 0.0012748 10
reco:pandora2Shower:LArPandoraShowerCreation 1.2576 2.33883 3.81755 2.19418 0.666402 10
reco:pandora2Showercalo:ShowerCalorimetry 1.46909 3.0519 5.10546 2.97638 0.983703 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.3503 2.79751 4.70342 2.73793 0.895813 10
[art]:TriggerResults:TriggerResultInserter 2.657e-05 3.62543e-05 9.0052e-05 3.0799e-05 1.80302e-05 10
end_path:out1:RootOutput 6.182e-06 7.1909e-06 1.029e-05 6.868e-06 1.09901e-06 10
end_path:out1:RootOutput(write) 1.31627 1.79243 2.47162 1.75935 0.308743 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4832.7 MB
Peak resident set size usage (VmHWM): 4013.79 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9553344
-rw-r--r-- 1 dunegli fnalgrid 2268450731 Jan 27 15:45 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2153849055 Jan 27 15:44 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1945001213 Jan 27 16:19 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1706406755 Jan 27 14:34 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1635668573 Jan 27 14:27 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 72615530 Jan 27 16:17 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242872 Jan 27 16:19 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 27 16:19 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 27 16:19 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 27 16:19 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 27 15:45 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 27 14:34 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 27 16:19 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 27 14:23 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 27 16:19 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 27 15:48 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 27 15:45 debugprod.log
