Jobsub ID 261516.1@dunegpschedd02.fnal.gov
| Jobsub ID | 261516.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11182 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 08:07:11 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 15:00:20 |
| From worker node | Hostname | dunegli-7890434-0-fnpc23039.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:36:44 |
| Input files | monte-carlo-011182-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12186s) |
| CPU time | 3h (12069s = 99%) |
| Max RSS bytes | 4473540608 (4266 MiB) |
| Outputting started | 2025-12-12 14:59:50 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11182/1/001/reco_stage1.root
|
| Finished | 2025-12-12 15:00:20 |
| Saved logs | justin-logs:261516.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 170473 traces, 0 summary
Retagger: tagging trace set: gauss with 126227 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 126227 traces tagged "gauss"
FrameSaver: q=4.54041e+06 n=2184347 tag=gauss
wclsFrameSaver: saving 170473 traces tagged "wiener"
FrameSaver: q=4.8173e+06 n=1916094 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 36495 XUs and 39933 XVs -> 700 XUVs
C:0 T:1 60064 XUs and 60731 XVs -> 9013 XUVs
C:0 T:2 127271 XUs and 153821 XVs -> 7011 XUVs
C:0 T:3 64822 XUs and 61975 XVs -> 376 XUVs
C:0 T:4 15350 XUs and 13277 XVs -> 293 XUVs
C:0 T:5 210273 XUs and 116155 XVs -> 46528 XUVs
C:0 T:6 75648 XUs and 90829 XVs -> 3896 XUVs
C:0 T:7 30636 XUs and 35397 XVs -> 255 XUVs
C:0 T:8 8059 XUs and 5820 XVs -> 111 XUVs
C:0 T:9 82865 XUs and 63189 XVs -> 12167 XUVs
C:0 T:10 123449 XUs and 104493 XVs -> 17452 XUVs
C:0 T:11 328 XUs and 254 XVs -> 21 XUVs
97823 XUVs total
14144 collection wire objects
93980 potential space points
Neighbour search...
26007554 tests to find 10277018 neighbours
Iterating with no regularization...
Begin: 8.4047e+07
0 6.842e+07
1 6.72666e+07
2 6.71059e+07
3 6.70591e+07
Now with regularization...
Begin: 5.46569e+07
0 5.46013e+07
1 5.45543e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411058640
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411058640
fLifetime: 30000 [us]
12-Dec-2025 14:59:48 UTC Closed output file "reco_stage1.root"
12-Dec-2025 14:59:48 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 304.887 430.346 564.56 419.879 68.0913 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00175227 0.00601863 0.00913787 0.00624892 0.00230551 10
reco:ophit:OpHitFinder 0.229089 0.27555 0.325417 0.276718 0.0249142 10
reco:opflash:OpFlashFinder 0.141778 0.186309 0.227363 0.187606 0.0283937 10
reco:opslicer:OpSlicer 0.499982 0.558032 0.627811 0.544495 0.0438279 10
reco:caldata:DataPrepModule 4.48414 4.90885 5.23833 4.91734 0.18617 10
reco:wclsdatasp:WireCellToolkit 49.6322 52.4462 57.3887 50.9704 2.72303 10
reco:gaushit:GausHitFinder 0.912525 1.21516 1.58283 1.18797 0.162753 10
reco:nhitsfilter:NumberOfHitsFilter 0.00225679 0.00324743 0.00408265 0.00312268 0.000559991 10
reco:reco3d:SpacePointSolver 12.0862 20.2708 34.9517 17.7159 6.58817 10
reco:hitpdune:DisambigFromSpacePoints 1.11829 1.91361 2.45467 1.83519 0.38074 10
reco:pandora:StandardPandora 20.262 39.895 59.986 37.0831 10.9398 10
reco:pandoraWriter:StandardPandora 0.634222 0.815934 0.943928 0.825 0.0908017 10
reco:pandoraTrack:LArPandoraTrackCreation 5.24489 12.3001 18.9912 11.1628 4.60537 10
reco:pandoraShower:LArPandoraShowerCreation 2.54747 8.8021 23.5304 7.31452 5.87289 10
reco:pandoracalo:Calorimetry 2.01748 3.66596 8.45194 3.20488 1.75733 10
reco:pandoracalonosce:Calorimetry 1.79612 3.18648 8.63038 2.55549 1.89254 10
reco:pandorapid:Chi2ParticleID 0.00496012 0.00608179 0.00819153 0.00593265 0.000784454 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0412559 0.0510299 0.0605122 0.0502146 0.00569113 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00413945 0.00572293 0.00665085 0.00569546 0.000735015 10
reco:pandoraShowercalo:ShowerCalorimetry 2.20953 5.11262 7.19814 5.28174 1.37039 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.09729 4.75369 6.21528 4.75251 1.19634 10
reco:emtrkmichelid:EmTrackMichelId 164.09 199.728 236.383 195.577 21.7744 10
reco:crttag:SingleCRTMatchingProducer 0.0217919 0.0377287 0.0750411 0.0285402 0.017454 10
reco:crtreco:TwoCRTMatchingProducer 0.0110948 0.0258201 0.061837 0.0129456 0.0206449 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.568807 0.822284 0.926906 0.833331 0.0979285 10
reco:pandora2Track:LArPandoraTrackCreation 13.2815 33.1161 62.4806 29.6174 13.9416 10
reco:pandora2calo:Calorimetry 3.86204 8.28554 21.1961 7.3023 4.49831 10
reco:pandora2calonosce:Calorimetry 3.60542 7.27096 11.5975 7.27064 2.1218 10
reco:pandora2pid:Chi2ParticleID 0.00935953 0.0133087 0.0151185 0.0135016 0.00147441 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0525165 0.0676458 0.0767694 0.0666678 0.00670794 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00903091 0.0132556 0.0147065 0.0137962 0.00153767 10
reco:pandora2Shower:LArPandoraShowerCreation 2.86302 6.67184 18.199 5.15799 4.36571 10
reco:pandora2Showercalo:ShowerCalorimetry 3.17724 5.65894 7.61132 5.96875 1.09915 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.93482 4.72222 5.85871 4.82679 0.819841 10
[art]:TriggerResults:TriggerResultInserter 6.4462e-05 0.000106937 0.000271256 8.97055e-05 5.5872e-05 10
end_path:out1:RootOutput 1.8365e-05 2.32803e-05 3.0939e-05 2.31145e-05 4.05722e-06 10
end_path:out1:RootOutput(write) 2.40058 3.13249 3.69355 3.14834 0.430961 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5285.03 MB
Peak resident set size usage (VmHWM): 4473.54 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.30 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.47 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11473428
-rw-r--r-- 1 dunegli fnalgrid 2649710379 Dec 12 13:45 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2512465936 Dec 12 13:43 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2401668791 Dec 12 14:59 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2085402705 Dec 12 11:53 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2008626989 Dec 12 11:41 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 90301990 Dec 12 14:54 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242877 Dec 12 14:59 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 14:59 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 14:59 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 14:59 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 13:45 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 11:53 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 14:59 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 14:59 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 13:51 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 13:45 debugprod.log
