Jobsub ID 266074.0@dunegpschedd02.fnal.gov
| Jobsub ID | 266074.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11530 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-05 08:00:05 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-05 11:47:25 |
| From worker node | Hostname | dunegli-8089765-0-fnpc19110.fnal.gov |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-05 08:26:40 |
| Input files | monte-carlo-011530-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12030s) |
| CPU time | 3h (11916s = 99%) |
| Max RSS bytes | 4339036160 (4138 MiB) |
| Outputting started | 2026-01-05 11:47:10 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11530/1/001/reco_stage1.root
|
| Finished | 2026-01-05 11:47:25 |
| Saved logs | justin-logs:266074.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 166628 traces, 0 summary
Retagger: tagging trace set: gauss with 124820 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 124820 traces tagged "gauss"
FrameSaver: q=4.49722e+06 n=2224245 tag=gauss
wclsFrameSaver: saving 166628 traces tagged "wiener"
FrameSaver: q=4.76759e+06 n=1975899 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 36483 XUs and 33731 XVs -> 330 XUVs
C:0 T:1 50519 XUs and 47605 XVs -> 3902 XUVs
C:0 T:2 68082 XUs and 114355 XVs -> 3925 XUVs
C:0 T:3 35251 XUs and 43467 XVs -> 248 XUVs
C:0 T:4 16759 XUs and 18922 XVs -> 108 XUVs
C:0 T:5 66772 XUs and 55496 XVs -> 3828 XUVs
C:0 T:6 196392 XUs and 163058 XVs -> 7880 XUVs
C:0 T:7 69093 XUs and 53076 XVs -> 621 XUVs
C:0 T:8 10717 XUs and 9805 XVs -> 149 XUVs
C:0 T:9 69610 XUs and 78411 XVs -> 6222 XUVs
C:0 T:10 69304 XUs and 67254 XVs -> 9718 XUVs
C:0 T:11 591 XUs and 369 XVs -> 102 XUVs
37033 XUVs total
14682 collection wire objects
34276 potential space points
Neighbour search...
1572008 tests to find 840024 neighbours
Iterating with no regularization...
Begin: 9.58025e+07
0 8.05631e+07
1 7.96001e+07
2 7.94496e+07
3 7.94074e+07
Now with regularization...
Begin: 6.59492e+07
0 6.59091e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411551351
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411551351
fLifetime: 30000 [us]
05-Jan-2026 11:47:08 UTC Closed output file "reco_stage1.root"
05-Jan-2026 11:47:08 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 255.056 377.56 477.394 364.87 60.2347 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000658422 0.00284074 0.00538802 0.00297978 0.00124674 10
reco:ophit:OpHitFinder 0.240542 0.275273 0.320817 0.275812 0.0221734 10
reco:opflash:OpFlashFinder 0.137905 0.185384 0.224155 0.182319 0.0252867 10
reco:opslicer:OpSlicer 0.48035 0.678298 0.82987 0.661986 0.0930457 10
reco:caldata:DataPrepModule 4.25672 4.39229 4.52999 4.38425 0.0830335 10
reco:wclsdatasp:WireCellToolkit 26.8921 30.245 31.9712 31.2295 1.78397 10
reco:gaushit:GausHitFinder 0.764112 1.08636 1.37281 1.08304 0.155053 10
reco:nhitsfilter:NumberOfHitsFilter 0.000491182 0.000574612 0.000661702 0.000575172 4.86892e-05 10
reco:reco3d:SpacePointSolver 8.19724 13.3927 20.3695 12.7794 3.50616 10
reco:hitpdune:DisambigFromSpacePoints 1.02911 1.66781 2.3114 1.63757 0.323405 10
reco:pandora:StandardPandora 21.1898 37.0075 52.6645 34.9495 8.65063 10
reco:pandoraWriter:StandardPandora 0.333835 0.433806 0.497463 0.440384 0.0460715 10
reco:pandoraTrack:LArPandoraTrackCreation 2.35835 4.30253 5.65652 4.26565 0.805427 10
reco:pandoraShower:LArPandoraShowerCreation 2.39607 5.50601 7.4596 5.52083 1.31702 10
reco:pandoracalo:Calorimetry 1.26868 2.11632 2.91415 2.10925 0.401403 10
reco:pandoracalonosce:Calorimetry 1.10786 1.95903 2.56527 1.96233 0.358811 10
reco:pandorapid:Chi2ParticleID 0.00464126 0.0053872 0.00594304 0.00530705 0.000384317 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0420773 0.0505377 0.0561059 0.0512868 0.00434598 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00397054 0.00511493 0.00572369 0.00517826 0.000515019 10
reco:pandoraShowercalo:ShowerCalorimetry 2.34661 4.84638 6.34564 4.80299 1.09174 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.32342 4.63459 6.24746 4.43719 1.08583 10
reco:emtrkmichelid:EmTrackMichelId 152.86 215.478 290.347 197.46 41.9184 10
reco:crttag:SingleCRTMatchingProducer 0.0101677 0.0121006 0.0155895 0.0114895 0.00179582 10
reco:crtreco:TwoCRTMatchingProducer 0.00677157 0.00859879 0.0115469 0.00842521 0.00118668 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.680451 0.882107 1.073 0.891153 0.109788 10
reco:pandora2Track:LArPandoraTrackCreation 7.57829 15.6936 22.495 15.543 3.628 10
reco:pandora2calo:Calorimetry 3.439 6.873 10.0245 6.74085 1.61114 10
reco:pandora2calonosce:Calorimetry 3.27387 6.46825 10.6515 6.06805 1.79578 10
reco:pandora2pid:Chi2ParticleID 0.010456 0.0143592 0.0174697 0.0145273 0.00178703 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0508417 0.0653259 0.0781762 0.0651634 0.0070045 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0100011 0.0142175 0.0171438 0.0141722 0.00182073 10
reco:pandora2Shower:LArPandoraShowerCreation 2.98045 5.64406 9.31215 5.42419 1.51147 10
reco:pandora2Showercalo:ShowerCalorimetry 3.09041 5.52801 8.25489 5.39075 1.2186 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.84084 4.925 7.29732 4.80968 1.04945 10
[art]:TriggerResults:TriggerResultInserter 3.6e-05 4.58042e-05 8.9941e-05 4.167e-05 1.5024e-05 10
end_path:out1:RootOutput 7.67e-06 9.614e-06 1.96e-05 8.515e-06 3.36671e-06 10
end_path:out1:RootOutput(write) 2.42682 3.04667 3.76441 3.04247 0.344778 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5151.88 MB
Peak resident set size usage (VmHWM): 4339.04 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.73 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11037392
-rw-r--r-- 1 dunegli fnalgrid 2565900684 Jan 5 10:42 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2432624072 Jan 5 10:40 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2304935152 Jan 5 11:47 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1994977128 Jan 5 08:45 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1915716477 Jan 5 08:32 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 87517560 Jan 5 11:42 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242855 Jan 5 11:47 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 5 11:47 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 5 11:47 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 5 11:47 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 5 10:42 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 5 08:45 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 5 11:47 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 5 08:26 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 5 11:47 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 5 10:46 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 5 10:42 debugprod.log
