Jobsub ID 246358.0@dunegpschedd02.fnal.gov
| Jobsub ID | 246358.0@dunegpschedd02.fnal.gov |
| Workflow ID | 10221 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-15 16:43:52 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-15 18:33:55 |
| From worker node | Hostname | dunegli-7611256-0-fnpc23022.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-15 16:45:59 |
| Input files | monte-carlo-010221-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6331s) |
| CPU time | 1h (6261s = 98%) |
| Max RSS bytes | 3971100672 (3787 MiB) |
| Outputting started | 2025-11-15 18:31:30 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10221/1/001/reco_stage1.root
|
| Finished | 2025-11-15 18:33:55 |
| Saved logs | justin-logs:246358.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
e: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 75408 traces, 0 summary
Retagger: tagging trace set: gauss with 59404 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 59404 traces tagged "gauss"
FrameSaver: q=1.89786e+06 n=1041315 tag=gauss
wclsFrameSaver: saving 75408 traces tagged "wiener"
FrameSaver: q=1.99814e+06 n=920234 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 14494 XUs and 19948 XVs -> 235 XUVs
C:0 T:1 25719 XUs and 26307 XVs -> 1769 XUVs
C:0 T:2 30694 XUs and 34316 XVs -> 1606 XUVs
C:0 T:3 17386 XUs and 14502 XVs -> 154 XUVs
C:0 T:4 10978 XUs and 9364 XVs -> 63 XUVs
C:0 T:5 38829 XUs and 25241 XVs -> 3029 XUVs
C:0 T:6 61148 XUs and 73465 XVs -> 2821 XUVs
C:0 T:7 25978 XUs and 31106 XVs -> 205 XUVs
C:0 T:8 4595 XUs and 5169 XVs -> 145 XUVs
C:0 T:9 23705 XUs and 33014 XVs -> 1878 XUVs
C:0 T:10 9329 XUs and 3621 XVs -> 910 XUVs
C:0 T:11 148 XUs and 83 XVs -> 17 XUVs
12832 XUVs total
6857 collection wire objects
11910 potential space points
Neighbour search...
309796 tests to find 170956 neighbours
Iterating with no regularization...
Begin: 2.95956e+07
0 2.53409e+07
1 2.50707e+07
2 2.50409e+07
3 2.50342e+07
Now with regularization...
Begin: 2.01507e+07
0 2.01516e+07
Warning: metric increased
run: 1 ; subrun: 0 ; event: 10
evttime: 410532731
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410532731
fLifetime: 30000 [us]
15-Nov-2025 18:31:29 UTC Closed output file "reco_stage1.root"
15-Nov-2025 18:31:29 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 112.564 170.648 227.638 158.773 41.4465 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000692711 0.00269752 0.00446405 0.00260288 0.00110326 10
reco:ophit:OpHitFinder 0.148231 0.184998 0.213143 0.184053 0.0192777 10
reco:opflash:OpFlashFinder 0.0694918 0.112435 0.148108 0.113071 0.0226548 10
reco:opslicer:OpSlicer 0.297521 0.406182 0.505235 0.386127 0.0630372 10
reco:caldata:DataPrepModule 3.28163 3.47779 3.76228 3.46929 0.119853 10
reco:wclsdatasp:WireCellToolkit 22.3577 23.1175 24.0883 23.1099 0.52138 10
reco:gaushit:GausHitFinder 0.449353 0.623875 0.813234 0.59772 0.11782 10
reco:nhitsfilter:NumberOfHitsFilter 0.000180764 0.000270295 0.00046145 0.000243354 7.89304e-05 10
reco:reco3d:SpacePointSolver 2.12075 7.33852 13.468 7.92537 3.78738 10
reco:hitpdune:DisambigFromSpacePoints 0.357845 0.761921 1.13476 0.665702 0.266844 10
reco:pandora:StandardPandora 5.87034 13.0954 25.0298 10.8439 5.99156 10
reco:pandoraWriter:StandardPandora 0.143012 0.214503 0.324127 0.191542 0.0593092 10
reco:pandoraTrack:LArPandoraTrackCreation 0.816371 1.57072 2.35636 1.4799 0.504342 10
reco:pandoraShower:LArPandoraShowerCreation 0.677568 1.66037 2.77776 1.4289 0.753127 10
reco:pandoracalo:Calorimetry 0.500705 0.961065 1.49346 0.858219 0.330251 10
reco:pandoracalonosce:Calorimetry 0.448198 0.878124 1.38001 0.779342 0.310844 10
reco:pandorapid:Chi2ParticleID 0.00226275 0.003015 0.00431632 0.00288099 0.000565883 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0190292 0.0287781 0.0372237 0.0274977 0.00611678 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00214354 0.00282108 0.00352031 0.00275221 0.000406172 10
reco:pandoraShowercalo:ShowerCalorimetry 0.713314 1.83614 3.24914 1.39283 0.949952 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.693591 1.78506 3.13871 1.35895 0.921731 10
reco:emtrkmichelid:EmTrackMichelId 64.2754 93.8626 120.374 90.549 19.8515 10
reco:crttag:SingleCRTMatchingProducer 0.00375719 0.00683308 0.0123896 0.00630082 0.00236668 10
reco:crtreco:TwoCRTMatchingProducer 0.00286352 0.00428003 0.0058149 0.00399689 0.00101289 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.265333 0.52622 0.783327 0.510145 0.155967 10
reco:pandora2Track:LArPandoraTrackCreation 2.13304 4.87786 8.0278 4.14874 2.10031 10
reco:pandora2calo:Calorimetry 1.15845 2.66012 4.47289 2.11258 1.22696 10
reco:pandora2calonosce:Calorimetry 1.09736 2.53307 4.31268 2.00801 1.18234 10
reco:pandora2pid:Chi2ParticleID 0.00452486 0.00668216 0.00864141 0.00651809 0.00138994 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0215474 0.034576 0.0459246 0.0331565 0.00816582 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00454024 0.00649257 0.00829873 0.00634846 0.00134657 10
reco:pandora2Shower:LArPandoraShowerCreation 0.861076 1.87089 3.03778 1.64882 0.773583 10
reco:pandora2Showercalo:ShowerCalorimetry 1.02533 2.35176 4.04063 1.84694 1.10855 10
reco:pandora2Showercalonosce:ShowerCalorimetry 0.953563 2.18512 3.78961 1.71219 1.03137 10
[art]:TriggerResults:TriggerResultInserter 2.8163e-05 4.12593e-05 9.9489e-05 3.34935e-05 2.0331e-05 10
end_path:out1:RootOutput 7.314e-06 1.0011e-05 1.4928e-05 1.0019e-05 1.85457e-06 10
end_path:out1:RootOutput(write) 1.08407 1.61341 2.10209 1.53009 0.347616 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4783.7 MB
Peak resident set size usage (VmHWM): 3971.1 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9124332
-rw-r--r-- 1 dunegli fnalgrid 2175994749 Nov 15 18:02 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2069811663 Nov 15 18:00 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1815847727 Nov 15 18:31 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1643454480 Nov 15 16:55 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1574524641 Nov 15 16:48 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 63058840 Nov 15 18:30 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242761 Nov 15 18:31 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 15 18:31 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 15 18:31 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 15 18:31 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 18:02 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 16:55 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 18:31 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 15 16:45 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 15 18:31 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 15 18:05 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 15 18:02 debugprod.log
