Jobsub ID 242951.1@dunegpschedd02.fnal.gov
| Jobsub ID | 242951.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10092 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-13 09:39:17 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-13 11:25:22 |
| From worker node | Hostname | dunegli-7728715-0-fnpc23018.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-13 09:40:17 |
| Input files | monte-carlo-010092-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6290s) |
| CPU time | 1h (6204s = 98%) |
| Max RSS bytes | 4000276480 (3814 MiB) |
| Outputting started | 2025-11-13 11:25:08 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10092/1/001/reco_stage1.root
|
| Finished | 2025-11-13 11:25:22 |
| Saved logs | justin-logs:242951.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
vice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 104123 traces, 0 summary
Retagger: tagging trace set: gauss with 82178 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 82178 traces tagged "gauss"
FrameSaver: q=2.95117e+06 n=1537878 tag=gauss
wclsFrameSaver: saving 104123 traces tagged "wiener"
FrameSaver: q=3.10618e+06 n=1383289 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 18485 XUs and 20671 XVs -> 237 XUVs
C:0 T:1 30496 XUs and 28792 XVs -> 1672 XUVs
C:0 T:2 59010 XUs and 75024 XVs -> 2415 XUVs
C:0 T:3 33881 XUs and 34577 XVs -> 450 XUVs
C:0 T:4 18367 XUs and 14871 XVs -> 121 XUVs
C:0 T:5 155276 XUs and 75178 XVs -> 32485 XUVs
C:0 T:6 119263 XUs and 94729 XVs -> 8376 XUVs
C:0 T:7 42265 XUs and 34430 XVs -> 548 XUVs
C:0 T:8 6180 XUs and 7267 XVs -> 73 XUVs
C:0 T:9 45868 XUs and 53014 XVs -> 5232 XUVs
C:0 T:10 37809 XUs and 27740 XVs -> 4730 XUVs
C:0 T:11 238 XUs and 129 XVs -> 36 XUVs
56375 XUVs total
9222 collection wire objects
53846 potential space points
Neighbour search...
16984464 tests to find 6554594 neighbours
Iterating with no regularization...
Begin: 6.02971e+07
0 5.0442e+07
1 4.97502e+07
2 4.96547e+07
3 4.96292e+07
Now with regularization...
Begin: 4.08672e+07
0 4.08418e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410486551
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410486551
fLifetime: 30000 [us]
13-Nov-2025 11:25:07 UTC Closed output file "reco_stage1.root"
13-Nov-2025 11:25:07 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 158.277 176.784 205.13 171.861 15.3911 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00065923 0.00263573 0.0055185 0.0027451 0.00126322 10
reco:ophit:OpHitFinder 0.190638 0.20647 0.237005 0.205017 0.0142782 10
reco:opflash:OpFlashFinder 0.0756694 0.11121 0.134377 0.111209 0.0170604 10
reco:opslicer:OpSlicer 0.329358 0.391153 0.434212 0.393956 0.0358267 10
reco:caldata:DataPrepModule 3.53883 3.67907 4.02585 3.63015 0.159008 10
reco:wclsdatasp:WireCellToolkit 22.1933 23.19 23.7967 23.2244 0.489005 10
reco:gaushit:GausHitFinder 0.559045 0.641017 0.771048 0.637441 0.0564831 10
reco:nhitsfilter:NumberOfHitsFilter 0.000253073 0.000288755 0.000388963 0.000267577 4.16249e-05 10
reco:reco3d:SpacePointSolver 5.28874 7.72372 11.1652 7.83829 1.81254 10
reco:hitpdune:DisambigFromSpacePoints 0.66711 0.805248 1.0009 0.792385 0.095969 10
reco:pandora:StandardPandora 11.3701 14.1696 16.8062 14.4489 1.90749 10
reco:pandoraWriter:StandardPandora 0.189638 0.222422 0.264008 0.217315 0.0244977 10
reco:pandoraTrack:LArPandoraTrackCreation 1.18415 1.62005 2.2904 1.59253 0.345589 10
reco:pandoraShower:LArPandoraShowerCreation 1.14443 1.7319 2.28111 1.7028 0.363791 10
reco:pandoracalo:Calorimetry 0.733157 0.986111 1.34635 0.961926 0.215163 10
reco:pandoracalonosce:Calorimetry 0.649462 0.904503 1.25254 0.881774 0.210452 10
reco:pandorapid:Chi2ParticleID 0.00242175 0.00308099 0.00383483 0.00303345 0.000441652 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0253014 0.0281762 0.0325947 0.0283864 0.00190655 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0022968 0.00281446 0.00342939 0.00277428 0.000295963 10
reco:pandoraShowercalo:ShowerCalorimetry 1.17174 1.86771 2.69363 1.83187 0.48147 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.12296 1.80831 2.6232 1.78341 0.469097 10
reco:emtrkmichelid:EmTrackMichelId 87.2671 97.6006 113.23 95.011 7.93688 10
reco:crttag:SingleCRTMatchingProducer 0.00575929 0.00855813 0.0133687 0.00761635 0.0026029 10
reco:crtreco:TwoCRTMatchingProducer 0.0036188 0.00449257 0.00579958 0.00444992 0.000583942 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.459677 0.565698 0.736112 0.560585 0.0759039 10
reco:pandora2Track:LArPandoraTrackCreation 3.46217 4.98495 6.57857 4.84301 1.04227 10
reco:pandora2calo:Calorimetry 1.77451 2.69757 3.79859 2.62701 0.650422 10
reco:pandora2calonosce:Calorimetry 1.65508 2.5519 3.59582 2.48295 0.627145 10
reco:pandora2pid:Chi2ParticleID 0.00553915 0.0067649 0.00790554 0.00662318 0.000876593 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0287901 0.0340199 0.0405687 0.0336726 0.00312832 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00539474 0.00657818 0.00775558 0.00646417 0.000850146 10
reco:pandora2Shower:LArPandoraShowerCreation 1.33529 1.91169 2.47288 1.922 0.364066 10
reco:pandora2Showercalo:ShowerCalorimetry 1.53269 2.37722 3.36955 2.30765 0.579095 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.41406 2.19775 3.10455 2.12076 0.531823 10
[art]:TriggerResults:TriggerResultInserter 2.9376e-05 3.88491e-05 9.0573e-05 3.29925e-05 1.75435e-05 10
end_path:out1:RootOutput 4.188e-06 6.5825e-06 1.0309e-05 6.848e-06 1.7945e-06 10
end_path:out1:RootOutput(write) 1.4285 1.69247 1.93781 1.7017 0.133909 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4819.14 MB
Peak resident set size usage (VmHWM): 4000.28 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 8988540
-rw-r--r-- 1 dunegli fnalgrid 2154554717 Nov 13 10:54 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2046503760 Nov 13 10:53 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1801812926 Nov 13 11:25 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1604737615 Nov 13 09:49 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1530284005 Nov 13 09:43 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 65687620 Nov 13 11:22 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242812 Nov 13 11:25 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 13 11:25 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 13 11:25 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 13 11:25 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 10:54 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 09:49 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 11:25 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 13 09:40 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 13 11:25 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 13 10:57 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 13 10:54 debugprod.log
