Jobsub ID 288575.1@dunegpschedd02.fnal.gov
| Jobsub ID | 288575.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12117 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-20 14:50:47 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-20 17:11:47 |
| From worker node | Hostname | dunegli-8385694-0-fnpc22005.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-20 14:54:05 |
| Input files | monte-carlo-012117-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8248s) |
| CPU time | 2h (8145s = 98%) |
| Max RSS bytes | 4486139904 (4278 MiB) |
| Outputting started | 2026-01-20 17:11:34 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12117/1/001/reco_stage1.root
|
| Finished | 2026-01-20 17:11:47 |
| Saved logs | justin-logs:288575.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 116094 traces, 0 summary
Retagger: tagging trace set: gauss with 92614 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 92614 traces tagged "gauss"
FrameSaver: q=3.45477e+06 n=1674998 tag=gauss
wclsFrameSaver: saving 116094 traces tagged "wiener"
FrameSaver: q=3.67438e+06 n=1506690 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 28933 XUs and 26822 XVs -> 453 XUVs
C:0 T:1 49129 XUs and 46171 XVs -> 2607 XUVs
C:0 T:2 175862 XUs and 179307 XVs -> 10154 XUVs
C:0 T:3 61389 XUs and 49014 XVs -> 1172 XUVs
C:0 T:4 15134 XUs and 13126 XVs -> 88 XUVs
C:0 T:5 60663 XUs and 45774 XVs -> 4832 XUVs
C:0 T:6 53799 XUs and 51896 XVs -> 2083 XUVs
C:0 T:7 25354 XUs and 23125 XVs -> 168 XUVs
C:0 T:8 10813 XUs and 8802 XVs -> 142 XUVs
C:0 T:9 75386 XUs and 84108 XVs -> 6146 XUVs
C:0 T:10 12435 XUs and 8227 XVs -> 1656 XUVs
C:0 T:11 405 XUs and 300 XVs -> 41 XUVs
29542 XUVs total
10934 collection wire objects
25500 potential space points
Neighbour search...
1985600 tests to find 681482 neighbours
Iterating with no regularization...
Begin: 1.42591e+08
0 1.09143e+08
1 1.06485e+08
2 1.06232e+08
3 1.06178e+08
Now with regularization...
Begin: 9.15877e+07
0 9.13776e+07
1 9.13451e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411853240
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411853240
fLifetime: 30000 [us]
20-Jan-2026 17:11:32 UTC Closed output file "reco_stage1.root"
20-Jan-2026 17:11:32 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 205.44 260.996 341.719 261.622 40.8014 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000895669 0.00384888 0.00701436 0.00370586 0.00182165 10
reco:ophit:OpHitFinder 0.199275 0.220016 0.253314 0.216156 0.0165377 10
reco:opflash:OpFlashFinder 0.129938 0.14855 0.175959 0.145986 0.0156261 10
reco:opslicer:OpSlicer 0.341171 0.463536 0.574122 0.455279 0.0763867 10
reco:caldata:DataPrepModule 3.58695 3.73515 3.92689 3.73308 0.0783568 10
reco:wclsdatasp:WireCellToolkit 26.3334 27.6008 29.1637 27.5791 0.707734 10
reco:gaushit:GausHitFinder 0.72029 0.921569 1.30944 0.865645 0.170768 10
reco:nhitsfilter:NumberOfHitsFilter 0.000741447 0.00117044 0.00149164 0.00126955 0.000241513 10
reco:reco3d:SpacePointSolver 6.55367 12.8506 22.8885 11.1135 5.04813 10
reco:hitpdune:DisambigFromSpacePoints 0.968726 1.25362 1.87347 1.23726 0.278815 10
reco:pandora:StandardPandora 15.549 27.2253 46.3996 25.6723 9.81126 10
reco:pandoraWriter:StandardPandora 0.317938 0.430518 0.521428 0.460321 0.0678468 10
reco:pandoraTrack:LArPandoraTrackCreation 2.60844 4.24654 6.61408 4.08276 1.11588 10
reco:pandoraShower:LArPandoraShowerCreation 2.22887 4.25102 6.73062 4.26383 1.41868 10
reco:pandoracalo:Calorimetry 1.36324 2.16489 2.82593 2.14632 0.418165 10
reco:pandoracalonosce:Calorimetry 1.11618 1.95164 3.06161 1.8763 0.513192 10
reco:pandorapid:Chi2ParticleID 0.00369743 0.00453584 0.00631149 0.00436101 0.000703644 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0321425 0.0381376 0.0443853 0.0378678 0.00332245 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00396179 0.00443594 0.00533129 0.00423692 0.000446511 10
reco:pandoraShowercalo:ShowerCalorimetry 2.35172 4.45318 6.75589 4.37066 1.57757 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.37551 4.26893 6.52582 4.20223 1.48758 10
reco:emtrkmichelid:EmTrackMichelId 105.349 122.213 153.737 120.06 14.1345 10
reco:crttag:SingleCRTMatchingProducer 0.0101507 0.015102 0.0267667 0.0145523 0.00466839 10
reco:crtreco:TwoCRTMatchingProducer 0.00458405 0.00850269 0.0208319 0.00605532 0.00491871 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.474299 0.624172 0.733504 0.657191 0.0818919 10
reco:pandora2Track:LArPandoraTrackCreation 9.21662 15.2722 22.2151 15.126 4.20649 10
reco:pandora2calo:Calorimetry 4.12921 6.35511 10.5792 5.90584 1.95962 10
reco:pandora2calonosce:Calorimetry 3.69218 5.71806 9.02352 5.48711 1.61922 10
reco:pandora2pid:Chi2ParticleID 0.00833791 0.010473 0.0122354 0.0104584 0.00137058 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.044365 0.050482 0.0626307 0.0498349 0.00506539 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00790292 0.0101041 0.0128359 0.00991213 0.00153457 10
reco:pandora2Shower:LArPandoraShowerCreation 2.49326 3.64879 5.29974 3.79206 0.791727 10
reco:pandora2Showercalo:ShowerCalorimetry 3.20853 4.55932 7.24996 4.37776 1.08063 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.75367 3.85232 5.36797 3.88244 0.721997 10
[art]:TriggerResults:TriggerResultInserter 9.0332e-05 0.000107955 0.000170925 0.000100751 2.23302e-05 10
end_path:out1:RootOutput 1.2934e-05 1.52759e-05 1.9567e-05 1.5053e-05 1.87776e-06 10
end_path:out1:RootOutput(write) 1.89663 2.2301 2.82325 2.18937 0.284909 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5306.2 MB
Peak resident set size usage (VmHWM): 4486.14 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.25 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10809892
-rw-r--r-- 1 dunegli fnalgrid 2525232574 Jan 20 16:26 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2400331121 Jan 20 16:24 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2228276976 Jan 20 17:11 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1962152822 Jan 20 15:05 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1873385352 Jan 20 14:57 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 79269430 Jan 20 17:08 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242625 Jan 20 17:11 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 20 17:11 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 20 17:11 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 20 17:11 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 20 16:26 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 20 15:05 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 20 17:11 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 20 14:54 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 20 17:11 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 20 16:31 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 20 16:26 debugprod.log
