Jobsub ID 296536.0@dunegpschedd02.fnal.gov
| Jobsub ID | 296536.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12531 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-29 16:40:09 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-29 20:13:36 |
| From worker node | Hostname | hnode50.pic.es |
| cpuinfo | AMD EPYC 7402P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-29 16:40:57 |
| Input files | monte-carlo-012531-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12690s) |
| CPU time | 3h (11131s = 87%) |
| Max RSS bytes | 3931967488 (3749 MiB) |
| Outputting started | 2026-01-29 20:12:29 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12531/1/001/reco_stage1.root
|
| Finished | 2026-01-29 20:13:36 |
| Saved logs | justin-logs:296536.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ailPedRemovalZKe
ToolBasedRawDigitPrepService:prepare: Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 94676 traces, 0 summary
Retagger: tagging trace set: gauss with 73966 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 73966 traces tagged "gauss"
FrameSaver: q=2.53501e+06 n=1298018 tag=gauss
wclsFrameSaver: saving 94676 traces tagged "wiener"
FrameSaver: q=2.67115e+06 n=1151444 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 28749 XUs and 30532 XVs -> 216 XUVs
C:0 T:1 42949 XUs and 43360 XVs -> 4362 XUVs
C:0 T:2 45586 XUs and 85275 XVs -> 2812 XUVs
C:0 T:4 11320 XUs and 11508 XVs -> 172 XUVs
C:0 T:5 49965 XUs and 32923 XVs -> 6660 XUVs
C:0 T:6 35433 XUs and 26681 XVs -> 1101 XUVs
C:0 T:7 17374 XUs and 11383 XVs -> 84 XUVs
C:0 T:8 5797 XUs and 7353 XVs -> 70 XUVs
C:0 T:9 28645 XUs and 42911 XVs -> 2244 XUVs
C:0 T:10 17180 XUs and 13735 XVs -> 2466 XUVs
C:0 T:11 1328 XUs and 501 XVs -> 109 XUVs
20296 XUVs total
7623 collection wire objects
19120 potential space points
Neighbour search...
1396586 tests to find 670404 neighbours
Iterating with no regularization...
Begin: 4.50422e+07
0 3.86653e+07
1 3.81413e+07
2 3.80655e+07
3 3.80424e+07
Now with regularization...
Begin: 3.03984e+07
0 3.03706e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412041400
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412041400
fLifetime: 30000 [us]
29-Jan-2026 21:12:25 CET Closed output file "reco_stage1.root"
29-Jan-2026 21:12:25 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 275.519 349.936 499.313 339.215 62.5471 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00103449 0.00297806 0.00463714 0.00327186 0.00115928 10
reco:ophit:OpHitFinder 0.206477 0.297043 0.362048 0.311229 0.0438497 10
reco:opflash:OpFlashFinder 0.100586 0.157235 0.200996 0.159552 0.0305656 10
reco:opslicer:OpSlicer 0.519451 0.799618 1.14987 0.834758 0.186489 10
reco:caldata:DataPrepModule 4.23146 5.941 7.20521 6.29466 0.991349 10
reco:wclsdatasp:WireCellToolkit 29.0733 37.9262 44.8004 37.7935 4.42904 10
reco:gaushit:GausHitFinder 0.77746 1.17799 1.70231 1.19608 0.241959 10
reco:nhitsfilter:NumberOfHitsFilter 0.00032334 0.0005588 0.000824915 0.000559487 0.000129574 10
reco:reco3d:SpacePointSolver 5.40983 12.0709 25.0097 9.91954 5.98902 10
reco:hitpdune:DisambigFromSpacePoints 0.662911 1.33205 2.17145 1.34859 0.419547 10
reco:pandora:StandardPandora 13.0072 24.8521 44.0857 22.7618 7.98288 10
reco:pandoraWriter:StandardPandora 0.24776 0.374724 0.474811 0.396464 0.072841 10
reco:pandoraTrack:LArPandoraTrackCreation 2.0599 3.11905 5.23415 2.90306 0.886589 10
reco:pandoraShower:LArPandoraShowerCreation 1.36357 3.3028 6.20053 2.74632 1.34421 10
reco:pandoracalo:Calorimetry 1.0365 1.66381 2.4436 1.72803 0.393069 10
reco:pandoracalonosce:Calorimetry 0.950689 1.48814 2.37161 1.49599 0.40098 10
reco:pandorapid:Chi2ParticleID 0.0041149 0.0058689 0.00821381 0.00554905 0.0013777 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0307596 0.0492662 0.0734362 0.0494925 0.0123229 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00409683 0.00552708 0.0073463 0.00536557 0.00103956 10
reco:pandoraShowercalo:ShowerCalorimetry 1.35513 3.04001 6.17827 2.46701 1.37313 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.27449 3.05376 6.26383 2.46228 1.49264 10
reco:emtrkmichelid:EmTrackMichelId 165.17 212.502 288.297 203.797 34.7984 10
reco:crttag:SingleCRTMatchingProducer 0.00523725 0.012085 0.0212331 0.0127762 0.0047673 10
reco:crtreco:TwoCRTMatchingProducer 0.00435373 0.00973147 0.0134698 0.011025 0.0031345 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.550821 0.803397 0.978981 0.80237 0.150063 10
reco:pandora2Track:LArPandoraTrackCreation 5.81345 11.2104 17.6712 10.8985 4.09554 10
reco:pandora2calo:Calorimetry 2.51263 4.7444 7.6243 4.60974 1.70766 10
reco:pandora2calonosce:Calorimetry 2.41225 4.64354 7.54153 4.50581 1.78147 10
reco:pandora2pid:Chi2ParticleID 0.00995627 0.0142247 0.0209495 0.0143962 0.00313786 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0430552 0.0638371 0.0876849 0.0658965 0.0164007 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00990595 0.0143338 0.0198853 0.0145607 0.00309766 10
reco:pandora2Shower:LArPandoraShowerCreation 2.33522 4.28541 8.24367 3.91937 1.64891 10
reco:pandora2Showercalo:ShowerCalorimetry 2.24142 4.36498 8.61607 4.20902 1.74494 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.0424 3.82802 7.1384 3.77489 1.44705 10
[art]:TriggerResults:TriggerResultInserter 2.2991e-05 4.08933e-05 9.9933e-05 3.3136e-05 2.37857e-05 10
end_path:out1:RootOutput 4.68e-06 4.72243e-05 0.000417253 5.855e-06 0.000123354 10
end_path:out1:RootOutput(write) 1.91187 2.66166 3.74289 2.62029 0.533147 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4918.53 MB
Peak resident set size usage (VmHWM): 3931.97 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.25 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.71 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9491048
-rw-r--r-- 1 dune001 dune 2252100274 Jan 29 20:11 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2142718807 Jan 29 20:08 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 1887641790 Jan 29 21:12 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1721114946 Jan 29 18:08 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1652213379 Jan 29 17:49 g4_stage1.root
-rw-r--r-- 1 dune001 dune 62407310 Jan 29 21:08 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242792 Jan 29 21:12 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 29 21:12 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 29 21:12 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 29 21:12 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 29 20:11 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 29 18:08 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 29 21:12 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 29 17:40 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 29 21:12 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 29 20:17 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 29 20:11 debugprod.log
