Jobsub ID 301887.1@dunegpschedd01.fnal.gov
| Jobsub ID | 301887.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12463 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-28 08:06:25 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-28 11:24:53 |
| From worker node | Hostname | dunegli-8450302-0-fnpc18006.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-28 08:08:04 |
| Input files | monte-carlo-012463-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11787s) |
| CPU time | 3h (11658s = 98%) |
| Max RSS bytes | 4316729344 (4116 MiB) |
| Outputting started | 2026-01-28 11:24:31 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12463/1/001/reco_stage1.root
|
| Finished | 2026-01-28 11:24:53 |
| Saved logs | justin-logs:301887.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ervice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120153 traces, 0 summary
Retagger: tagging trace set: gauss with 90419 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90419 traces tagged "gauss"
FrameSaver: q=3.13262e+06 n=1561672 tag=gauss
wclsFrameSaver: saving 120153 traces tagged "wiener"
FrameSaver: q=3.32215e+06 n=1375061 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 32567 XUs and 32354 XVs -> 339 XUVs
C:0 T:1 65245 XUs and 63082 XVs -> 3377 XUVs
C:0 T:2 80707 XUs and 136948 XVs -> 6621 XUVs
C:0 T:3 40626 XUs and 53223 XVs -> 397 XUVs
C:0 T:4 7453 XUs and 8249 XVs -> 83 XUVs
C:0 T:5 18055 XUs and 14640 XVs -> 1878 XUVs
C:0 T:6 105215 XUs and 136113 XVs -> 6183 XUVs
C:0 T:7 41716 XUs and 52881 XVs -> 567 XUVs
C:0 T:8 5213 XUs and 4834 XVs -> 55 XUVs
C:0 T:9 21326 XUs and 27391 XVs -> 2211 XUVs
C:0 T:10 33975 XUs and 29657 XVs -> 4693 XUVs
C:0 T:11 376 XUs and 272 XVs -> 26 XUVs
26430 XUVs total
11192 collection wire objects
24154 potential space points
Neighbour search...
1254858 tests to find 656290 neighbours
Iterating with no regularization...
Begin: 1.04875e+08
0 9.00599e+07
1 8.90003e+07
2 8.88887e+07
3 8.88598e+07
Now with regularization...
Begin: 7.76416e+07
0 7.76259e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412014110
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412014110
fLifetime: 30000 [us]
28-Jan-2026 11:24:29 UTC Closed output file "reco_stage1.root"
28-Jan-2026 11:24:29 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 292.638 380.058 485.834 350.509 67.9198 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00132477 0.00322124 0.00440425 0.00322982 0.000966079 10
reco:ophit:OpHitFinder 0.268798 0.321258 0.404292 0.311027 0.0405496 10
reco:opflash:OpFlashFinder 0.114525 0.168945 0.199941 0.171732 0.0262578 10
reco:opslicer:OpSlicer 0.587068 0.842641 1.11259 0.80829 0.162036 10
reco:caldata:DataPrepModule 5.44933 6.77468 7.67637 7.45077 0.961375 10
reco:wclsdatasp:WireCellToolkit 32.7 41.3437 47.9803 44.5483 5.60793 10
reco:gaushit:GausHitFinder 1.1602 1.4301 2.06242 1.41491 0.248045 10
reco:nhitsfilter:NumberOfHitsFilter 0.000462984 0.000643826 0.000938191 0.000623133 0.000125059 10
reco:reco3d:SpacePointSolver 8.72865 16.4451 26.4431 16.1424 5.88105 10
reco:hitpdune:DisambigFromSpacePoints 1.30106 1.70417 2.80383 1.65987 0.427441 10
reco:pandora:StandardPandora 21.6314 41.1222 61.4245 35.5275 13.2659 10
reco:pandoraWriter:StandardPandora 0.425201 0.554349 0.730894 0.544705 0.0908375 10
reco:pandoraTrack:LArPandoraTrackCreation 4.36904 5.82636 8.70813 5.19185 1.41168 10
reco:pandoraShower:LArPandoraShowerCreation 4.19082 6.32417 9.23115 5.323 1.99177 10
reco:pandoracalo:Calorimetry 2.25998 3.05878 4.4656 2.80665 0.733642 10
reco:pandoracalonosce:Calorimetry 2.1711 2.81319 4.08052 2.62693 0.619166 10
reco:pandorapid:Chi2ParticleID 0.00761371 0.00920561 0.0108783 0.00913103 0.00101819 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0492974 0.066271 0.091767 0.0646705 0.0116913 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00626121 0.00833022 0.0105224 0.00832911 0.00115826 10
reco:pandoraShowercalo:ShowerCalorimetry 3.63605 6.18217 9.84878 5.10936 2.19231 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.47139 5.87471 9.56943 4.97453 2.11353 10
reco:emtrkmichelid:EmTrackMichelId 126.719 170.409 206.912 166.629 26.6478 10
reco:crttag:SingleCRTMatchingProducer 0.0122252 0.0214809 0.0333958 0.0195185 0.00617001 10
reco:crtreco:TwoCRTMatchingProducer 0.0104074 0.0152788 0.0195562 0.0146332 0.00299301 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.7233 1.11423 1.58429 1.07783 0.253223 10
reco:pandora2Track:LArPandoraTrackCreation 11.7789 20.9373 33.0813 17.9373 6.63586 10
reco:pandora2calo:Calorimetry 5.73675 9.92474 17.4019 8.46302 3.5621 10
reco:pandora2calonosce:Calorimetry 5.73118 9.20175 15.6999 7.7805 3.22903 10
reco:pandora2pid:Chi2ParticleID 0.0195645 0.0248392 0.0318222 0.0245154 0.0035223 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0617985 0.0939477 0.129837 0.0910463 0.0199598 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0176331 0.0239143 0.0332425 0.0222861 0.0044639 10
reco:pandora2Shower:LArPandoraShowerCreation 5.24313 7.82701 11.6377 6.64894 2.22695 10
reco:pandora2Showercalo:ShowerCalorimetry 5.2784 8.26207 13.5697 7.1378 2.78358 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.44601 7.22157 11.5945 6.34367 2.34936 10
[art]:TriggerResults:TriggerResultInserter 4.5398e-05 7.47243e-05 0.000183406 6.42895e-05 3.74579e-05 10
end_path:out1:RootOutput 1.1524e-05 1.47855e-05 2.193e-05 1.39685e-05 2.82785e-06 10
end_path:out1:RootOutput(write) 2.6799 3.97083 5.36108 3.87116 0.779728 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5124.05 MB
Peak resident set size usage (VmHWM): 4316.73 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.27 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.34 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10224032
-rw-r--r-- 1 dunegli fnalgrid 2398070288 Jan 28 10:18 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2284624960 Jan 28 10:15 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2074587153 Jan 28 11:24 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1853355456 Jan 28 08:25 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1785110213 Jan 28 08:13 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 73038260 Jan 28 11:20 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243027 Jan 28 11:24 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 28 11:24 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 28 11:24 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 28 11:24 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 28 10:18 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 28 08:25 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 28 11:24 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 28 08:08 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 28 11:24 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 28 10:25 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 28 10:18 debugprod.log
