Jobsub ID 228842.95@dunegpschedd02.fnal.gov
| Jobsub ID | 228842.95@dunegpschedd02.fnal.gov | |
| Workflow ID | 9021 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 2097152000 (2000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-10-15 16:17:36 | |
| Site | UK_Bristol | |
| Entry | CMSHTPC_T2_UK_SGrid_Bristol_lcgce02 | |
| Last heartbeat | 2025-10-15 16:37:15 | |
| From worker node | Hostname | hd80.dice.priv |
| cpuinfo | AMD EPYC 7551P 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 2097152000 (2000 MiB) | |
| Wall seconds limit | 259200 (72 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Started | 2025-10-15 16:18:31 | |
| Input files | hd-protodune:np04hd_raw_run028891_0795_dataflow3_datawriter_0_20240824T113249.hdf5 hd-protodune:np04hd_raw_run028891_0809_dataflow7_datawriter_0_20240824T115743.hdf5 hd-protodune:np04hd_raw_run028891_0781_dataflow0_datawriter_0_20240824T111302.hdf5 hd-protodune:np04hd_raw_run028891_0781_dataflow7_datawriter_0_20240824T111302.hdf5 hd-protodune:np04hd_raw_run028891_0783_dataflow2_datawriter_0_20240824T111551.hdf5 hd-protodune:np04hd_raw_run028891_0811_dataflow6_datawriter_0_20240824T120045.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 18m (1101s) | |
| CPU time | 0m (49s = 4%) | |
| Max RSS bytes | 766832640 (731 MiB) | |
| Outputting started | 2025-10-15 16:36:53 | |
| Output files | ||
| Finished | 2025-10-15 16:37:15 | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
ERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF WARNING: NONZERO HALF %MSG-w BeamEvent: BeamEvent:beamevent@BeginModule 15-Oct-2025 16:36:42 UTC run: 28891 subRun: 1 event: 201334 BeamEvent_module.cc:1828 Could not get XCET1 info %MSG %MSG-w BeamEvent: BeamEvent:beamevent@BeginModule 15-Oct-2025 16:36:42 UTC run: 28891 subRun: 1 event: 201334 BeamEvent_module.cc:1846 Could not get XCET2 info %MSG Timing trigger: 12 Matched: 1 CKovs: 1 0 TOF, P: 94.5283 5.06399 %MSG-w HDF5FileLayout.cpp: PostProcessEvent 15-Oct-2025 16:36:42 UTC run: 28891 subRun: 1 event: 201334 HDF5FileLayout.cpp:70 File Layout Not Enough Digits For Path 201342 5 %MSG Timing trigger: 12 Matched: 1 CKovs: 0 0 TOF, P: 94.8827 4.75833 %MSG-w HDF5FileLayout.cpp: PostProcessEvent 15-Oct-2025 16:36:44 UTC run: 28891 subRun: 1 event: 201342 HDF5FileLayout.cpp:70 File Layout Not Enough Digits For Path 201350 5 %MSG Timing trigger: 12 Matched: 1 CKovs: 0 0 TOF, P: 98.2549 5.16001 %MSG-w HDF5FileLayout.cpp: PostProcessEvent 15-Oct-2025 16:36:46 UTC run: 28891 subRun: 1 event: 201350 HDF5FileLayout.cpp:70 File Layout Not Enough Digits For Path 201358 5 %MSG Timing trigger: 12 Matched: 1 CKovs: 1 0 TOF, P: 95.7305 5.49021 %MSG-w HDF5FileLayout.cpp: PostProcessEvent 15-Oct-2025 16:36:48 UTC run: 28891 subRun: 1 event: 201358 HDF5FileLayout.cpp:70 File Layout Not Enough Digits For Path 201366 5 %MSG Timing trigger: 12 Matched: 1 CKovs: 1 0 TOF, P: -1 5.22278 %MSG-w HDF5FileLayout.cpp: PostProcessEvent 15-Oct-2025 16:36:49 UTC run: 28891 subRun: 1 event: 201366 HDF5FileLayout.cpp:70 File Layout Not Enough Digits For Path 201374 5 %MSG Timing trigger: 8 Matched: 0 CKovs: 0 0 TOF, P: 0 -1 15-Oct-2025 16:36:52 UTC Closed output file "pdhd_228842_95_1_20251015T161843Z_beam.root" 15-Oct-2025 16:36:52 UTC Closed output file "pdhd_228842_95_1_20251015T161843Z_beam.root" =================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts =================================================================================================================================== Full event 0.778127 5.36521 390.017 1.06388 34.1624 186 ----------------------------------------------------------------------------------------------------------------------------------- source:HDF5RawInput3(read) 1.5779e-05 2.35796e-05 0.000173335 2.14505e-05 1.27022e-05 186 produce:triggerrawdecoder:PDHDTriggerReader3 0.554341 0.856734 1.77567 0.705674 0.304917 186 produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0964181 0.111339 0.245748 0.103795 0.0195232 186 produce:timingrawdecoder:PDHDTimingRawDecoder 0.0193519 0.020223 0.0857593 0.0195951 0.00540711 186 produce:beamevent:BeamEvent 0.000652796 4.25384 389.046 0.0122298 34.1791 186 [art]:TriggerResults:TriggerResultInserter 1.4637e-05 2.46657e-05 8.9147e-05 2.2913e-05 9.00861e-06 186 end_path:out1:RootOutput 3.216e-06 4.06704e-06 2.108e-05 3.897e-06 1.35618e-06 186 end_path:out1:RootOutput(write) 0.0657669 0.122682 0.170148 0.122643 0.0224839 186 =================================================================================================================================== =================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts =================================================================================================================================== Full event 0.778127 5.36521 390.017 1.06388 34.1624 186 ----------------------------------------------------------------------------------------------------------------------------------- source:HDF5RawInput3(read) 1.5779e-05 2.35796e-05 0.000173335 2.14505e-05 1.27022e-05 186 produce:triggerrawdecoder:PDHDTriggerReader3 0.554341 0.856734 1.77567 0.705674 0.304917 186 produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0964181 0.111339 0.245748 0.103795 0.0195232 186 produce:timingrawdecoder:PDHDTimingRawDecoder 0.0193519 0.020223 0.0857593 0.0195951 0.00540711 186 produce:beamevent:BeamEvent 0.000652796 4.25384 389.046 0.0122298 34.1791 186 [art]:TriggerResults:TriggerResultInserter 1.4637e-05 2.46657e-05 8.9147e-05 2.2913e-05 9.00861e-06 186 end_path:out1:RootOutput 3.216e-06 4.06704e-06 2.108e-05 3.897e-06 1.35618e-06 186 end_path:out1:RootOutput(write) 0.0657669 0.122682 0.170148 0.122643 0.0224839 186 =================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 1613.3 MB Peak resident set size usage (VmHWM): 766.833 MB ==================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 1613.3 MB Peak resident set size usage (VmHWM): 766.833 MB ==================================================================================================== TrigReport ---------- Event summary ------------- TrigReport Events total = 186 passed = 186 failed = 0 TrigReport ---------- Modules in End-path ---------- TrigReport Run Success Error Name TrigReport 186 186 0 out1 TimeReport ---------- Time summary [sec] ------- TimeReport CPU = 42.470424 Real = 1086.904595 MemReport ---------- Memory summary [base-10 MB] ------ MemReport VmPeak = 1613.3 VmHWM = 766.833 Art has completed and will exit with status 0. gen lar returns 0 ==== Start *.json ==== cat: *.json: No such file or directory ==== End *.json ==== .: total 66564 -rw-r--r-- 1 dnpil001 users 6585435 Oct 15 16:36 jobscript.log -rw-r--r-- 1 dnpil001 users 978 Oct 15 16:36 justin-processed-pfns.txt -rw-r--r-- 1 dnpil001 users 18883677 Oct 15 16:36 pdhd_228842_95_1_20251015T161843Z_beam_hist.root -rw-r--r-- 1 dnpil001 users 6448939 Oct 15 16:36 debug.log -rw-r--r-- 1 dnpil001 users 35397536 Oct 15 16:36 pdhd_228842_95_1_20251015T161843Z_beam.root -rw-r--r-- 1 dnpil001 users 498 Oct 15 16:18 all-input-dids.txt