Jobsub ID 234359.20@dunegpschedd01.fnal.gov
| Jobsub ID | 234359.20@dunegpschedd01.fnal.gov |
| Workflow ID | 9021 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-10-15 16:15:35 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce01 |
| Last heartbeat | 2025-10-15 16:18:25 |
| From worker node | Hostname | dune004-9562244.0-lcg2368.gridpp.rl.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-10-15 16:16:49 |
| Input files | hd-protodune:np04hd_raw_run028891_0876_dataflow6_datawriter_0_20240824T133256.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1m (77s) |
| CPU time | 0m (19s = 24%) |
| Max RSS bytes | 774471680 (738 MiB) |
| Outputting started | 2025-10-15 16:18:06 |
| Output files | |
| Finished | 2025-10-15 16:18:25 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
%MSG-w BeamEvent: BeamEvent:beamevent@BeginModule 15-Oct-2025 16:17:57 UTC run: 28891 subRun: 1 event: 217462 BeamEvent_module.cc:1828
Could not get XCET1 info
%MSG
%MSG-w BeamEvent: BeamEvent:beamevent@BeginModule 15-Oct-2025 16:17:57 UTC run: 28891 subRun: 1 event: 217462 BeamEvent_module.cc:1846
Could not get XCET2 info
%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 97.7686 5.04361
%MSG-w HDF5FileLayout.cpp: PostProcessEvent 15-Oct-2025 16:17:57 UTC run: 28891 subRun: 1 event: 217462 HDF5FileLayout.cpp:70
File Layout Not Enough Digits For Path 217470 5
%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 88.9238 -1
%MSG-w HDF5FileLayout.cpp: PostProcessEvent 15-Oct-2025 16:17:59 UTC run: 28891 subRun: 1 event: 217470 HDF5FileLayout.cpp:70
File Layout Not Enough Digits For Path 217478 5
%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 95.4229 5.14459
%MSG-w HDF5FileLayout.cpp: PostProcessEvent 15-Oct-2025 16:18:00 UTC run: 28891 subRun: 1 event: 217478 HDF5FileLayout.cpp:70
File Layout Not Enough Digits For Path 217486 5
%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 95.2441 5.0533
%MSG-w HDF5FileLayout.cpp: PostProcessEvent 15-Oct-2025 16:18:02 UTC run: 28891 subRun: 1 event: 217486 HDF5FileLayout.cpp:70
File Layout Not Enough Digits For Path 217494 5
%MSG
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
15-Oct-2025 16:18:06 UTC Closed output file "pdhd_234359_20_1_20251015T161654Z_beam.root"
15-Oct-2025 16:18:06 UTC Closed output file "pdhd_234359_20_1_20251015T161654Z_beam.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 1.03221 1.55977 5.52681 1.43435 0.764577 31
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 1.4947e-05 2.61026e-05 0.000172569 2.0636e-05 2.7033e-05 31
produce:triggerrawdecoder:PDHDTriggerReader3 0.599046 1.09182 1.51303 1.05779 0.230839 31
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0884881 0.103401 0.161545 0.0975453 0.0169861 31
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0178159 0.0179428 0.0184434 0.0179104 0.000122221 31
produce:beamevent:BeamEvent 0.00118817 0.200954 4.68649 0.00865469 0.824786 31
[art]:TriggerResults:TriggerResultInserter 1.9688e-05 2.8826e-05 0.000111233 2.6209e-05 1.54538e-05 31
end_path:out1:RootOutput 3.692e-06 5.01258e-06 3.058e-05 4.214e-06 4.67421e-06 31
end_path:out1:RootOutput(write) 0.106387 0.145224 0.198029 0.137902 0.0245354 31
===================================================================================================================================
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 1.03221 1.55977 5.52681 1.43435 0.764577 31
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 1.4947e-05 2.61026e-05 0.000172569 2.0636e-05 2.7033e-05 31
produce:triggerrawdecoder:PDHDTriggerReader3 0.599046 1.09182 1.51303 1.05779 0.230839 31
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0884881 0.103401 0.161545 0.0975453 0.0169861 31
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0178159 0.0179428 0.0184434 0.0179104 0.000122221 31
produce:beamevent:BeamEvent 0.00118817 0.200954 4.68649 0.00865469 0.824786 31
[art]:TriggerResults:TriggerResultInserter 1.9688e-05 2.8826e-05 0.000111233 2.6209e-05 1.54538e-05 31
end_path:out1:RootOutput 3.692e-06 5.01258e-06 3.058e-05 4.214e-06 4.67421e-06 31
end_path:out1:RootOutput(write) 0.106387 0.145224 0.198029 0.137902 0.0245354 31
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 1652.77 MB
Peak resident set size usage (VmHWM): 782.795 MB
====================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 1652.77 MB
Peak resident set size usage (VmHWM): 782.795 MB
====================================================================================================
TrigReport ---------- Event summary -------------
TrigReport Events total = 31 passed = 31 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 31 31 0 out1
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 12.274070 Real = 66.655810
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 1652.77 VmHWM = 782.795
Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 9772
-rw-r--r-- 1 dune004 dune 1081646 Oct 15 16:18 jobscript.log
-rw-r--r-- 1 dune004 dune 163 Oct 15 16:18 justin-processed-pfns.txt
-rw-r--r-- 1 dune004 dune 663395 Oct 15 16:18 pdhd_234359_20_1_20251015T161654Z_beam_hist.root
-rw-r--r-- 1 dune004 dune 1055689 Oct 15 16:18 debug.log
-rw-r--r-- 1 dune004 dune 6244812 Oct 15 16:18 pdhd_234359_20_1_20251015T161654Z_beam.root
-rw-r--r-- 1 dune004 dune 83 Oct 15 16:16 all-input-dids.txt
