Jobsub ID 228838.189@dunegpschedd02.fnal.gov

Jobsub ID	228838.189@dunegpschedd02.fnal.gov
Workflow ID	9021
Stage ID	1
User name	calcuttj@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-10-15 16:11:35
Site	UK_Sheffield
Entry	DUNE_UK_Sheffield_lcgce2
Last heartbeat	2025-10-15 17:07:30
From worker node	Hostname	wn037.hep
	cpuinfo	AMD EPYC 7513 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2025-10-15 16:13:07
Input files	hd-protodune:np04hd_raw_run028891_0037_dataflow7_datawriter_0_20240823T160910.hdf5 hd-protodune:np04hd_raw_run028891_0040_dataflow7_datawriter_0_20240823T161322.hdf5 hd-protodune:np04hd_raw_run028891_0860_dataflow3_datawriter_0_20240824T131021.hdf5 hd-protodune:np04hd_raw_run028891_0862_dataflow4_datawriter_0_20240824T131320.hdf5 hd-protodune:np04hd_raw_run028891_0873_dataflow2_datawriter_0_20240824T132838.hdf5 hd-protodune:np04hd_raw_run028891_0879_dataflow3_datawriter_0_20240824T133704.hdf5 hd-protodune:np04hd_raw_run028891_0889_dataflow6_datawriter_0_20240824T135134.hdf5 hd-protodune:np04hd_raw_run028891_0889_dataflow7_datawriter_0_20240824T135134.hdf5
Jobscript	Exit code	0
	Real time	53m (3239s)
	CPU time	1m (68s = 2%)
	Max RSS bytes	842682368 (803 MiB)
Outputting started	2025-10-15 17:07:07
Output files
Finished	2025-10-15 17:07:30
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 15-Oct-2025 18:06:58 BST  run: 28891 subRun: 1 event: 220703 BeamEvent_module.cc:1828
Could not get XCET1 info

%MSG
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 15-Oct-2025 18:06:58 BST  run: 28891 subRun: 1 event: 220703 BeamEvent_module.cc:1846
Could not get XCET2 info

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 95.5683 5.23695
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 15-Oct-2025 18:06:58 BST  run: 28891 subRun: 1 event: 220703 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 220711 5
%MSG
Timing trigger: 12
Matched: 1
CKovs: 0 0
TOF, P: 93.83 5.11474
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 15-Oct-2025 18:07:00 BST  run: 28891 subRun: 1 event: 220711 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 220719 5
%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 95.4229 5.19889
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 15-Oct-2025 18:07:03 BST  run: 28891 subRun: 1 event: 220719 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 220727 5
%MSG
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
15-Oct-2025 18:07:06 BST  Closed output file "pdhd_228838_189_1_20251015T161318Z_beam.root"
15-Oct-2025 18:07:06 BST  Closed output file "pdhd_228838_189_1_20251015T161318Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.991262       12.4093       1311.73       1.85068       106.743        248    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.6922e-05    2.77685e-05   0.000300437    2.387e-05    2.03903e-05      248    
produce:triggerrawdecoder:PDHDTriggerReader3      0.717674       1.45744       2.60167       1.47763       0.46881        248    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.123943      0.143557      0.384135      0.131133      0.0312567       248    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0248639     0.0258326     0.059054      0.0251829    0.00333618       248    
produce:beamevent:BeamEvent                      0.00054067      10.6594       1310.67      0.0143437      106.796        248    
[art]:TriggerResults:TriggerResultInserter       1.5629e-05    2.66594e-05   0.000101181   2.4095e-05    1.02476e-05      248    
end_path:out1:RootOutput                          2.955e-06    5.98336e-06   4.9423e-05     4.884e-06    5.46566e-06      248    
end_path:out1:RootOutput(write)                   0.0697581     0.122482      0.190845      0.121586      0.0232091       248    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.991262       12.4093       1311.73       1.85068       106.743        248    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.6922e-05    2.77685e-05   0.000300437    2.387e-05    2.03903e-05      248    
produce:triggerrawdecoder:PDHDTriggerReader3      0.717674       1.45744       2.60167       1.47763       0.46881        248    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.123943      0.143557      0.384135      0.131133      0.0312567       248    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0248639     0.0258326     0.059054      0.0251829    0.00333618       248    
produce:beamevent:BeamEvent                      0.00054067      10.6594       1310.67      0.0143437      106.796        248    
[art]:TriggerResults:TriggerResultInserter       1.5629e-05    2.66594e-05   0.000101181   2.4095e-05    1.02476e-05      248    
end_path:out1:RootOutput                          2.955e-06    5.98336e-06   4.9423e-05     4.884e-06    5.46566e-06      248    
end_path:out1:RootOutput(write)                   0.0697581     0.122482      0.190845      0.121586      0.0232091       248    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1717.75 MB
  Peak resident set size usage (VmHWM): 842.682 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1717.75 MB
  Peak resident set size usage (VmHWM): 842.682 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 248 passed = 248 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        248        248          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 60.583607 Real = 3222.818109

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1717.75 VmHWM = 842.682

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 96776
-rw-r--r--. 1 dune004 dune  8674185 Oct 15 18:07 jobscript.log
-rw-r--r--. 1 dune004 dune     1304 Oct 15 18:07 justin-processed-pfns.txt
-rw-r--r--. 1 dune004 dune 32634047 Oct 15 18:07 pdhd_228838_189_1_20251015T161318Z_beam_hist.root
-rw-r--r--. 1 dune004 dune  8487961 Oct 15 18:07 debug.log
-rw-r--r--. 1 dune004 dune 47196820 Oct 15 18:07 pdhd_228838_189_1_20251015T161318Z_beam.root
-rw-r--r--. 1 dune004 dune      664 Oct 15 17:13 all-input-dids.txt