justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 228843.32@dunegpschedd02.fnal.gov

Jobsub ID228843.32@dunegpschedd02.fnal.gov
Workflow ID9021
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-15 16:23:36
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2025-10-15 18:21:36
From worker nodeHostnamecomp05-24
cpuinfoIntel(R) Xeon(R) Platinum 8352Y CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2025-10-15 16:24:43
Input fileshd-protodune:np04hd_raw_run028891_0286_dataflow3_datawriter_0_20240823T224618.hdf5
hd-protodune:np04hd_raw_run028891_0289_dataflow3_datawriter_0_20240823T225115.hdf5
hd-protodune:np04hd_raw_run028891_0292_dataflow0_datawriter_0_20240823T225554.hdf5
hd-protodune:np04hd_raw_run028891_0296_dataflow6_datawriter_0_20240823T230217.hdf5
hd-protodune:np04hd_raw_run028891_0299_dataflow7_datawriter_0_20240823T230649.hdf5
JobscriptExit code0
Real time1h (6994s)
CPU time0m (28s = 0%)
Max RSS bytes820809728 (782 MiB)
Outputting started2025-10-15 18:21:18
Output files
Finished2025-10-15 18:21:36
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 15-Oct-2025 19:21:11 BST  run: 28891 subRun: 1 event: 74383 BeamEvent_module.cc:1828
Could not get XCET1 info

%MSG
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 15-Oct-2025 19:21:11 BST  run: 28891 subRun: 1 event: 74383 BeamEvent_module.cc:1846
Could not get XCET2 info

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: -1 4.95863
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 90.625 6.03602
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: -1 5.23002
15-Oct-2025 19:21:16 BST  Closed output file "pdhd_228843_32_1_20251015T162449Z_beam.root"
15-Oct-2025 19:21:16 BST  Closed output file "pdhd_228843_32_1_20251015T162449Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.925159       44.4871       3241.85       1.12924       295.099        155    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.2677e-05    1.69451e-05   9.7462e-05    1.5496e-05    7.89391e-06      155    
produce:triggerrawdecoder:PDHDTriggerReader3       0.68136       1.01096       2.22516      0.819455      0.364039        155    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.121901      0.141362      0.354361       0.13243      0.0275318       155    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0243782     0.0258197     0.0728752     0.0247761    0.00606836       155    
produce:beamevent:BeamEvent                      0.000167602     43.2197       3240.78     0.00659176      295.116        155    
[art]:TriggerResults:TriggerResultInserter       1.0591e-05    1.89803e-05   6.8217e-05    1.8074e-05    6.78583e-06      155    
end_path:out1:RootOutput                          2.425e-06    3.36079e-06   2.4566e-05     2.991e-06    2.03619e-06      155    
end_path:out1:RootOutput(write)                   0.0495755     0.0889791      0.17129      0.0876439     0.0187055       155    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.925159       44.4871       3241.85       1.12924       295.099        155    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.2677e-05    1.69451e-05   9.7462e-05    1.5496e-05    7.89391e-06      155    
produce:triggerrawdecoder:PDHDTriggerReader3       0.68136       1.01096       2.22516      0.819455      0.364039        155    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.121901      0.141362      0.354361       0.13243      0.0275318       155    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0243782     0.0258197     0.0728752     0.0247761    0.00606836       155    
produce:beamevent:BeamEvent                      0.000167602     43.2197       3240.78     0.00659176      295.116        155    
[art]:TriggerResults:TriggerResultInserter       1.0591e-05    1.89803e-05   6.8217e-05    1.8074e-05    6.78583e-06      155    
end_path:out1:RootOutput                          2.425e-06    3.36079e-06   2.4566e-05     2.991e-06    2.03619e-06      155    
end_path:out1:RootOutput(write)                   0.0495755     0.0889791      0.17129      0.0876439     0.0187055       155    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1644.32 MB
  Peak resident set size usage (VmHWM): 820.777 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1644.32 MB
  Peak resident set size usage (VmHWM): 820.777 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 155 passed = 155 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        155        155          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 25.675170 Real = 6986.002961

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1644.32 VmHWM = 820.777

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 51853
-rw-r--r-- 1 pltdune004 pltdune  5433574 Oct 15 19:21 jobscript.log
-rw-r--r-- 1 pltdune004 pltdune      815 Oct 15 19:21 justin-processed-pfns.txt
-rw-r--r-- 1 pltdune004 pltdune 13253196 Oct 15 19:21 pdhd_228843_32_1_20251015T162449Z_beam_hist.root
-rw-r--r-- 1 pltdune004 pltdune  5313689 Oct 15 19:21 debug.log
-rw-r--r-- 1 pltdune004 pltdune 29093787 Oct 15 19:21 pdhd_228843_32_1_20251015T162449Z_beam.root
-rw-r--r-- 1 pltdune004 pltdune      415 Oct 15 17:24 all-input-dids.txt
justIN time: 2025-11-04 01:55:15 UTC       justIN version: 01.05.01