justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 235901.25@dunegpschedd01.fnal.gov

Jobsub ID235901.25@dunegpschedd01.fnal.gov
Workflow ID9021
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-18 09:25:07
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce01
Last heartbeat2025-10-18 09:28:38
From worker nodeHostnamedune004-9612654.0-lcg2703.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-18 09:25:49
Input fileshd-protodune:np04hd_raw_run028891_0388_dataflow3_datawriter_0_20240824T011933.hdf5
hd-protodune:np04hd_raw_run028891_0411_dataflow6_datawriter_0_20240824T015150.hdf5
JobscriptExit code0
Real time2m (135s)
CPU time0m (23s = 17%)
Max RSS bytes659578880 (629 MiB)
Outputting started2025-10-18 09:28:05
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/beam_inst_pdhd/fnal/09021/1/001/pdhd_235901_25_1_20251018T092600Z_beam.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/beam_inst_pdhd/fnal/09021/1/001/pdhd_235901_25_1_20251018T092600Z_beam_hist.root
Finished2025-10-18 09:28:38
Saved logsjustin-logs:235901.25-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

345 Breaking 2A Gen -2.71396e+06

%MSG
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 18-Oct-2025 09:28:00 UTC  run: 28891 subRun: 1 event: 102182 BeamEvent_module.cc:1828
Could not get XCET1 info

%MSG
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 18-Oct-2025 09:28:00 UTC  run: 28891 subRun: 1 event: 102182 BeamEvent_module.cc:1846
Could not get XCET2 info

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 95.8233 4.43896
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 18-Oct-2025 09:28:00 UTC  run: 28891 subRun: 1 event: 102182 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 102190 5
%MSG
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
18-Oct-2025 09:28:04 UTC  Closed output file "pdhd_235901_25_1_20251018T092600Z_beam.root"
18-Oct-2025 09:28:04 UTC  Closed output file "pdhd_235901_25_1_20251018T092600Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.908301       1.31118       9.64416       1.05914       1.27082        62     
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        1.943e-05    3.01593e-05   0.000195385   2.4347e-05    2.36308e-05      62     
produce:triggerrawdecoder:PDHDTriggerReader3      0.654126      0.746868       1.31126      0.734781      0.0922894       62     
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.113525      0.136128      0.237713      0.126366      0.0266207       62     
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0228162     0.023331      0.0249709     0.0231506    0.000489332      62     
produce:beamevent:BeamEvent                      0.000477942    0.267008       8.61198     0.00726309      1.25813        62     
[art]:TriggerResults:TriggerResultInserter       1.3951e-05    3.07852e-05   0.000121905   2.60245e-05   1.75768e-05      62     
end_path:out1:RootOutput                          3.325e-06    7.50411e-06   0.000126331   5.0075e-06    1.56464e-05      62     
end_path:out1:RootOutput(write)                   0.0803628      0.13727      0.322249      0.133315      0.0387182       62     
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.908301       1.31118       9.64416       1.05914       1.27082        62     
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        1.943e-05    3.01593e-05   0.000195385   2.4347e-05    2.36308e-05      62     
produce:triggerrawdecoder:PDHDTriggerReader3      0.654126      0.746868       1.31126      0.734781      0.0922894       62     
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.113525      0.136128      0.237713      0.126366      0.0266207       62     
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0228162     0.023331      0.0249709     0.0231506    0.000489332      62     
produce:beamevent:BeamEvent                      0.000477942    0.267008       8.61198     0.00726309      1.25813        62     
[art]:TriggerResults:TriggerResultInserter       1.3951e-05    3.07852e-05   0.000121905   2.60245e-05   1.75768e-05      62     
end_path:out1:RootOutput                          3.325e-06    7.50411e-06   0.000126331   5.0075e-06    1.56464e-05      62     
end_path:out1:RootOutput(write)                   0.0803628      0.13727      0.322249      0.133315      0.0387182       62     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1658.8 MB
  Peak resident set size usage (VmHWM): 783.868 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1658.8 MB
  Peak resident set size usage (VmHWM): 783.868 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 62 passed = 62 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         62         62          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 15.326555 Real = 118.406266

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1658.8 VmHWM = 783.868

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 20528
-rw-r--r-- 1 dune004 dune  2468466 Oct 18 09:28 jobscript.log
-rw-r--r-- 1 dune004 dune      326 Oct 18 09:28 justin-processed-pfns.txt
-rw-r--r-- 1 dune004 dune  2519795 Oct 18 09:28 pdhd_235901_25_1_20251018T092600Z_beam_hist.root
-rw-r--r-- 1 dune004 dune  2414696 Oct 18 09:28 debug.log
-rw-r--r-- 1 dune004 dune 11877977 Oct 18 09:28 pdhd_235901_25_1_20251018T092600Z_beam.root
-rw-r--r-- 1 dune004 dune      166 Oct 18 09:25 all-input-dids.txt
justIN time: 2025-11-05 05:38:01 UTC       justIN version: 01.05.01