justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 254014.0@dunegpschedd02.fnal.gov

Jobsub ID254014.0@dunegpschedd02.fnal.gov
Workflow ID10707
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-27 15:15:52
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2025-11-27 19:11:01
From worker nodeHostnamedune002-535684.0-lcg2637.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-27 18:56:23
Input filesvd-protodune:np02vd_raw_run039305_0341_df-s04-d2_dw_0_20250905T042930.hdf5
vd-protodune:np02vd_raw_run039305_0412_df-s05-d4_dw_0_20250905T072242.hdf5
vd-protodune:np02vd_raw_run039305_0397_df-s03-d2_dw_0_20250905T063332.hdf5
vd-protodune:np02vd_raw_run039305_0478_df-s03-d0_dw_0_20250905T114052.hdf5
vd-protodune:np02vd_raw_run039305_0323_df-s04-d0_dw_0_20250905T035442.hdf5
vd-protodune:np02vd_raw_run039305_0452_df-s05-d4_dw_0_20250905T100707.hdf5
vd-protodune:np02vd_raw_run039305_0427_df-s02-d1_dw_0_20250905T081113.hdf5
JobscriptExit code0
Real time7m (464s)
CPU time0m (45s = 9%)
Max RSS bytes991641600 (945 MiB)
Outputting started2025-11-27 19:04:08
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10707/1/001/pdhd_254014_0_1_20251127T185635Z_beam_hist.root
Finished2025-11-27 19:11:01
Saved logsjustin-logs:254014.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 27-Nov-2025 19:04:04 UTC  run: 39305 subRun: 1 event: 406343 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 406363 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:04 UTC  run: 39305 subRun: 1 event: 406363 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:04 UTC  run: 39305 subRun: 1 event: 406363 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:04 UTC  run: 39305 subRun: 1 event: 406363 BeamEvent_module.cc:559
High: 25568592

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:04 UTC  run: 39305 subRun: 1 event: 406363 BeamEvent_module.cc:560
Low: 1006092206

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:04 UTC  run: 39305 subRun: 1 event: 406363 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109816267450859438

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:04 UTC  run: 39305 subRun: 1 event: 406363 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109816267450703188
	Candidate: 109816267450859438
	End: 109816267451015688
	Match to Trigger: 1
Found 1 LLT HSI frames.
		LLT -- Timestamp=109816267450859437  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 27-Nov-2025 19:04:04 UTC  run: 39305 subRun: 1 event: 406363 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 406383 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406383 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406383 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406383 BeamEvent_module.cc:559
High: 25568592

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406383 BeamEvent_module.cc:560
Low: 2506092206

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406383 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109816268950859438

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406383 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109816268950703188
	Candidate: 109816268950859438
	End: 109816268951015688
	Match to Trigger: 1
Found 1 LLT HSI frames.
		LLT -- Timestamp=109816268950859437  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406383 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 406403 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406403 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406403 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406403 BeamEvent_module.cc:559
High: 25568592

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406403 BeamEvent_module.cc:560
Low: 4006092206

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406403 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109816270450859438

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 19:04:05 UTC  run: 39305 subRun: 1 event: 406403 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109816270450703188
	Candidate: 109816270450859438
	End: 109816270451015688
	Match to Trigger: 1
Found 1 LLT HSI frames.
		LLT -- Timestamp=109816270450859437  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
27-Nov-2025 19:04:07 UTC  Closed output file "pdhd_254014_0_1_20251127T185635Z_beam.root"
27-Nov-2025 19:04:07 UTC  Closed output file "pdhd_254014_0_1_20251127T185635Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.185081      0.937074       26.5936      0.198721       3.57068        314    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.8331e-05    2.88979e-05   0.000225875   2.5516e-05    1.65268e-05      314    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0456607     0.053791      0.123525      0.0514287     0.0113667       314    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0229677     0.0233835     0.0333356     0.0233311    0.000594855      314    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.113385      0.121977      0.210195       0.11563      0.0138387       314    
produce:beamevent:BeamEvent                      0.00043638     0.736826       26.3933     0.00282301      3.57056        314    
[art]:TriggerResults:TriggerResultInserter       1.5251e-05    2.46262e-05   0.000175004   2.2546e-05    1.10468e-05      314    
end_path:out1:RootOutput                          3.871e-06    6.20056e-06   6.7061e-05     5.341e-06    5.14116e-06      314    
end_path:out1:RootOutput(write)                  0.000254056   0.000568203   0.00570169    0.000416615   0.000418737      314    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.185081      0.937074       26.5936      0.198721       3.57068        314    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.8331e-05    2.88979e-05   0.000225875   2.5516e-05    1.65268e-05      314    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0456607     0.053791      0.123525      0.0514287     0.0113667       314    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0229677     0.0233835     0.0333356     0.0233311    0.000594855      314    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.113385      0.121977      0.210195       0.11563      0.0138387       314    
produce:beamevent:BeamEvent                      0.00043638     0.736826       26.3933     0.00282301      3.57056        314    
[art]:TriggerResults:TriggerResultInserter       1.5251e-05    2.46262e-05   0.000175004   2.2546e-05    1.10468e-05      314    
end_path:out1:RootOutput                          3.871e-06    6.20056e-06   6.7061e-05     5.341e-06    5.14116e-06      314    
end_path:out1:RootOutput(write)                  0.000254056   0.000568203   0.00570169    0.000416615   0.000418737      314    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2033.41 MB
  Peak resident set size usage (VmHWM): 1039.25 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2033.41 MB
  Peak resident set size usage (VmHWM): 1039.25 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 314 passed = 314 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        314        314          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 36.083212 Real = 447.088975

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2033.41 VmHWM = 1039.25

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 31396
-rw-r--r-- 1 dune002 dune 12369229 Nov 27 19:04 jobscript.log
-rw-r--r-- 1 dune002 dune     1085 Nov 27 19:04 justin-processed-pfns.txt
-rw-r--r-- 1 dune002 dune  2912822 Nov 27 19:04 pdhd_254014_0_1_20251127T185635Z_beam_hist.root
-rw-r--r-- 1 dune002 dune 12186708 Nov 27 19:04 debug.log
-rw-r--r-- 1 dune002 dune   257957 Nov 27 19:04 pdhd_254014_0_1_20251127T185635Z_beam.root
-rw-r--r-- 1 dune002 dune      525 Nov 27 18:56 all-input-dids.txt
justIN time: 2026-02-08 12:12:16 UTC       justIN version: 01.06.00