Jobsub ID 255168.1@dunegpschedd01.fnal.gov

Jobsub ID	255168.1@dunegpschedd01.fnal.gov
Workflow ID	10500
Stage ID	1
User name	calcuttj@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-21 23:58:00
Site	UK_Oxford
Entry	DUNE_UK_SGrid_Oxford_arc01
Last heartbeat	2025-11-22 04:08:14
From worker node	Hostname	t2wn176.physics.ox.ac.uk
	cpuinfo	AMD EPYC 9655 96-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-22 00:00:16
Input files	vd-protodune:np02vd_raw_run039324_0635_df-s03-d0_dw_0_20250906T041509.hdf5 vd-protodune:np02vd_raw_run039324_0538_df-s05-d4_dw_0_20250906T023058.hdf5 vd-protodune:np02vd_raw_run039324_1852_df-s04-d0_dw_0_20250907T071805.hdf5 vd-protodune:np02vd_raw_run039324_0089_df-s05-d4_dw_0_20250905T165155.hdf5 vd-protodune:np02vd_raw_run039324_0409_df-s05-d3_dw_0_20250905T235918.hdf5 vd-protodune:np02vd_raw_run039324_2807_df-s04-d0_dw_0_20250908T024153.hdf5 vd-protodune:np02vd_raw_run039324_2772_df-s05-d3_dw_0_20250908T020207.hdf5 vd-protodune:np02vd_raw_run039324_0053_df-s05-d5_dw_0_20250905T155502.hdf5 vd-protodune:np02vd_raw_run039324_2866_df-s05-d1_dw_0_20250908T034809.hdf5 vd-protodune:np02vd_raw_run039324_0214_df-s02-d2_dw_0_20250905T200808.hdf5 vd-protodune:np02vd_raw_run039324_1159_df-s03-d3_dw_0_20250906T160250.hdf5 vd-protodune:np02vd_raw_run039324_1491_df-s01-d2_dw_0_20250906T220503.hdf5 vd-protodune:np02vd_raw_run039324_0643_df-s04-d0_dw_0_20250906T042347.hdf5 vd-protodune:np02vd_raw_run039324_0207_df-s05-d2_dw_0_20250905T195617.hdf5 vd-protodune:np02vd_raw_run039324_2251_df-s03-d0_dw_0_20250907T151953.hdf5 vd-protodune:np02vd_raw_run039324_2675_df-s05-d2_dw_0_20250908T001840.hdf5 vd-protodune:np02vd_raw_run039324_0513_df-s03-d1_dw_0_20250906T020015.hdf5 vd-protodune:np02vd_raw_run039324_1624_df-s02-d2_dw_0_20250907T011725.hdf5 vd-protodune:np02vd_raw_run039324_1500_df-s03-d0_dw_0_20250906T221828.hdf5 vd-protodune:np02vd_raw_run039324_2263_df-s03-d1_dw_0_20250907T153238.hdf5
Jobscript	Exit code	0
	Real time	4h (14783s)
	CPU time	1m (74s = 0%)
	Max RSS bytes	1851912192 (1766 MiB)
Outputting started	2025-11-22 04:06:40
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39324/fnal/10500/1/001/pdhd_255168_1_1_20251122T000030Z_beam_hist.root
Finished	2025-11-22 04:08:14
Saved logs	justin-logs:255168.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

t: 1187867 BeamEvent_module.cc:829
Set event T0: 1.75726e+09 3.43198e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:1239
Trigger: 44 1.75726e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:852
Setting beam event for matched event

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:853
SetActiveTrigger 44

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:854
Set T0  1.75726e+09 3.43198e+08


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:879
beamevt has TOF 76.123 and TOFChan 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:883
beamevt has Magnet Current 33.2

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:884
beamevt CKov0: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:885
beamevt CKov1: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75726e+09 3.43198e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	262144
	0
	0
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2529
82 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2570
72 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2572


%MSG
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2596
70 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:2631
	0 0 0

%MSG
82 72 70
-0.013499999999999999847 -0.023500000000000000056 -0.025499999999999998362
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 04:06:38 GMT  run: 39324 subRun: 1 event: 1187867 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 1
TOF, P: 76.123046875 1.0691856971658928455
22-Nov-2025 04:06:39 GMT  Closed output file "pdhd_255168_1_1_20251122T000030Z_beam.root"
22-Nov-2025 04:06:39 GMT  Closed output file "pdhd_255168_1_1_20251122T000030Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.146815       27.6867       4236.71      0.178666       212.538        520    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.2419e-05    2.07925e-05   0.000279083    1.982e-05    1.21575e-05      520    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0361086     0.0526781      1.56372      0.0446128     0.0784986       520    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0179956     0.0217351     0.258937      0.0194959     0.0122609       520    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.090087       0.1168        1.54326      0.104058      0.0930194       520    
produce:beamevent:BeamEvent                      0.000307726     27.4948       4236.54     0.00161396      212.54         520    
[art]:TriggerResults:TriggerResultInserter        9.424e-06    1.55745e-05   7.6656e-05    1.43215e-05   5.31038e-06      520    
end_path:out1:RootOutput                          4.116e-06    4.99418e-06   3.0466e-05    4.8675e-06    1.36998e-06      520    
end_path:out1:RootOutput(write)                  0.000167264   0.000372597   0.00284728    0.000260855   0.000216853      520    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.146815       27.6867       4236.71      0.178666       212.538        520    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.2419e-05    2.07925e-05   0.000279083    1.982e-05    1.21575e-05      520    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0361086     0.0526781      1.56372      0.0446128     0.0784986       520    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0179956     0.0217351     0.258937      0.0194959     0.0122609       520    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.090087       0.1168        1.54326      0.104058      0.0930194       520    
produce:beamevent:BeamEvent                      0.000307726     27.4948       4236.54     0.00161396      212.54         520    
[art]:TriggerResults:TriggerResultInserter        9.424e-06    1.55745e-05   7.6656e-05    1.43215e-05   5.31038e-06      520    
end_path:out1:RootOutput                          4.116e-06    4.99418e-06   3.0466e-05    4.8675e-06    1.36998e-06      520    
end_path:out1:RootOutput(write)                  0.000167264   0.000372597   0.00284728    0.000260855   0.000216853      520    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3055.96 MB
  Peak resident set size usage (VmHWM): 1851.91 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3055.96 MB
  Peak resident set size usage (VmHWM): 1851.91 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 520 passed = 520 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        520        520          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 68.545110 Real = 14756.630675

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3055.96 VmHWM = 1851.91

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 662492
-rw-r--r-- 1 dune020 dune 440151239 Nov 22 04:06 jobscript.log
-rw-r--r-- 1 dune020 dune      3100 Nov 22 04:06 justin-processed-pfns.txt
-rw-r--r-- 1 dune020 dune   5685404 Nov 22 04:06 pdhd_255168_1_1_20251122T000030Z_beam_hist.root
-rw-r--r-- 1 dune020 dune 231283605 Nov 22 04:06 debug.log
-rw-r--r-- 1 dune020 dune    397324 Nov 22 04:06 pdhd_255168_1_1_20251122T000030Z_beam.root
-rw-r--r-- 1 dune020 dune      1500 Nov 22 00:00 all-input-dids.txt