Jobsub ID 249617.134@dunegpschedd02.fnal.gov

Jobsub ID	249617.134@dunegpschedd02.fnal.gov
Workflow ID	10512
Stage ID	1
User name	calcuttj@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-22 11:21:32
Site	UK_Manchester
Entry	UBoone_T2_UK_Manchester_ce01
Last heartbeat	2025-11-22 14:07:57
From worker node	Hostname	wn1206241.tier2.hep.manchester.ac.uk
	cpuinfo	AMD EPYC 7702P 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-22 11:23:00
Input files	vd-protodune:np02vd_raw_run039324_2147_df-s03-d2_dw_0_20250907T133335.hdf5 vd-protodune:np02vd_raw_run039324_1420_df-s03-d3_dw_0_20250906T204746.hdf5 vd-protodune:np02vd_raw_run039324_2455_df-s04-d0_dw_0_20250907T200606.hdf5 vd-protodune:np02vd_raw_run039324_1051_df-s04-d3_dw_0_20250906T132145.hdf5 vd-protodune:np02vd_raw_run039324_0241_df-s04-d1_dw_0_20250905T204220.hdf5 vd-protodune:np02vd_raw_run039324_0656_df-s05-d3_dw_0_20250906T043551.hdf5 vd-protodune:np02vd_raw_run039324_1564_df-s04-d1_dw_0_20250906T233826.hdf5 vd-protodune:np02vd_raw_run039324_0142_df-s05-d0_dw_0_20250905T182720.hdf5 vd-protodune:np02vd_raw_run039324_1688_df-s03-d3_dw_0_20250907T035301.hdf5 vd-protodune:np02vd_raw_run039324_1575_df-s05-d0_dw_0_20250906T235136.hdf5 vd-protodune:np02vd_raw_run039324_0859_df-s02-d0_dw_0_20250906T093215.hdf5 vd-protodune:np02vd_raw_run039324_0160_df-s03-d1_dw_0_20250905T184930.hdf5 vd-protodune:np02vd_raw_run039324_0489_df-s01-d2_dw_0_20250906T013330.hdf5 vd-protodune:np02vd_raw_run039324_0996_df-s05-d2_dw_0_20250906T120841.hdf5 vd-protodune:np02vd_raw_run039324_0943_df-s01-d3_dw_0_20250906T111247.hdf5 vd-protodune:np02vd_raw_run039324_0843_df-s02-d1_dw_0_20250906T091622.hdf5 vd-protodune:np02vd_raw_run039324_1013_df-s05-d0_dw_0_20250906T122655.hdf5 vd-protodune:np02vd_raw_run039324_2905_df-s05-d3_dw_0_20250908T051645.hdf5 vd-protodune:np02vd_raw_run039324_2153_df-s03-d2_dw_0_20250907T133953.hdf5 vd-protodune:np02vd_raw_run039324_1241_df-s02-d2_dw_0_20250906T173120.hdf5
Jobscript	Exit code	0
	Real time	2h (9865s)
	CPU time	1m (115s = 1%)
	Max RSS bytes	981692416 (936 MiB)
Outputting started	2025-11-22 14:07:26
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39324/fnal/10512/1/001/pdhd_249617_134_1_20251122T112325Z_beam_hist.root
Finished	2025-11-22 14:07:57
Saved logs	justin-logs:249617.134-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75718e+09 7.08666e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	0
	0
	1073741824
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2529
158 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2570
145 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2572


%MSG
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2596
137 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:2631
	0 0 0

%MSG
158 145 137
0.0625 0.049500000000000002331 0.041500000000000002165
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: -1 1.9675440660500687073
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 22-Nov-2025 14:07:22 GMT  run: 39324 subRun: 1 event: 650884 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 650904 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:23 GMT  run: 39324 subRun: 1 event: 650904 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:23 GMT  run: 39324 subRun: 1 event: 650904 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:23 GMT  run: 39324 subRun: 1 event: 650904 BeamEvent_module.cc:559
High: 25570333

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:23 GMT  run: 39324 subRun: 1 event: 650904 BeamEvent_module.cc:560
Low: 2297755138

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:23 GMT  run: 39324 subRun: 1 event: 650904 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109823746280584706

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:23 GMT  run: 39324 subRun: 1 event: 650904 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109823746280428456
	Candidate: 109823746280584706
	End: 109823746280740956
	Match to Trigger: 1
Found 1 LLT HSI frames.
		LLT -- Timestamp=109823746280584705  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
22-Nov-2025 14:07:25 GMT  Closed output file "pdhd_249617_134_1_20251122T112325Z_beam.root"
22-Nov-2025 14:07:25 GMT  Closed output file "pdhd_249617_134_1_20251122T112325Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.186404       18.0576       2734.3       0.206688       139.412        516    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.9948e-05    2.98224e-05   0.000402067    2.692e-05    2.03655e-05      516    
produce:triggerrawdecoder:PDVDTriggerReader4      0.044787      0.0542898     0.176999      0.0514746     0.0137401       516    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0227943     0.0247412     0.100139      0.0241261    0.00491853       516    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.112441       0.12651      0.343552       0.11852      0.0220012       516    
produce:beamevent:BeamEvent                      0.000524549     17.8509       2734.1       0.0047902      139.413        516    
[art]:TriggerResults:TriggerResultInserter       1.6281e-05    2.35133e-05   8.6333e-05    2.2012e-05    7.27114e-06      516    
end_path:out1:RootOutput                          3.897e-06    6.23719e-06   0.000163829    5.29e-06     8.90984e-06      516    
end_path:out1:RootOutput(write)                  0.000283424   0.000676705   0.00500207    0.000466289   0.000515736      516    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.186404       18.0576       2734.3       0.206688       139.412        516    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.9948e-05    2.98224e-05   0.000402067    2.692e-05    2.03655e-05      516    
produce:triggerrawdecoder:PDVDTriggerReader4      0.044787      0.0542898     0.176999      0.0514746     0.0137401       516    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0227943     0.0247412     0.100139      0.0241261    0.00491853       516    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.112441       0.12651      0.343552       0.11852      0.0220012       516    
produce:beamevent:BeamEvent                      0.000524549     17.8509       2734.1       0.0047902      139.413        516    
[art]:TriggerResults:TriggerResultInserter       1.6281e-05    2.35133e-05   8.6333e-05    2.2012e-05    7.27114e-06      516    
end_path:out1:RootOutput                          3.897e-06    6.23719e-06   0.000163829    5.29e-06     8.90984e-06      516    
end_path:out1:RootOutput(write)                  0.000283424   0.000676705   0.00500207    0.000466289   0.000515736      516    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1928.38 MB
  Peak resident set size usage (VmHWM): 981.692 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1928.38 MB
  Peak resident set size usage (VmHWM): 981.692 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 516 passed = 516 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        516        516          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 103.132414 Real = 9830.766681

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1928.38 VmHWM = 981.692

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 49552
-rw-r--r-- 1 dune01 dune01 22551856 Nov 22 14:07 jobscript.log
-rw-r--r-- 1 dune01 dune01     3100 Nov 22 14:07 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01  5537481 Nov 22 14:07 pdhd_249617_134_1_20251122T112325Z_beam_hist.root
-rw-r--r-- 1 dune01 dune01 22229637 Nov 22 14:07 debug.log
-rw-r--r-- 1 dune01 dune01   392418 Nov 22 14:07 pdhd_249617_134_1_20251122T112325Z_beam.root
-rw-r--r-- 1 dune01 dune01     1500 Nov 22 11:23 all-input-dids.txt