Jobsub ID 249617.38@dunegpschedd02.fnal.gov

Jobsub ID	249617.38@dunegpschedd02.fnal.gov
Workflow ID	10512
Stage ID	1
User name	calcuttj@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-22 11:21:32
Site	UK_Manchester
Entry	UBoone_T2_UK_Manchester_ce02
Last heartbeat	2025-11-22 14:08:22
From worker node	Hostname	wn1206240.tier2.hep.manchester.ac.uk
	cpuinfo	AMD EPYC 7702P 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-22 11:22:54
Input files	vd-protodune:np02vd_raw_run039324_0882_df-s04-d0_dw_0_20250906T095752.hdf5 vd-protodune:np02vd_raw_run039324_1070_df-s03-d0_dw_0_20250906T142339.hdf5 vd-protodune:np02vd_raw_run039324_2989_df-s03-d1_dw_0_20250908T080631.hdf5 vd-protodune:np02vd_raw_run039324_1166_df-s03-d3_dw_0_20250906T161018.hdf5 vd-protodune:np02vd_raw_run039324_0999_df-s02-d2_dw_0_20250906T121144.hdf5 vd-protodune:np02vd_raw_run039324_2679_df-s01-d2_dw_0_20250908T002020.hdf5 vd-protodune:np02vd_raw_run039324_0643_df-s01-d2_dw_0_20250906T042126.hdf5 vd-protodune:np02vd_raw_run039324_0538_df-s05-d4_dw_0_20250906T023058.hdf5 vd-protodune:np02vd_raw_run039324_2662_df-s03-d2_dw_0_20250908T000444.hdf5 vd-protodune:np02vd_raw_run039324_2022_df-s05-d0_dw_0_20250907T110809.hdf5 vd-protodune:np02vd_raw_run039324_1159_df-s03-d3_dw_0_20250906T160250.hdf5 vd-protodune:np02vd_raw_run039324_1260_df-s02-d3_dw_0_20250906T175405.hdf5 vd-protodune:np02vd_raw_run039324_1624_df-s02-d2_dw_0_20250907T011725.hdf5 vd-protodune:np02vd_raw_run039324_0439_df-s04-d0_dw_0_20250906T003920.hdf5 vd-protodune:np02vd_raw_run039324_1049_df-s05-d2_dw_0_20250906T130546.hdf5 vd-protodune:np02vd_raw_run039324_1529_df-s03-d2_dw_0_20250906T224842.hdf5 vd-protodune:np02vd_raw_run039324_2803_df-s01-d3_dw_0_20250908T023444.hdf5 vd-protodune:np02vd_raw_run039324_1508_df-s03-d1_dw_0_20250906T222643.hdf5 vd-protodune:np02vd_raw_run039324_1998_df-s02-d3_dw_0_20250907T103642.hdf5 vd-protodune:np02vd_raw_run039324_0879_df-s05-d3_dw_0_20250906T095257.hdf5
Jobscript	Exit code	0
	Real time	2h (9898s)
	CPU time	1m (108s = 1%)
	Max RSS bytes	1021390848 (974 MiB)
Outputting started	2025-11-22 14:07:53
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39324/fnal/10512/1/001/pdhd_249617_38_1_20251122T112314Z_beam_hist.root
Finished	2025-11-22 14:08:22
Saved logs	justin-logs:249617.38-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75715e+09 7.47436e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	0
	0
	0
	256
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2529
168 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2570
132 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2572


%MSG
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2596
114 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:2631
	0 0 0

%MSG
168 132 114
0.072499999999999995004 0.036499999999999997724 0.018499999999999999084
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: -1 20.38028911400737897
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460157 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 460177 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460177 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460177 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460177 BeamEvent_module.cc:559
High: 25569933

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460177 BeamEvent_module.cc:560
Low: 1034673538

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460177 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109822027030584706

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:07:50 GMT  run: 39324 subRun: 1 event: 460177 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109822027030428456
	Candidate: 109822027030584706
	End: 109822027030740956
	Match to Trigger: 1
Found 1 LLT HSI frames.
		LLT -- Timestamp=109822027030584705  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
22-Nov-2025 14:07:52 GMT  Closed output file "pdhd_249617_38_1_20251122T112314Z_beam.root"
22-Nov-2025 14:07:52 GMT  Closed output file "pdhd_249617_38_1_20251122T112314Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.181121       18.1151       3102.35      0.205583       148.812        517    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.9517e-05    2.78569e-05   0.000204304   2.5779e-05    1.10873e-05      517    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0443461     0.0542163      0.14533      0.0507687     0.0139786       517    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0223698     0.0239352     0.0752941     0.0233333    0.00449562       517    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.111187      0.124877      0.363614      0.118634      0.021063        517    
produce:beamevent:BeamEvent                      0.000510961     17.911        3102.15     0.00424075      148.812        517    
[art]:TriggerResults:TriggerResultInserter       1.5319e-05    2.21848e-05   7.2306e-05    2.0879e-05    6.89762e-06      517    
end_path:out1:RootOutput                          3.636e-06    5.2357e-06    3.6539e-05     4.849e-06    3.17997e-06      517    
end_path:out1:RootOutput(write)                  0.000287321   0.000610324   0.00532963    0.000417355   0.00040397       517    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.181121       18.1151       3102.35      0.205583       148.812        517    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.9517e-05    2.78569e-05   0.000204304   2.5779e-05    1.10873e-05      517    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0443461     0.0542163      0.14533      0.0507687     0.0139786       517    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0223698     0.0239352     0.0752941     0.0233333    0.00449562       517    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.111187      0.124877      0.363614      0.118634      0.021063        517    
produce:beamevent:BeamEvent                      0.000510961     17.911        3102.15     0.00424075      148.812        517    
[art]:TriggerResults:TriggerResultInserter       1.5319e-05    2.21848e-05   7.2306e-05    2.0879e-05    6.89762e-06      517    
end_path:out1:RootOutput                          3.636e-06    5.2357e-06    3.6539e-05     4.849e-06    3.17997e-06      517    
end_path:out1:RootOutput(write)                  0.000287321   0.000610324   0.00532963    0.000417355   0.00040397       517    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1963.41 MB
  Peak resident set size usage (VmHWM): 1021.39 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1963.41 MB
  Peak resident set size usage (VmHWM): 1021.39 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 517 passed = 517 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        517        517          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 96.520639 Real = 9872.503819

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1963.41 VmHWM = 1021.39

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 48068
-rw-r--r-- 1 dune01 dune01 21917488 Nov 22 14:07 jobscript.log
-rw-r--r-- 1 dune01 dune01     3100 Nov 22 14:07 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01  5280636 Nov 22 14:07 pdhd_249617_38_1_20251122T112314Z_beam_hist.root
-rw-r--r-- 1 dune01 dune01 21594628 Nov 22 14:07 debug.log
-rw-r--r-- 1 dune01 dune01   396219 Nov 22 14:07 pdhd_249617_38_1_20251122T112314Z_beam.root
-rw-r--r-- 1 dune01 dune01     1500 Nov 22 11:23 all-input-dids.txt