Jobsub ID 257340.0@dunegpschedd01.fnal.gov

Jobsub ID	257340.0@dunegpschedd01.fnal.gov
Workflow ID	10649
Stage ID	1
User name	calcuttj@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-25 13:20:19
Site	NL_NIKHEF
Entry	VIRGO_NL_NIKHEF_juk
Last heartbeat	2025-11-25 14:33:19
From worker node	Hostname	wn-lot-021.farm.nikhef.nl
	cpuinfo	AMD EPYC 7702P 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	129600 (36 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-25 13:49:52
Input files	vd-protodune:np02vd_raw_run039305_0295_df-s05-d4_dw_0_20250905T025850.hdf5 vd-protodune:np02vd_raw_run039305_0090_df-s05-d1_dw_0_20250904T182210.hdf5 vd-protodune:np02vd_raw_run039305_0265_df-s01-d3_dw_0_20250905T015849.hdf5 vd-protodune:np02vd_raw_run039305_0328_df-s05-d0_dw_0_20250905T040500.hdf5 vd-protodune:np02vd_raw_run039305_0102_df-s03-d1_dw_0_20250904T184801.hdf5 vd-protodune:np02vd_raw_run039305_0064_df-s02-d1_dw_0_20250904T170420.hdf5 vd-protodune:np02vd_raw_run039305_0477_df-s05-d3_dw_0_20250905T113829.hdf5 vd-protodune:np02vd_raw_run039305_0045_df-s03-d2_dw_0_20250904T160753.hdf5 vd-protodune:np02vd_raw_run039305_0151_df-s05-d1_dw_0_20250904T210829.hdf5 vd-protodune:np02vd_raw_run039305_0267_df-s05-d2_dw_0_20250905T020319.hdf5 vd-protodune:np02vd_raw_run039305_0215_df-s02-d1_dw_0_20250905T001901.hdf5 vd-protodune:np02vd_raw_run039305_0008_df-s03-d3_dw_0_20250904T143208.hdf5 vd-protodune:np02vd_raw_run039305_0218_df-s05-d2_dw_0_20250905T002510.hdf5 vd-protodune:np02vd_raw_run039305_0415_df-s02-d1_dw_0_20250905T073153.hdf5 vd-protodune:np02vd_raw_run039305_0310_df-s02-d3_dw_0_20250905T032804.hdf5 vd-protodune:np02vd_raw_run039305_0395_df-s05-d0_dw_0_20250905T062832.hdf5 vd-protodune:np02vd_raw_run039305_0374_df-s02-d0_dw_0_20250905T054131.hdf5 vd-protodune:np02vd_raw_run039305_0122_df-s01-d2_dw_0_20250904T193750.hdf5 vd-protodune:np02vd_raw_run039305_0024_df-s02-d1_dw_0_20250904T150338.hdf5 vd-protodune:np02vd_raw_run039305_0137_df-s03-d1_dw_0_20250904T201021.hdf5
Jobscript	Exit code	0
	Real time	42m (2573s)
	CPU time	2m (134s = 5%)
	Max RSS bytes	1061220352 (1012 MiB)
Outputting started	2025-11-25 14:32:46
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10649/1/001/pdhd_257340_0_1_20251125T135009Z_beam_hist.root
Finished	2025-11-25 14:33:19
Saved logs	justin-logs:257340.0-dunegpschedd01.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
79 diff: -0.0277886

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
80 diff: -0.0749495

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
81 diff: -0.144266

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
82 diff: -0.18633

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
83 diff: -0.191861

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
84 diff: -0.205101

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
85 diff: -0.211514

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
86 diff: -0.239972

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
87 diff: -0.360725

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
88 diff: -0.364945

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
89 diff: -0.445856

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
90 diff: -0.472091

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
91 diff: -0.520508

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
92 diff: -0.612525

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
93 diff: -0.895264

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
94 diff: -0.913388

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:817
95 diff: -0.924886

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 BeamEvent_module.cc:836
Could not find matching time 

%MSG
Timing trigger: 12
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 25-Nov-2025 15:32:43 CET  run: 39305 subRun: 1 event: 130787 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 130807 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:44 CET  run: 39305 subRun: 1 event: 130807 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:44 CET  run: 39305 subRun: 1 event: 130807 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:44 CET  run: 39305 subRun: 1 event: 130807 BeamEvent_module.cc:559
High: 25567959

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:44 CET  run: 39305 subRun: 1 event: 130807 BeamEvent_module.cc:560
Low: 3782890574

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:44 CET  run: 39305 subRun: 1 event: 130807 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109813551513359438

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 25-Nov-2025 15:32:44 CET  run: 39305 subRun: 1 event: 130807 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109813551513203188
	Candidate: 109813551513359438
	End: 109813551513515688
	Match to Trigger: 1
Found 1 LLT HSI frames.
		LLT -- Timestamp=109813551513359437  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
25-Nov-2025 15:32:45 CET  Closed output file "pdhd_257340_0_1_20251125T135009Z_beam.root"
25-Nov-2025 15:32:45 CET  Closed output file "pdhd_257340_0_1_20251125T135009Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.137564       2.31381       95.7828      0.151032       10.1128        947    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        1.579e-05    2.6158e-05    0.00117955    2.4255e-05    3.87846e-05      947    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0337809     0.0409696     0.256128      0.0362853     0.0138554       947    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0168941     0.0181991     0.060463      0.0176372    0.00349539       947    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0844351     0.0912557     0.185549      0.0878819    0.00991649       947    
produce:beamevent:BeamEvent                      0.000328515     2.16246       95.5844     0.00279456      10.1123        947    
[art]:TriggerResults:TriggerResultInserter       1.0851e-05    1.80575e-05   0.000138409   1.7323e-05    7.99635e-06      947    
end_path:out1:RootOutput                          3.246e-06    5.0201e-06    0.000119635    4.709e-06    5.23445e-06      947    
end_path:out1:RootOutput(write)                  0.000220474   0.000502661   0.00353802    0.000313918   0.000344381      947    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.137564       2.31381       95.7828      0.151032       10.1128        947    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        1.579e-05    2.6158e-05    0.00117955    2.4255e-05    3.87846e-05      947    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0337809     0.0409696     0.256128      0.0362853     0.0138554       947    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0168941     0.0181991     0.060463      0.0176372    0.00349539       947    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0844351     0.0912557     0.185549      0.0878819    0.00991649       947    
produce:beamevent:BeamEvent                      0.000328515     2.16246       95.5844     0.00279456      10.1123        947    
[art]:TriggerResults:TriggerResultInserter       1.0851e-05    1.80575e-05   0.000138409   1.7323e-05    7.99635e-06      947    
end_path:out1:RootOutput                          3.246e-06    5.0201e-06    0.000119635    4.709e-06    5.23445e-06      947    
end_path:out1:RootOutput(write)                  0.000220474   0.000502661   0.00353802    0.000313918   0.000344381      947    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2111.18 MB
  Peak resident set size usage (VmHWM): 1061.22 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2111.18 MB
  Peak resident set size usage (VmHWM): 1061.22 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 947 passed = 947 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        947        947          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 127.205778 Real = 2552.731443

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2111.18 VmHWM = 1061.22

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 105616
-rw-r--r-- 1 dune090 dune 44762033 Nov 25 15:32 jobscript.log
-rw-r--r-- 1 dune090 dune     3100 Nov 25 15:32 justin-processed-pfns.txt
-rw-r--r-- 1 dune090 dune 10528281 Nov 25 15:32 pdhd_257340_0_1_20251125T135009Z_beam_hist.root
-rw-r--r-- 1 dune090 dune 44129771 Nov 25 15:32 debug.log
-rw-r--r-- 1 dune090 dune   642154 Nov 25 15:32 pdhd_257340_0_1_20251125T135009Z_beam.root
-rw-r--r-- 1 dune090 dune     1500 Nov 25 14:50 all-input-dids.txt