Jobsub ID 258966.140@dunegpschedd01.fnal.gov

Jobsub ID	258966.140@dunegpschedd01.fnal.gov
Workflow ID	10705
Stage ID	1
User name	calcuttj@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-26 19:48:54
Site	ES_PIC
Entry	DUNE_T1_ES_PIC_ce15-multicore
Last heartbeat	2025-11-27 03:20:20
From worker node	Hostname	tds428.pic.es
	cpuinfo	AMD EPYC 7502 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	216000 (60 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-27 02:03:36
Input files	vd-protodune:np02vd_raw_run039305_0269_df-s01-d2_dw_0_20250905T020742.hdf5 vd-protodune:np02vd_raw_run039305_0436_df-s05-d1_dw_0_20250905T085709.hdf5 vd-protodune:np02vd_raw_run039305_0183_df-s03-d1_dw_0_20250904T230757.hdf5 vd-protodune:np02vd_raw_run039305_0084_df-s05-d3_dw_0_20250904T180959.hdf5 vd-protodune:np02vd_raw_run039305_0139_df-s05-d5_dw_0_20250904T201739.hdf5 vd-protodune:np02vd_raw_run039305_0309_df-s03-d0_dw_0_20250905T032608.hdf5 vd-protodune:np02vd_raw_run039305_0321_df-s02-d3_dw_0_20250905T034946.hdf5 vd-protodune:np02vd_raw_run039305_0379_df-s02-d0_dw_0_20250905T055150.hdf5 vd-protodune:np02vd_raw_run039305_0384_df-s02-d3_dw_0_20250905T060140.hdf5 vd-protodune:np02vd_raw_run039305_0120_df-s02-d3_dw_0_20250904T193356.hdf5 vd-protodune:np02vd_raw_run039305_0240_df-s05-d0_dw_0_20250905T010825.hdf5 vd-protodune:np02vd_raw_run039305_0312_df-s05-d5_dw_0_20250905T033205.hdf5 vd-protodune:np02vd_raw_run039305_0379_df-s03-d1_dw_0_20250905T055134.hdf5 vd-protodune:np02vd_raw_run039305_0462_df-s05-d2_dw_0_20250905T104829.hdf5 vd-protodune:np02vd_raw_run039305_0404_df-s02-d0_dw_0_20250905T065639.hdf5
Jobscript	Exit code	0
	Real time	1h (4017s)
	CPU time	1m (111s = 2%)
	Max RSS bytes	1059061760 (1010 MiB)
Outputting started	2025-11-27 03:10:35
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10705/1/001/pdhd_258966_140_1_20251127T020421Z_beam_hist.root
Finished	2025-11-27 03:20:20
Saved logs	justin-logs:258966.140-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75706e+09 8.83734e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	0
	0
	0
	65536
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2529
176 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2570
139 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2572


%MSG
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2596
134 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:2631
	0 0 0

%MSG
176 139 134
0.080500000000000002109 0.043499999999999997002 0.0384999999999999995
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 0 0
TOF, P: -1 1.709463316673251132
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 27-Nov-2025 04:10:31 CET  run: 39305 subRun: 1 event: 385302 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 385322 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:32 CET  run: 39305 subRun: 1 event: 385322 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:32 CET  run: 39305 subRun: 1 event: 385322 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:32 CET  run: 39305 subRun: 1 event: 385322 BeamEvent_module.cc:559
High: 25568524

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:32 CET  run: 39305 subRun: 1 event: 385322 BeamEvent_module.cc:560
Low: 313868334

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:32 CET  run: 39305 subRun: 1 event: 385322 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109815974700859438

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 04:10:32 CET  run: 39305 subRun: 1 event: 385322 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109815974700703188
	Candidate: 109815974700859438
	End: 109815974701015688
	Match to Trigger: 1
Found 1 LLT HSI frames.
		LLT -- Timestamp=109815974700859437  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
27-Nov-2025 04:10:33 CET  Closed output file "pdhd_258966_140_1_20251127T020421Z_beam.root"
27-Nov-2025 04:10:33 CET  Closed output file "pdhd_258966_140_1_20251127T020421Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.238179       4.95332       1077.43      0.259541       52.8772        708    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        1.611e-05    2.32757e-05   0.000194772    2.149e-05    9.50873e-06      708    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0588661     0.0691438     0.155236      0.0641474     0.0133267       708    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0293935     0.0314686     0.0608688     0.0300045    0.00395452       708    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.146647      0.162591      0.446206      0.150942      0.0275805       708    
produce:beamevent:BeamEvent                      0.000415564     4.68914       1077.17     0.00333479      52.8746        708    
[art]:TriggerResults:TriggerResultInserter       1.1671e-05    1.85639e-05   0.000106591   1.7155e-05    6.53364e-06      708    
end_path:out1:RootOutput                           3.1e-06     4.91821e-06    4.691e-05     4.54e-06     3.07666e-06      708    
end_path:out1:RootOutput(write)                  0.000187192   0.000524177   0.00533267    0.000355994   0.000462467      708    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.238179       4.95332       1077.43      0.259541       52.8772        708    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        1.611e-05    2.32757e-05   0.000194772    2.149e-05    9.50873e-06      708    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0588661     0.0691438     0.155236      0.0641474     0.0133267       708    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0293935     0.0314686     0.0608688     0.0300045    0.00395452       708    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.146647      0.162591      0.446206      0.150942      0.0275805       708    
produce:beamevent:BeamEvent                      0.000415564     4.68914       1077.17     0.00333479      52.8746        708    
[art]:TriggerResults:TriggerResultInserter       1.1671e-05    1.85639e-05   0.000106591   1.7155e-05    6.53364e-06      708    
end_path:out1:RootOutput                           3.1e-06     4.91821e-06    4.691e-05     4.54e-06     3.07666e-06      708    
end_path:out1:RootOutput(write)                  0.000187192   0.000524177   0.00533267    0.000355994   0.000462467      708    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2085.08 MB
  Peak resident set size usage (VmHWM): 1083.9 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2085.08 MB
  Peak resident set size usage (VmHWM): 1083.9 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 708 passed = 708 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        708        708          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 102.580549 Real = 3944.315567

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2085.08 VmHWM = 1083.9

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 73648
-rw-r--r-- 1 dune001 dune 33668328 Nov 27 04:10 jobscript.log
-rw-r--r-- 1 dune001 dune     2325 Nov 27 04:10 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune  7998259 Nov 27 04:10 pdhd_258966_140_1_20251127T020421Z_beam_hist.root
-rw-r--r-- 1 dune001 dune 33214671 Nov 27 04:10 debug.log
-rw-r--r-- 1 dune001 dune   502991 Nov 27 04:10 pdhd_258966_140_1_20251127T020421Z_beam.root
-rw-r--r-- 1 dune001 dune     1125 Nov 27 03:04 all-input-dids.txt