justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249651.75@dunegpschedd02.fnal.gov

Jobsub ID249651.75@dunegpschedd02.fnal.gov
Workflow ID10513
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 12:07:34
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2025-11-22 14:35:57
From worker nodeHostnamewn2207301.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 12:09:02
Input filesvd-protodune:np02vd_raw_run039305_0209_df-s03-d3_dw_0_20250905T000628.hdf5
vd-protodune:np02vd_raw_run039305_0308_df-s02-d1_dw_0_20250905T032402.hdf5
vd-protodune:np02vd_raw_run039305_0260_df-s05-d2_dw_0_20250905T014856.hdf5
vd-protodune:np02vd_raw_run039305_0510_df-s05-d5_dw_0_20250905T132237.hdf5
vd-protodune:np02vd_raw_run039305_0493_df-s02-d3_dw_0_20250905T124117.hdf5
vd-protodune:np02vd_raw_run039305_0414_df-s02-d1_dw_0_20250905T072831.hdf5
vd-protodune:np02vd_raw_run039305_0108_df-s05-d3_dw_0_20250904T190912.hdf5
vd-protodune:np02vd_raw_run039305_0093_df-s05-d1_dw_0_20250904T182800.hdf5
vd-protodune:np02vd_raw_run039305_0112_df-s05-d4_dw_0_20250904T191739.hdf5
vd-protodune:np02vd_raw_run039305_0451_df-s04-d3_dw_0_20250905T095317.hdf5
vd-protodune:np02vd_raw_run039305_0165_df-s01-d2_dw_0_20250904T220433.hdf5
vd-protodune:np02vd_raw_run039305_0373_df-s02-d2_dw_0_20250905T053924.hdf5
vd-protodune:np02vd_raw_run039305_0248_df-s04-d1_dw_0_20250905T012401.hdf5
vd-protodune:np02vd_raw_run039305_0415_df-s03-d0_dw_0_20250905T073155.hdf5
vd-protodune:np02vd_raw_run039305_0166_df-s01-d2_dw_0_20250904T220806.hdf5
vd-protodune:np02vd_raw_run039305_0258_df-s03-d0_dw_0_20250905T014426.hdf5
vd-protodune:np02vd_raw_run039305_0195_df-s05-d3_dw_0_20250904T233852.hdf5
vd-protodune:np02vd_raw_run039305_0389_df-s05-d4_dw_0_20250905T061222.hdf5
vd-protodune:np02vd_raw_run039305_0290_df-s05-d5_dw_0_20250905T024842.hdf5
vd-protodune:np02vd_raw_run039305_0008_df-s04-d0_dw_0_20250904T143208.hdf5
JobscriptExit code0
Real time2h (8785s)
CPU time2m (176s = 2%)
Max RSS bytes1066422272 (1017 MiB)
Outputting started2025-11-22 14:35:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10513/1/001/pdhd_249651_75_1_20251122T120920Z_beam_hist.root
Finished2025-11-22 14:35:57
Saved logsjustin-logs:249651.75-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Event:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:829
Set event T0: 1.757e+09 2.5528e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:1239
Trigger: 15 1.757e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:852
Setting beam event for matched event

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:853
SetActiveTrigger 15

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:854
Set T0  1.757e+09 2.5528e+08


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:879
beamevt has TOF 78.3184 and TOFChan 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:883
beamevt has Magnet Current 66.4

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:884
beamevt CKov0: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:885
beamevt CKov1: 0 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.757e+09 2.5528e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	0
	0
	0
	524288
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2529
179 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2570
164 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2572


%MSG
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2596
151 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:2631
	0 0 0

%MSG
179 164 151
0.083500000000000004774 0.068500000000000005329 0.055500000000000000722
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:35:26 GMT  run: 39305 subRun: 1 event: 8610 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 78.318359375 13.584656086139332842
22-Nov-2025 14:35:28 GMT  Closed output file "pdhd_249651_75_1_20251122T120920Z_beam.root"
22-Nov-2025 14:35:28 GMT  Closed output file "pdhd_249651_75_1_20251122T120920Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.180054       8.51559       989.06       0.196792       52.5745        951    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.6701e-05    2.96099e-05   0.00026104     2.661e-05    1.70106e-05      951    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0439564     0.0574777      6.08636      0.0463516     0.196117        951    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0221691     0.0235859     0.117023      0.0231205    0.00418241       951    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.110048      0.118867       0.32651      0.114068      0.0143397       951    
produce:beamevent:BeamEvent                      0.000414457     8.31437       988.874     0.00449983      52.5753        951    
[art]:TriggerResults:TriggerResultInserter       1.2573e-05    2.91679e-05   0.000261571   2.5258e-05    1.48022e-05      951    
end_path:out1:RootOutput                          3.657e-06    6.7241e-06    7.6183e-05     5.751e-06    4.93518e-06      951    
end_path:out1:RootOutput(write)                  0.000219703   0.000683744   0.00641078    0.000532068   0.000631841      951    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.180054       8.51559       989.06       0.196792       52.5745        951    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.6701e-05    2.96099e-05   0.00026104     2.661e-05    1.70106e-05      951    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0439564     0.0574777      6.08636      0.0463516     0.196117        951    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0221691     0.0235859     0.117023      0.0231205    0.00418241       951    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.110048      0.118867       0.32651      0.114068      0.0143397       951    
produce:beamevent:BeamEvent                      0.000414457     8.31437       988.874     0.00449983      52.5753        951    
[art]:TriggerResults:TriggerResultInserter       1.2573e-05    2.91679e-05   0.000261571   2.5258e-05    1.48022e-05      951    
end_path:out1:RootOutput                          3.657e-06    6.7241e-06    7.6183e-05     5.751e-06    4.93518e-06      951    
end_path:out1:RootOutput(write)                  0.000219703   0.000683744   0.00641078    0.000532068   0.000631841      951    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2130.21 MB
  Peak resident set size usage (VmHWM): 1066.42 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2130.21 MB
  Peak resident set size usage (VmHWM): 1066.42 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 951 passed = 951 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        951        951          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 166.277190 Real = 8763.169092

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2130.21 VmHWM = 1066.42

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 97080
-rw-r--r-- 1 dune01 dune01 44501484 Nov 22 14:35 jobscript.log
-rw-r--r-- 1 dune01 dune01     3100 Nov 22 14:35 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 10326218 Nov 22 14:35 pdhd_249651_75_1_20251122T120920Z_beam_hist.root
-rw-r--r-- 1 dune01 dune01 43913263 Nov 22 14:35 debug.log
-rw-r--r-- 1 dune01 dune01   634623 Nov 22 14:35 pdhd_249651_75_1_20251122T120920Z_beam.root
-rw-r--r-- 1 dune01 dune01     1500 Nov 22 12:09 all-input-dids.txt
justIN time: 2026-02-08 21:38:15 UTC       justIN version: 01.06.00