justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255327.97@dunegpschedd01.fnal.gov

Jobsub ID255327.97@dunegpschedd01.fnal.gov
Workflow ID10513
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 11:59:34
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2025-11-22 14:38:23
From worker nodeHostnamewn1908251.tier2.hep.manchester.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 12:00:21
Input filesvd-protodune:np02vd_raw_run039305_0145_df-s02-d3_dw_0_20250904T204309.hdf5
vd-protodune:np02vd_raw_run039305_0259_df-s01-d2_dw_0_20250905T014715.hdf5
vd-protodune:np02vd_raw_run039305_0198_df-s02-d2_dw_0_20250904T234452.hdf5
vd-protodune:np02vd_raw_run039305_0398_df-s03-d3_dw_0_20250905T063601.hdf5
vd-protodune:np02vd_raw_run039305_0490_df-s05-d0_dw_0_20250905T123438.hdf5
vd-protodune:np02vd_raw_run039305_0443_df-s04-d3_dw_0_20250905T092125.hdf5
vd-protodune:np02vd_raw_run039305_0358_df-s04-d3_dw_0_20250905T050736.hdf5
vd-protodune:np02vd_raw_run039305_0441_df-s02-d3_dw_0_20250905T091309.hdf5
vd-protodune:np02vd_raw_run039305_0200_df-s02-d1_dw_0_20250904T234829.hdf5
vd-protodune:np02vd_raw_run039305_0066_df-s05-d1_dw_0_20250904T171332.hdf5
vd-protodune:np02vd_raw_run039305_0253_df-s02-d2_dw_0_20250905T013409.hdf5
vd-protodune:np02vd_raw_run039305_0183_df-s05-d2_dw_0_20250904T230823.hdf5
vd-protodune:np02vd_raw_run039305_0507_df-s03-d1_dw_0_20250905T131543.hdf5
vd-protodune:np02vd_raw_run039305_0204_df-s05-d2_dw_0_20250904T235636.hdf5
vd-protodune:np02vd_raw_run039305_0348_df-s01-d3_dw_0_20250905T044715.hdf5
vd-protodune:np02vd_raw_run039305_0382_df-s04-d0_dw_0_20250905T055734.hdf5
vd-protodune:np02vd_raw_run039305_0062_df-s03-d2_dw_0_20250904T164946.hdf5
vd-protodune:np02vd_raw_run039305_0056_df-s05-d1_dw_0_20250904T163304.hdf5
vd-protodune:np02vd_raw_run039305_0365_df-s02-d1_dw_0_20250905T052217.hdf5
vd-protodune:np02vd_raw_run039305_0444_df-s05-d2_dw_0_20250905T092839.hdf5
JobscriptExit code0
Real time2h (9462s)
CPU time1m (90s = 0%)
Max RSS bytes1042911232 (994 MiB)
Outputting started2025-11-22 14:38:04
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10513/1/001/pdhd_255327_97_1_20251122T120035Z_beam_hist.root
Finished2025-11-22 14:38:23
Saved logsjustin-logs:255327.97-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

39305 subRun: 1 event: 421876 BeamEvent_module.cc:829
Set event T0: 1.75706e+09 9.49425e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:1239
Trigger: 65 1.75706e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:852
Setting beam event for matched event

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:853
SetActiveTrigger 65

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:854
Set T0  1.75706e+09 9.49425e+08


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:879
beamevt has TOF 71.5508 and TOFChan 3

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:883
beamevt has Magnet Current 66.4

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:884
beamevt CKov0: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:885
beamevt CKov1: 0 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75706e+09 9.49425e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	0
	0
	131072
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2529
145 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2570
154 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2572


%MSG
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2596
151 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:2631
	0 0 0

%MSG
145 154 151
0.049500000000000002331 0.058500000000000003386 0.055500000000000000722
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:38:02 GMT  run: 39305 subRun: 1 event: 421876 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 71.55078125 2.8770144686157306246
22-Nov-2025 14:38:03 GMT  Closed output file "pdhd_255327_97_1_20251122T120035Z_beam.root"
22-Nov-2025 14:38:03 GMT  Closed output file "pdhd_255327_97_1_20251122T120035Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.170586       9.33838       1974.08      0.181845       102.782        940    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        8.455e-06    1.15873e-05   7.7126e-05    1.1108e-05    3.23089e-06      940    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0424986     0.0496703     0.326056      0.0434833     0.0156153       940    
produce:timingrawdecoder:PDHDTimingRawDecoder      0.02125      0.0223147     0.255145      0.021418      0.0131696       940    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.106077      0.111476      0.187714      0.107274      0.0102923       940    
produce:beamevent:BeamEvent                      0.000184049     9.15423       1973.83     0.00191535      102.78         940    
[art]:TriggerResults:TriggerResultInserter        7.056e-06    1.0212e-05    4.5088e-05     9.882e-06    2.36061e-06      940    
end_path:out1:RootOutput                          1.043e-06    1.99641e-06   1.5569e-05     2.027e-06    8.22979e-07      940    
end_path:out1:RootOutput(write)                  7.4706e-05    0.000534627    0.0967645    0.000174932   0.00427867       940    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.170586       9.33838       1974.08      0.181845       102.782        940    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        8.455e-06    1.15873e-05   7.7126e-05    1.1108e-05    3.23089e-06      940    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0424986     0.0496703     0.326056      0.0434833     0.0156153       940    
produce:timingrawdecoder:PDHDTimingRawDecoder      0.02125      0.0223147     0.255145      0.021418      0.0131696       940    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.106077      0.111476      0.187714      0.107274      0.0102923       940    
produce:beamevent:BeamEvent                      0.000184049     9.15423       1973.83     0.00191535      102.78         940    
[art]:TriggerResults:TriggerResultInserter        7.056e-06    1.0212e-05    4.5088e-05     9.882e-06    2.36061e-06      940    
end_path:out1:RootOutput                          1.043e-06    1.99641e-06   1.5569e-05     2.027e-06    8.22979e-07      940    
end_path:out1:RootOutput(write)                  7.4706e-05    0.000534627    0.0967645    0.000174932   0.00427867       940    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2091.81 MB
  Peak resident set size usage (VmHWM): 1042.91 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2091.81 MB
  Peak resident set size usage (VmHWM): 1042.91 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 940 passed = 940 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        940        940          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 85.160564 Real = 9445.437960

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2091.81 VmHWM = 1042.91

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 91180
-rw-r--r-- 1 dune01 dune01 41916415 Nov 22 14:38 jobscript.log
-rw-r--r-- 1 dune01 dune01     3100 Nov 22 14:38 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01  9459689 Nov 22 14:38 pdhd_255327_97_1_20251122T120035Z_beam_hist.root
-rw-r--r-- 1 dune01 dune01 41333238 Nov 22 14:38 debug.log
-rw-r--r-- 1 dune01 dune01   623674 Nov 22 14:38 pdhd_255327_97_1_20251122T120035Z_beam.root
-rw-r--r-- 1 dune01 dune01     1500 Nov 22 12:00 all-input-dids.txt
justIN time: 2026-02-08 21:40:44 UTC       justIN version: 01.06.00