justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255317.185@dunegpschedd01.fnal.gov

Jobsub ID255317.185@dunegpschedd01.fnal.gov
Workflow ID10514
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 11:51:36
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2025-11-22 14:22:40
From worker nodeHostnamewn6219291.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 11:52:20
Input filesvd-protodune:np02vd_raw_run039324_1328_df-s04-d1_dw_0_20250906T191339.hdf5
vd-protodune:np02vd_raw_run039324_1207_df-s05-d2_dw_0_20250906T165250.hdf5
vd-protodune:np02vd_raw_run039324_2813_df-s03-d3_dw_0_20250908T024827.hdf5
vd-protodune:np02vd_raw_run039324_2114_df-s03-d3_dw_0_20250907T125925.hdf5
vd-protodune:np02vd_raw_run039324_2377_df-s02-d1_dw_0_20250907T184154.hdf5
vd-protodune:np02vd_raw_run039324_2297_df-s01-d2_dw_0_20250907T171259.hdf5
vd-protodune:np02vd_raw_run039324_1468_df-s04-d2_dw_0_20250906T213741.hdf5
vd-protodune:np02vd_raw_run039324_2376_df-s05-d3_dw_0_20250907T184030.hdf5
vd-protodune:np02vd_raw_run039324_2914_df-s05-d4_dw_0_20250908T052745.hdf5
vd-protodune:np02vd_raw_run039324_1439_df-s05-d0_dw_0_20250906T210629.hdf5
vd-protodune:np02vd_raw_run039324_2586_df-s02-d2_dw_0_20250907T222018.hdf5
vd-protodune:np02vd_raw_run039324_1185_df-s03-d1_dw_0_20250906T162945.hdf5
vd-protodune:np02vd_raw_run039324_2878_df-s03-d3_dw_0_20250908T043709.hdf5
vd-protodune:np02vd_raw_run039324_0865_df-s03-d2_dw_0_20250906T093937.hdf5
vd-protodune:np02vd_raw_run039324_0667_df-s04-d2_dw_0_20250906T044846.hdf5
vd-protodune:np02vd_raw_run039324_1523_df-s05-d1_dw_0_20250906T224254.hdf5
vd-protodune:np02vd_raw_run039324_0926_df-s05-d3_dw_0_20250906T105109.hdf5
vd-protodune:np02vd_raw_run039324_2860_df-s01-d3_dw_0_20250908T033642.hdf5
vd-protodune:np02vd_raw_run039324_2994_df-s04-d3_dw_0_20250908T081527.hdf5
vd-protodune:np02vd_raw_run039324_2071_df-s05-d0_dw_0_20250907T121019.hdf5
JobscriptExit code0
Real time2h (8993s)
CPU time1m (105s = 1%)
Max RSS bytes1027182592 (979 MiB)
Outputting started2025-11-22 14:22:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39324/fnal/10514/1/001/pdhd_255317_185_1_20251122T115238Z_beam_hist.root
Finished2025-11-22 14:22:40
Saved logsjustin-logs:255317.185-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

2:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:1239
Trigger: 6 1.75725e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:852
Setting beam event for matched event

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:853
SetActiveTrigger 6

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:854
Set T0  1.75725e+09 1.63305e+08


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:879
beamevt has TOF 77.0938 and TOFChan 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:883
beamevt has Magnet Current 33.2

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:884
beamevt CKov0: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:885
beamevt CKov1: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75725e+09 1.63305e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	1024
	0
	0
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2529
74 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2570
70 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2572


%MSG
Got 2 Fibers before Fix
After Fix 2
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2594
XBPF021660 has 2 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2596
67 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2596
68 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2603
N1,N2,N3 1 1 2

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:2631
	0 0 0

%MSG
74 70 67
-0.021499999999999998279 -0.025499999999999998362 -0.028000000000000000583
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:22:12 GMT  run: 39324 subRun: 1 event: 1085834 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 1
TOF, P: 77.09375 1.1832768837785039295
22-Nov-2025 14:22:13 GMT  Closed output file "pdhd_255317_185_1_20251122T115238Z_beam.root"
22-Nov-2025 14:22:13 GMT  Closed output file "pdhd_255317_185_1_20251122T115238Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.180689       16.3955       1565.4       0.201574       112.458        518    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.9006e-05    2.55264e-05   0.000197211    2.405e-05    1.03783e-05      518    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0439609     0.055547      0.614836      0.0504687     0.0338639       518    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0221823     0.0235766     0.0670828     0.0230511    0.00378314       518    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.109338      0.122863      0.345985       0.11536      0.0191435       518    
produce:beamevent:BeamEvent                      0.000472758     16.1926       1565.22     0.00386575      112.46         518    
[art]:TriggerResults:TriggerResultInserter       1.2934e-05    1.93208e-05    6.372e-05    1.8094e-05    6.14325e-06      518    
end_path:out1:RootOutput                          3.447e-06    4.82581e-06   3.5837e-05    4.4635e-06    3.12502e-06      518    
end_path:out1:RootOutput(write)                  0.000241223   0.000530287   0.00469928    0.000352402   0.000403388      518    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.180689       16.3955       1565.4       0.201574       112.458        518    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.9006e-05    2.55264e-05   0.000197211    2.405e-05    1.03783e-05      518    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0439609     0.055547      0.614836      0.0504687     0.0338639       518    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0221823     0.0235766     0.0670828     0.0230511    0.00378314       518    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.109338      0.122863      0.345985       0.11536      0.0191435       518    
produce:beamevent:BeamEvent                      0.000472758     16.1926       1565.22     0.00386575      112.46         518    
[art]:TriggerResults:TriggerResultInserter       1.2934e-05    1.93208e-05    6.372e-05    1.8094e-05    6.14325e-06      518    
end_path:out1:RootOutput                          3.447e-06    4.82581e-06   3.5837e-05    4.4635e-06    3.12502e-06      518    
end_path:out1:RootOutput(write)                  0.000241223   0.000530287   0.00469928    0.000352402   0.000403388      518    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1961.19 MB
  Peak resident set size usage (VmHWM): 1027.18 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1961.19 MB
  Peak resident set size usage (VmHWM): 1027.18 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 518 passed = 518 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        518        518          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 95.256051 Real = 8970.700110

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1961.19 VmHWM = 1027.18

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 49068
-rw-r--r-- 1 dune01 dune01 22434797 Nov 22 14:22 jobscript.log
-rw-r--r-- 1 dune01 dune01     3100 Nov 22 14:22 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01  5277681 Nov 22 14:22 pdhd_255317_185_1_20251122T115238Z_beam_hist.root
-rw-r--r-- 1 dune01 dune01 22113431 Nov 22 14:22 debug.log
-rw-r--r-- 1 dune01 dune01   387296 Nov 22 14:22 pdhd_255317_185_1_20251122T115238Z_beam.root
-rw-r--r-- 1 dune01 dune01     1500 Nov 22 11:52 all-input-dids.txt
justIN time: 2026-02-08 21:32:37 UTC       justIN version: 01.06.00