justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249617.13@dunegpschedd02.fnal.gov

Jobsub ID249617.13@dunegpschedd02.fnal.gov
Workflow ID10512
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 11:21:32
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-11-22 14:12:25
From worker nodeHostnamewn1208240.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 11:23:05
Input filesvd-protodune:np02vd_raw_run039324_1753_df-s05-d1_dw_0_20250907T050421.hdf5
vd-protodune:np02vd_raw_run039324_2188_df-s03-d1_dw_0_20250907T141538.hdf5
vd-protodune:np02vd_raw_run039324_1162_df-s05-d5_dw_0_20250906T160434.hdf5
vd-protodune:np02vd_raw_run039324_0419_df-s04-d3_dw_0_20250906T001009.hdf5
vd-protodune:np02vd_raw_run039324_2673_df-s05-d0_dw_0_20250908T001746.hdf5
vd-protodune:np02vd_raw_run039324_1524_df-s04-d1_dw_0_20250906T224355.hdf5
vd-protodune:np02vd_raw_run039324_2458_df-s05-d4_dw_0_20250907T200456.hdf5
vd-protodune:np02vd_raw_run039324_0817_df-s05-d3_dw_0_20250906T084859.hdf5
vd-protodune:np02vd_raw_run039324_1225_df-s04-d1_dw_0_20250906T171202.hdf5
vd-protodune:np02vd_raw_run039324_1274_df-s05-d2_dw_0_20250906T181619.hdf5
vd-protodune:np02vd_raw_run039324_2894_df-s02-d1_dw_0_20250908T050320.hdf5
vd-protodune:np02vd_raw_run039324_2265_df-s02-d2_dw_0_20250907T153421.hdf5
vd-protodune:np02vd_raw_run039324_0185_df-s03-d1_dw_0_20250905T192232.hdf5
vd-protodune:np02vd_raw_run039324_2558_df-s05-d3_dw_0_20250907T215007.hdf5
vd-protodune:np02vd_raw_run039324_0087_df-s05-d0_dw_0_20250905T164706.hdf5
vd-protodune:np02vd_raw_run039324_2601_df-s05-d1_dw_0_20250907T223404.hdf5
vd-protodune:np02vd_raw_run039324_1076_df-s04-d2_dw_0_20250906T142932.hdf5
vd-protodune:np02vd_raw_run039324_2534_df-s05-d1_dw_0_20250907T212606.hdf5
JobscriptExit code0
Real time2h (10127s)
CPU time1m (110s = 1%)
Max RSS bytes1036550144 (988 MiB)
Outputting started2025-11-22 14:11:54
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39324/fnal/10512/1/001/pdhd_249617_13_1_20251122T112327Z_beam_hist.root
Finished2025-11-22 14:12:25
Saved logsjustin-logs:249617.13-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

1328895 BeamEvent_module.cc:829
Set event T0: 1.75728e+09 3.88945e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:1239
Trigger: 33 1.75728e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:852
Setting beam event for matched event

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:853
SetActiveTrigger 33

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:854
Set T0  1.75728e+09 3.88945e+08


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:879
beamevt has TOF 77.5742 and TOFChan 2

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:883
beamevt has Magnet Current 33.2

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:884
beamevt CKov0: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:885
beamevt CKov1: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75728e+09 3.88945e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	65536
	0
	0
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2529
80 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2570
80 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2572


%MSG
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2596
79 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:2631
	0 0 0

%MSG
80 80 79
-0.015499999999999999889 -0.015499999999999999889 -0.016500000000000000777
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:11:51 GMT  run: 39324 subRun: 1 event: 1328895 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 1
TOF, P: 77.57421875 1.0823610311021933938
22-Nov-2025 14:11:52 GMT  Closed output file "pdhd_249617_13_1_20251122T112327Z_beam.root"
22-Nov-2025 14:11:52 GMT  Closed output file "pdhd_249617_13_1_20251122T112327Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.185246       20.6734       2918.79      0.209056       165.02         467    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       2.2643e-05    3.04359e-05   0.000214474   2.7763e-05    1.32482e-05      467    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0444903     0.0545223     0.282642      0.0517546     0.0164458       467    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0225305     0.0240591     0.0755464     0.0236994    0.00363055       467    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.111872      0.127795      0.282373      0.119076      0.0225623       467    
produce:beamevent:BeamEvent                      0.000556287     20.4659       2918.61     0.00457996      165.021        467    
[art]:TriggerResults:TriggerResultInserter       1.5298e-05    2.36617e-05   8.7885e-05    2.2012e-05    8.0797e-06       467    
end_path:out1:RootOutput                          4.077e-06    5.56403e-06   3.6509e-05     5.34e-06     2.08632e-06      467    
end_path:out1:RootOutput(write)                  0.000278374   0.000625649   0.00448749    0.000437784   0.000398643      467    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.185246       20.6734       2918.79      0.209056       165.02         467    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       2.2643e-05    3.04359e-05   0.000214474   2.7763e-05    1.32482e-05      467    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0444903     0.0545223     0.282642      0.0517546     0.0164458       467    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0225305     0.0240591     0.0755464     0.0236994    0.00363055       467    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.111872      0.127795      0.282373      0.119076      0.0225623       467    
produce:beamevent:BeamEvent                      0.000556287     20.4659       2918.61     0.00457996      165.021        467    
[art]:TriggerResults:TriggerResultInserter       1.5298e-05    2.36617e-05   8.7885e-05    2.2012e-05    8.0797e-06       467    
end_path:out1:RootOutput                          4.077e-06    5.56403e-06   3.6509e-05     5.34e-06     2.08632e-06      467    
end_path:out1:RootOutput(write)                  0.000278374   0.000625649   0.00448749    0.000437784   0.000398643      467    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1955.09 MB
  Peak resident set size usage (VmHWM): 1036.55 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1955.09 MB
  Peak resident set size usage (VmHWM): 1036.55 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 467 passed = 467 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        467        467          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 99.708792 Real = 10101.317931

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1955.09 VmHWM = 1036.55

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 47420
-rw-r--r-- 1 dune01 dune01 21617313 Nov 22 14:11 jobscript.log
-rw-r--r-- 1 dune01 dune01     2790 Nov 22 14:11 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01  5245278 Nov 22 14:11 pdhd_249617_13_1_20251122T112327Z_beam_hist.root
-rw-r--r-- 1 dune01 dune01 21318717 Nov 22 14:11 debug.log
-rw-r--r-- 1 dune01 dune01   347851 Nov 22 14:11 pdhd_249617_13_1_20251122T112327Z_beam.root
-rw-r--r-- 1 dune01 dune01     1350 Nov 22 11:23 all-input-dids.txt
justIN time: 2026-02-08 21:39:37 UTC       justIN version: 01.06.00