justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249496.17@dunegpschedd02.fnal.gov

Jobsub ID249496.17@dunegpschedd02.fnal.gov
Workflow ID10502
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 00:20:14
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce508
Last heartbeat2025-11-22 07:26:41
From worker nodeHostnameb9p06p6630.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 00:22:31
Input filesvd-protodune:np02vd_raw_run039324_2927_df-s03-d0_dw_0_20250908T054518.hdf5
vd-protodune:np02vd_raw_run039324_0272_df-s04-d2_dw_0_20250905T212125.hdf5
vd-protodune:np02vd_raw_run039324_0969_df-s04-d2_dw_0_20250906T114050.hdf5
vd-protodune:np02vd_raw_run039324_0318_df-s05-d5_dw_0_20250905T222420.hdf5
vd-protodune:np02vd_raw_run039324_1457_df-s05-d5_dw_0_20250906T212247.hdf5
vd-protodune:np02vd_raw_run039324_1326_df-s05-d1_dw_0_20250906T191158.hdf5
vd-protodune:np02vd_raw_run039324_0383_df-s05-d2_dw_0_20250905T233217.hdf5
vd-protodune:np02vd_raw_run039324_1033_df-s02-d3_dw_0_20250906T124826.hdf5
vd-protodune:np02vd_raw_run039324_1298_df-s04-d0_dw_0_20250906T184339.hdf5
vd-protodune:np02vd_raw_run039324_1379_df-s05-d5_dw_0_20250906T200449.hdf5
vd-protodune:np02vd_raw_run039324_2514_df-s03-d2_dw_0_20250907T210755.hdf5
vd-protodune:np02vd_raw_run039324_1062_df-s05-d4_dw_0_20250906T141455.hdf5
vd-protodune:np02vd_raw_run039324_0031_df-s03-d3_dw_0_20250905T151957.hdf5
vd-protodune:np02vd_raw_run039324_2723_df-s05-d2_dw_0_20250908T011145.hdf5
vd-protodune:np02vd_raw_run039324_2969_df-s01-d3_dw_0_20250908T072408.hdf5
vd-protodune:np02vd_raw_run039324_2874_df-s05-d5_dw_0_20250908T041747.hdf5
vd-protodune:np02vd_raw_run039324_2021_df-s03-d2_dw_0_20250907T110727.hdf5
vd-protodune:np02vd_raw_run039324_0622_df-s01-d3_dw_0_20250906T035934.hdf5
vd-protodune:np02vd_raw_run039324_1414_df-s05-d2_dw_0_20250906T204104.hdf5
vd-protodune:np02vd_raw_run039324_1101_df-s01-d3_dw_0_20250906T145511.hdf5
JobscriptExit code0
Real time7h (25371s)
CPU time1m (97s = 0%)
Max RSS bytes1517867008 (1447 MiB)
Outputting started2025-11-22 07:25:24
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39324/fnal/10502/1/001/pdhd_249496_17_1_20251122T002255Z_beam_hist.root
Finished2025-11-22 07:26:41
Saved logsjustin-logs:249496.17-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

21 BeamEvent_module.cc:829
Set event T0: 1.75717e+09 9.07145e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:1239
Trigger: 37 1.75717e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:852
Setting beam event for matched event

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:853
SetActiveTrigger 37

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:854
Set T0  1.75717e+09 9.07145e+08


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:879
beamevt has TOF 77.4219 and TOFChan 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:883
beamevt has Magnet Current 33.2

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:884
beamevt CKov0: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:885
beamevt CKov1: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75717e+09 9.07145e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	1024
	0
	0
	0
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2529
42 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2570
32 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2572


%MSG
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2596
32 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:2631
	0 0 0

%MSG
42 32 32
-0.053499999999999998945 -0.063500000000000000888 -0.063500000000000000888
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 08:25:22 CET  run: 39324 subRun: 1 event: 576521 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 1
TOF, P: 77.421875 0.92076625694848213133
22-Nov-2025 08:25:22 CET  Closed output file "pdhd_249496_17_1_20251122T002255Z_beam.root"
22-Nov-2025 08:25:22 CET  Closed output file "pdhd_249496_17_1_20251122T002255Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                       0.00293078      48.0745       5082.59      0.022902       323.403        526    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        6.37e-06     1.57711e-05   0.000168013   1.52205e-05   8.22202e-06      526    
produce:triggerrawdecoder:PDVDTriggerReader4     0.00061404    0.00958372     0.107592     0.00814262    0.00942632       526    
produce:timingrawdecoder:PDHDTimingRawDecoder    0.000322685   0.000463404    0.0018862    0.000442762   0.000124031      526    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0012355    0.00793604     0.0519669    0.00487695    0.00799045       526    
produce:beamevent:BeamEvent                      0.000191793     48.056        5082.58     0.00169695      323.405        526    
[art]:TriggerResults:TriggerResultInserter        5.62e-06     1.21924e-05   6.4251e-05     1.138e-05    5.20402e-06      526    
end_path:out1:RootOutput                           8.1e-07     3.93795e-06   3.7001e-05    3.6955e-06    2.74209e-06      526    
end_path:out1:RootOutput(write)                  5.2141e-05    0.000308606   0.00344627    0.000224819   0.000232126      526    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                       0.00293078      48.0745       5082.59      0.022902       323.403        526    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        6.37e-06     1.57711e-05   0.000168013   1.52205e-05   8.22202e-06      526    
produce:triggerrawdecoder:PDVDTriggerReader4     0.00061404    0.00958372     0.107592     0.00814262    0.00942632       526    
produce:timingrawdecoder:PDHDTimingRawDecoder    0.000322685   0.000463404    0.0018862    0.000442762   0.000124031      526    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0012355    0.00793604     0.0519669    0.00487695    0.00799045       526    
produce:beamevent:BeamEvent                      0.000191793     48.056        5082.58     0.00169695      323.405        526    
[art]:TriggerResults:TriggerResultInserter        5.62e-06     1.21924e-05   6.4251e-05     1.138e-05    5.20402e-06      526    
end_path:out1:RootOutput                           8.1e-07     3.93795e-06   3.7001e-05    3.6955e-06    2.74209e-06      526    
end_path:out1:RootOutput(write)                  5.2141e-05    0.000308606   0.00344627    0.000224819   0.000232126      526    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2822.21 MB
  Peak resident set size usage (VmHWM): 1517.87 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2822.21 MB
  Peak resident set size usage (VmHWM): 1517.87 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 526 passed = 526 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        526        526          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 87.397350 Real = 25330.762145

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2822.21 VmHWM = 1517.87

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 1882224
-rw-r--r--. 1 duneprd np-comp 1235333693 Nov 22 08:25 jobscript.log
-rw-r--r--. 1 duneprd np-comp       3100 Nov 22 08:25 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp    6007759 Nov 22 08:25 pdhd_249496_17_1_20251122T002255Z_beam_hist.root
-rw-r--r--. 1 duneprd np-comp  629648887 Nov 22 08:25 debug.log
-rw-r--r--. 1 duneprd np-comp     399182 Nov 22 08:25 pdhd_249496_17_1_20251122T002255Z_beam.root
-rw-r--r--. 1 duneprd np-comp       1500 Nov 22 01:22 all-input-dids.txt
justIN time: 2026-02-08 22:55:37 UTC       justIN version: 01.06.00