justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255171.53@dunegpschedd01.fnal.gov

Jobsub ID255171.53@dunegpschedd01.fnal.gov
Workflow ID10503
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 00:20:16
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce515
Last heartbeat2025-11-22 14:54:32
From worker nodeHostnameb9p16p5590.cern.ch
cpuinfoIntel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 00:35:46
Input filesvd-protodune:np02vd_raw_run039305_0502_df-s05-d1_dw_0_20250905T130324.hdf5
vd-protodune:np02vd_raw_run039305_0275_df-s02-d1_dw_0_20250905T021913.hdf5
vd-protodune:np02vd_raw_run039305_0110_df-s05-d3_dw_0_20250904T191333.hdf5
vd-protodune:np02vd_raw_run039305_0244_df-s03-d2_dw_0_20250905T011551.hdf5
vd-protodune:np02vd_raw_run039305_0332_df-s03-d1_dw_0_20250905T041229.hdf5
vd-protodune:np02vd_raw_run039305_0124_df-s03-d0_dw_0_20250904T194202.hdf5
vd-protodune:np02vd_raw_run039305_0002_df-s04-d3_dw_0_20250904T141731.hdf5
vd-protodune:np02vd_raw_run039305_0200_df-s02-d2_dw_0_20250904T234842.hdf5
vd-protodune:np02vd_raw_run039305_0243_df-s02-d1_dw_0_20250905T011410.hdf5
vd-protodune:np02vd_raw_run039305_0510_df-s01-d3_dw_0_20250905T132311.hdf5
vd-protodune:np02vd_raw_run039305_0108_df-s05-d3_dw_0_20250904T190912.hdf5
vd-protodune:np02vd_raw_run039305_0119_df-s01-d3_dw_0_20250904T193119.hdf5
vd-protodune:np02vd_raw_run039305_0408_df-s03-d3_dw_0_20250905T070745.hdf5
vd-protodune:np02vd_raw_run039305_0101_df-s04-d0_dw_0_20250904T184335.hdf5
vd-protodune:np02vd_raw_run039305_0228_df-s05-d1_dw_0_20250905T004436.hdf5
vd-protodune:np02vd_raw_run039305_0235_df-s01-d2_dw_0_20250905T005848.hdf5
vd-protodune:np02vd_raw_run039305_0162_df-s01-d3_dw_0_20250904T215308.hdf5
vd-protodune:np02vd_raw_run039305_0498_df-s05-d1_dw_0_20250905T125346.hdf5
vd-protodune:np02vd_raw_run039305_0269_df-s04-d0_dw_0_20250905T020711.hdf5
vd-protodune:np02vd_raw_run039305_0112_df-s05-d4_dw_0_20250904T191739.hdf5
JobscriptExit code0
Real time14h (51360s)
CPU time4m (247s = 0%)
Max RSS bytes2030145536 (1936 MiB)
Outputting started2025-11-22 14:51:52
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10503/1/001/pdhd_255171_53_1_20251122T003603Z_beam_hist.root
Finished2025-11-22 14:54:32
Saved logsjustin-logs:255171.53-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

39305 subRun: 1 event: 107038 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75701e+09 5.22321e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	4096
	0
	0
	0
	0
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2529
12 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2570
162 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2572


%MSG
Got 2 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2596
17 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:2631
	0 0 0

%MSG
12 162 17
-0.083500000000000004774 0.066500000000000003553 -0.078500000000000000333
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: -1 0.18346532455947930917
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107038 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 107058 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107058 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107058 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107058 BeamEvent_module.cc:559
High: 25567912

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107058 BeamEvent_module.cc:560
Low: 2646353486

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107058 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109813348513359438

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 15:51:46 CET  run: 39305 subRun: 1 event: 107058 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109813348513203188
	Candidate: 109813348513359438
	End: 109813348513515688
	Match to Trigger: 1
Found 2 LLT HSI frames.
		LLT -- Timestamp=109813348513359437  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
		LLT -- Timestamp=109813348513376860  TriggerBits=4
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
22-Nov-2025 15:51:47 CET  Closed output file "pdhd_255171_53_1_20251122T003603Z_beam.root"
22-Nov-2025 15:51:47 CET  Closed output file "pdhd_255171_53_1_20251122T003603Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                       0.00277408      53.6346       5028.27       0.01405       381.243        956    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.2976e-05    1.90053e-05   0.000130379   1.83505e-05   6.22265e-06      956    
produce:triggerrawdecoder:PDVDTriggerReader4     0.000613549   0.00617203     0.0818964    0.00467153    0.00727659       956    
produce:timingrawdecoder:PDHDTimingRawDecoder    0.000302958   0.000492527   0.00154093    0.000464768   0.000154816      956    
produce:ctbrawdecoder:PDHDCTBRawDecoder          0.00119888    0.00478801     0.0848478    0.00180163    0.00616536       956    
produce:beamevent:BeamEvent                      0.000259602     53.6225       5028.26     0.00229868      381.243        956    
[art]:TriggerResults:TriggerResultInserter       1.0473e-05    1.58936e-05   0.00012664    1.4875e-05    5.26072e-06      956    
end_path:out1:RootOutput                          3.061e-06    4.04533e-06   2.7364e-05    3.8745e-06    1.3797e-06       956    
end_path:out1:RootOutput(write)                  0.00015675    0.00040448     0.0044014    0.000266828   0.000306813      956    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                       0.00277408      53.6346       5028.27       0.01405       381.243        956    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.2976e-05    1.90053e-05   0.000130379   1.83505e-05   6.22265e-06      956    
produce:triggerrawdecoder:PDVDTriggerReader4     0.000613549   0.00617203     0.0818964    0.00467153    0.00727659       956    
produce:timingrawdecoder:PDHDTimingRawDecoder    0.000302958   0.000492527   0.00154093    0.000464768   0.000154816      956    
produce:ctbrawdecoder:PDHDCTBRawDecoder          0.00119888    0.00478801     0.0848478    0.00180163    0.00616536       956    
produce:beamevent:BeamEvent                      0.000259602     53.6225       5028.26     0.00229868      381.243        956    
[art]:TriggerResults:TriggerResultInserter       1.0473e-05    1.58936e-05   0.00012664    1.4875e-05    5.26072e-06      956    
end_path:out1:RootOutput                          3.061e-06    4.04533e-06   2.7364e-05    3.8745e-06    1.3797e-06       956    
end_path:out1:RootOutput(write)                  0.00015675    0.00040448     0.0044014    0.000266828   0.000306813      956    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3278.19 MB
  Peak resident set size usage (VmHWM): 2030.15 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3278.19 MB
  Peak resident set size usage (VmHWM): 2030.15 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 956 passed = 956 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        956        956          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 240.796795 Real = 51340.518493

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3278.19 VmHWM = 2030.15

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 4227640
-rw-r--r--. 1 duneprd np-comp 2150117962 Nov 22 15:51 jobscript.log
-rw-r--r--. 1 duneprd np-comp       3100 Nov 22 15:51 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp   10271175 Nov 22 15:51 pdhd_255171_53_1_20251122T003603Z_beam_hist.root
-rw-r--r--. 1 duneprd np-comp 1096425855 Nov 22 15:51 debug.log
-rw-r--r--. 1 duneprd np-comp     634182 Nov 22 15:51 pdhd_255171_53_1_20251122T003603Z_beam.root
-rw-r--r--. 1 duneprd np-comp       1500 Nov 22 01:36 all-input-dids.txt
justIN time: 2026-02-08 22:55:41 UTC       justIN version: 01.06.00