justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257668.112@dunegpschedd01.fnal.gov

Jobsub ID257668.112@dunegpschedd01.fnal.gov
Workflow ID10706
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-25 18:58:40
SiteUK_Oxford
EntryDUNE_UK_SGrid_Oxford_arc01
Last heartbeat2025-11-26 14:08:04
From worker nodeHostnamet2wn068.physics.ox.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-25 19:00:22
Input filesvd-protodune:np02vd_raw_run039305_0285_df-s01-d2_dw_0_20250905T023934.hdf5
vd-protodune:np02vd_raw_run039305_0394_df-s01-d2_dw_0_20250905T062552.hdf5
vd-protodune:np02vd_raw_run039305_0501_df-s05-d2_dw_0_20250905T130101.hdf5
vd-protodune:np02vd_raw_run039305_0051_df-s05-d2_dw_0_20250904T162116.hdf5
vd-protodune:np02vd_raw_run039305_0034_df-s04-d3_dw_0_20250904T154324.hdf5
vd-protodune:np02vd_raw_run039305_0456_df-s03-d1_dw_0_20250905T102856.hdf5
vd-protodune:np02vd_raw_run039305_0012_df-s04-d1_dw_0_20250904T144004.hdf5
vd-protodune:np02vd_raw_run039305_0191_df-s05-d2_dw_0_20250904T232831.hdf5
vd-protodune:np02vd_raw_run039305_0217_df-s04-d0_dw_0_20250905T002344.hdf5
vd-protodune:np02vd_raw_run039305_0012_df-s01-d3_dw_0_20250904T144005.hdf5
JobscriptExit code0
Real time19h (68592s)
CPU time4m (273s = 0%)
Max RSS bytes1614319616 (1539 MiB)
Outputting started2025-11-26 14:03:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10706/1/001/pdhd_257668_112_1_20251125T190035Z_beam_hist.root
Finished2025-11-26 14:08:04
Saved logsjustin-logs:257668.112-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:829
Set event T0: 1.757e+09 7.03269e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:1239
Trigger: 67 1.757e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:852
Setting beam event for matched event

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:853
SetActiveTrigger 67

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:854
Set T0  1.757e+09 7.03269e+08


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:879
beamevt has TOF 74.502 and TOFChan 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:883
beamevt has Magnet Current 66.4

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:884
beamevt CKov0: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:885
beamevt CKov1: 0 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.757e+09 7.03269e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	512
	0
	0
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2529
73 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2570
67 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2572


%MSG
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2596
64 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:2631
	0 0 0

%MSG
73 67 64
-0.022499999999999999167 -0.028500000000000001027 -0.031500000000000000222
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 14:03:21 GMT  run: 39305 subRun: 1 event: 12461 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 74.501953125 2.104213533075965703
26-Nov-2025 14:03:23 GMT  Closed output file "pdhd_257668_112_1_20251125T190035Z_beam.root"
26-Nov-2025 14:03:23 GMT  Closed output file "pdhd_257668_112_1_20251125T190035Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.148902       142.233       7250.24       0.2047        866.476        477    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.3475e-05    2.00816e-05   0.000101299   1.8535e-05    7.06359e-06      477    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0365317     0.055163       0.29031      0.0503658     0.0274011       477    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0182662     0.0232965     0.0803509     0.0225207    0.00407527       477    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0905282     0.121798      0.386562      0.114122      0.0332568       477    
produce:beamevent:BeamEvent                      0.000357678     142.032       7250.06     0.00245851      866.471        477    
[art]:TriggerResults:TriggerResultInserter        9.868e-06    1.59011e-05   8.4428e-05    1.4928e-05    5.66002e-06      477    
end_path:out1:RootOutput                          2.575e-06    4.11947e-06   4.7098e-05     3.758e-06    2.77934e-06      477    
end_path:out1:RootOutput(write)                  0.000163546   0.000373492   0.00305848    0.000250067   0.000256114      477    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.148902       142.233       7250.24       0.2047        866.476        477    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.3475e-05    2.00816e-05   0.000101299   1.8535e-05    7.06359e-06      477    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0365317     0.055163       0.29031      0.0503658     0.0274011       477    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0182662     0.0232965     0.0803509     0.0225207    0.00407527       477    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0905282     0.121798      0.386562      0.114122      0.0332568       477    
produce:beamevent:BeamEvent                      0.000357678     142.032       7250.06     0.00245851      866.471        477    
[art]:TriggerResults:TriggerResultInserter        9.868e-06    1.59011e-05   8.4428e-05    1.4928e-05    5.66002e-06      477    
end_path:out1:RootOutput                          2.575e-06    4.11947e-06   4.7098e-05     3.758e-06    2.77934e-06      477    
end_path:out1:RootOutput(write)                  0.000163546   0.000373492   0.00305848    0.000250067   0.000256114      477    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3044.8 MB
  Peak resident set size usage (VmHWM): 1614.32 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3044.8 MB
  Peak resident set size usage (VmHWM): 1614.32 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 477 passed = 477 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        477        477          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 263.308702 Real = 68563.630365

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3044.8 VmHWM = 1614.32

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 4882396
-rw-r--r-- 1 dune020 dune 3322501040 Nov 26 14:03 jobscript.log
-rw-r--r-- 1 dune020 dune       1550 Nov 26 14:03 justin-processed-pfns.txt
-rw-r--r-- 1 dune020 dune    4514967 Nov 26 14:03 pdhd_257668_112_1_20251125T190035Z_beam_hist.root
-rw-r--r-- 1 dune020 dune 1670553107 Nov 26 14:03 debug.log
-rw-r--r-- 1 dune020 dune     362120 Nov 26 14:03 pdhd_257668_112_1_20251125T190035Z_beam.root
-rw-r--r-- 1 dune020 dune        750 Nov 25 19:00 all-input-dids.txt
justIN time: 2026-02-08 12:13:43 UTC       justIN version: 01.06.00