justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255168.4@dunegpschedd01.fnal.gov

Jobsub ID255168.4@dunegpschedd01.fnal.gov
Workflow ID10500
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-21 23:58:00
SiteUK_Oxford
EntryDUNE_UK_SGrid_Oxford_arc01
Last heartbeat2025-11-22 03:20:03
From worker nodeHostnamet2wn176.physics.ox.ac.uk
cpuinfoAMD EPYC 9655 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-21 23:59:45
Input filesvd-protodune:np02vd_raw_run039324_2679_df-s01-d2_dw_0_20250908T002020.hdf5
vd-protodune:np02vd_raw_run039324_0345_df-s03-d3_dw_0_20250905T225307.hdf5
vd-protodune:np02vd_raw_run039324_1323_df-s02-d2_dw_0_20250906T190814.hdf5
vd-protodune:np02vd_raw_run039324_2448_df-s05-d3_dw_0_20250907T195550.hdf5
vd-protodune:np02vd_raw_run039324_1819_df-s05-d0_dw_0_20250907T062001.hdf5
vd-protodune:np02vd_raw_run039324_1413_df-s01-d3_dw_0_20250906T203910.hdf5
vd-protodune:np02vd_raw_run039324_2213_df-s04-d3_dw_0_20250907T143953.hdf5
vd-protodune:np02vd_raw_run039324_0723_df-s05-d3_dw_0_20250906T063747.hdf5
vd-protodune:np02vd_raw_run039324_1015_df-s03-d0_dw_0_20250906T123004.hdf5
vd-protodune:np02vd_raw_run039324_0088_df-s05-d1_dw_0_20250905T164951.hdf5
vd-protodune:np02vd_raw_run039324_2022_df-s05-d0_dw_0_20250907T110809.hdf5
vd-protodune:np02vd_raw_run039324_2625_df-s05-d4_dw_0_20250907T231204.hdf5
vd-protodune:np02vd_raw_run039324_2714_df-s03-d0_dw_0_20250908T010417.hdf5
vd-protodune:np02vd_raw_run039324_0129_df-s05-d1_dw_0_20250905T180631.hdf5
vd-protodune:np02vd_raw_run039324_0179_df-s03-d2_dw_0_20250905T191458.hdf5
vd-protodune:np02vd_raw_run039324_1794_df-s05-d4_dw_0_20250907T054816.hdf5
vd-protodune:np02vd_raw_run039324_1226_df-s05-d4_dw_0_20250906T171230.hdf5
vd-protodune:np02vd_raw_run039324_1788_df-s05-d3_dw_0_20250907T054229.hdf5
vd-protodune:np02vd_raw_run039324_1402_df-s02-d0_dw_0_20250906T202752.hdf5
vd-protodune:np02vd_raw_run039324_2892_df-s03-d2_dw_0_20250908T050401.hdf5
JobscriptExit code0
Real time3h (11968s)
CPU time1m (69s = 0%)
Max RSS bytes996892672 (950 MiB)
Outputting started2025-11-22 03:19:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39324/fnal/10500/1/001/pdhd_255168_4_1_20251122T000029Z_beam_hist.root
Finished2025-11-22 03:20:03
Saved logsjustin-logs:255168.4-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:1180
acqTime: 1.75731e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:1181
NXBPF: 67

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:1196
SpillOffset 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:807
Matching in time between Beamline and TPC!!!

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:817
0 diff: 0.15038

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:817
1 diff: 0.1485

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:817
2 diff: -7.15256e-07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:827
FOUND MATCHING TIME!!!

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:828
diff: -7.15256e-07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:829
Set event T0: 1.75731e+09 1.53123e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:1239
Trigger: 2 1.75731e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:852
Setting beam event for matched event

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:853
SetActiveTrigger 2

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:854
Set T0  1.75731e+09 1.53123e+07


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:879
beamevt has TOF 75.5547 and TOFChan 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:883
beamevt has Magnet Current 33.2

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:884
beamevt CKov0: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:885
beamevt CKov1: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75731e+09 1.53123e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:2518
XBPF021655 has 0 active fibers

%MSG
Data: 
	0
	0
	0
	0
	0
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:2531


%MSG
Got 0 Fibers before Fix
After fix: 0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:2545
Warning, at least one empty Beam Profiler. Not checking momentum

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 03:19:12 GMT  run: 39324 subRun: 1 event: 1517688 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 0

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 1
TOF, P: 75.5546875 -1
22-Nov-2025 03:19:13 GMT  Closed output file "pdhd_255168_4_1_20251122T000029Z_beam.root"
22-Nov-2025 03:19:13 GMT  Closed output file "pdhd_255168_4_1_20251122T000029Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.147247       22.4602       1498.12      0.172527       122.061        519    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.6065e-05    2.32209e-05   0.000128575   2.1984e-05    6.79526e-06      519    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0360979     0.0462945      0.14844      0.0437297     0.0117439       519    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0180219     0.0209669     0.269335      0.0188556     0.0158493       519    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0896949     0.106878      0.394773      0.101405      0.027853        519    
produce:beamevent:BeamEvent                      0.000379114     22.2852       1497.97     0.00170092      122.061        519    
[art]:TriggerResults:TriggerResultInserter       1.1828e-05    1.90578e-05   9.7558e-05    1.6635e-05    7.60671e-06      519    
end_path:out1:RootOutput                          3.385e-06    4.58032e-06   3.3661e-05     4.326e-06    1.87703e-06      519    
end_path:out1:RootOutput(write)                  0.00019149    0.000413452   0.00263658    0.000309769   0.000233823      519    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.147247       22.4602       1498.12      0.172527       122.061        519    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.6065e-05    2.32209e-05   0.000128575   2.1984e-05    6.79526e-06      519    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0360979     0.0462945      0.14844      0.0437297     0.0117439       519    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0180219     0.0209669     0.269335      0.0188556     0.0158493       519    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0896949     0.106878      0.394773      0.101405      0.027853        519    
produce:beamevent:BeamEvent                      0.000379114     22.2852       1497.97     0.00170092      122.061        519    
[art]:TriggerResults:TriggerResultInserter       1.1828e-05    1.90578e-05   9.7558e-05    1.6635e-05    7.60671e-06      519    
end_path:out1:RootOutput                          3.385e-06    4.58032e-06   3.3661e-05     4.326e-06    1.87703e-06      519    
end_path:out1:RootOutput(write)                  0.00019149    0.000413452   0.00263658    0.000309769   0.000233823      519    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2036.56 MB
  Peak resident set size usage (VmHWM): 996.893 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2036.56 MB
  Peak resident set size usage (VmHWM): 996.893 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 519 passed = 519 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        519        519          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 64.030956 Real = 11911.113565

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2036.56 VmHWM = 996.893

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 53836
-rw-r--r-- 1 dune020 dune 23287252 Nov 22 03:19 jobscript.log
-rw-r--r-- 1 dune020 dune     3100 Nov 22 03:19 justin-processed-pfns.txt
-rw-r--r-- 1 dune020 dune  5556128 Nov 22 03:19 pdhd_255168_4_1_20251122T000029Z_beam_hist.root
-rw-r--r-- 1 dune020 dune 22945525 Nov 22 03:19 debug.log
-rw-r--r-- 1 dune020 dune   386576 Nov 22 03:19 pdhd_255168_4_1_20251122T000029Z_beam.root
-rw-r--r-- 1 dune020 dune     1500 Nov 22 00:00 all-input-dids.txt
justIN time: 2026-02-08 22:55:42 UTC       justIN version: 01.06.00