justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249618.14@dunegpschedd02.fnal.gov

Jobsub ID249618.14@dunegpschedd02.fnal.gov
Workflow ID10515
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 11:27:33
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-11-22 14:33:04
From worker nodeHostnamewn2207290.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 11:28:18
Input filesvd-protodune:np02vd_raw_run039305_0070_df-s04-d3_dw_0_20250904T173359.hdf5
vd-protodune:np02vd_raw_run039305_0186_df-s02-d2_dw_0_20250904T231828.hdf5
vd-protodune:np02vd_raw_run039305_0471_df-s02-d0_dw_0_20250905T111754.hdf5
vd-protodune:np02vd_raw_run039305_0441_df-s02-d3_dw_0_20250905T091309.hdf5
vd-protodune:np02vd_raw_run039305_0351_df-s04-d1_dw_0_20250905T045302.hdf5
vd-protodune:np02vd_raw_run039305_0154_df-s02-d1_dw_0_20250904T212247.hdf5
vd-protodune:np02vd_raw_run039305_0320_df-s05-d1_dw_0_20250905T034757.hdf5
vd-protodune:np02vd_raw_run039305_0068_df-s04-d1_dw_0_20250904T172448.hdf5
vd-protodune:np02vd_raw_run039305_0102_df-s04-d2_dw_0_20250904T184838.hdf5
vd-protodune:np02vd_raw_run039305_0238_df-s04-d2_dw_0_20250905T010417.hdf5
vd-protodune:np02vd_raw_run039305_0263_df-s03-d2_dw_0_20250905T015429.hdf5
vd-protodune:np02vd_raw_run039305_0507_df-s03-d1_dw_0_20250905T131543.hdf5
vd-protodune:np02vd_raw_run039305_0397_df-s05-d0_dw_0_20250905T063447.hdf5
vd-protodune:np02vd_raw_run039305_0068_df-s03-d0_dw_0_20250904T172527.hdf5
vd-protodune:np02vd_raw_run039305_0421_df-s01-d3_dw_0_20250905T075141.hdf5
vd-protodune:np02vd_raw_run039305_0230_df-s04-d2_dw_0_20250905T004841.hdf5
vd-protodune:np02vd_raw_run039305_0251_df-s04-d0_dw_0_20250905T013026.hdf5
vd-protodune:np02vd_raw_run039305_0485_df-s03-d2_dw_0_20250905T122106.hdf5
vd-protodune:np02vd_raw_run039305_0258_df-s03-d3_dw_0_20250905T014408.hdf5
vd-protodune:np02vd_raw_run039305_0502_df-s03-d2_dw_0_20250905T130325.hdf5
JobscriptExit code0
Real time3h (11058s)
CPU time2m (152s = 1%)
Max RSS bytes1056083968 (1007 MiB)
Outputting started2025-11-22 14:32:37
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10515/1/001/pdhd_249618_14_1_20251122T112836Z_beam_hist.root
Finished2025-11-22 14:33:04
Saved logsjustin-logs:249618.14-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:817
6 diff: 0.264184

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:817
7 diff: 0.0295961

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:817
8 diff: -7.15256e-07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:827
FOUND MATCHING TIME!!!

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:828
diff: -7.15256e-07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:829
Set event T0: 1.75708e+09 4.00647e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:1239
Trigger: 8 1.75708e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:852
Setting beam event for matched event

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:853
SetActiveTrigger 8

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:854
Set T0  1.75708e+09 4.00647e+08


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:879
beamevt has TOF 75.4023 and TOFChan 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:883
beamevt has Magnet Current 66.4

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:884
beamevt CKov0: 1 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:885
beamevt CKov1: 0 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.75708e+09 4.00647e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	1048576
	0
	0
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:2529
84 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:2570
88 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:2572


%MSG
Got 0 Fibers before Fix
After Fix 0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:2589
Warning, at least one empty Beam Profiler. Not checking momentum

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:32:34 GMT  run: 39305 subRun: 1 event: 475348 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 0

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 75.40234375 -1
22-Nov-2025 14:32:35 GMT  Closed output file "pdhd_249618_14_1_20251122T112836Z_beam.root"
22-Nov-2025 14:32:35 GMT  Closed output file "pdhd_249618_14_1_20251122T112836Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.180961       11.0328       1650.28      0.195409       80.6141        938    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.4798e-05    2.6841e-05    0.000192542   2.3644e-05    1.07979e-05      938    
produce:triggerrawdecoder:PDVDTriggerReader4       0.04411      0.053053      0.439685      0.0468698     0.0229686       938    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0222906     0.0237195     0.270108      0.0231258    0.00860264       938    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.110592       0.11919      0.367907      0.113751      0.0197021       938    
produce:beamevent:BeamEvent                      0.000448824     10.8357       1650.09      0.0041184      80.6144        938    
[art]:TriggerResults:TriggerResultInserter       1.2805e-05    2.46191e-05   0.00024491    2.1235e-05    1.27597e-05      938    
end_path:out1:RootOutput                          3.857e-06    6.33514e-06   0.000208261    5.36e-06     7.96314e-06      938    
end_path:out1:RootOutput(write)                  0.000190999   0.000584403   0.00706521    0.000433766   0.00061044       938    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.180961       11.0328       1650.28      0.195409       80.6141        938    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.4798e-05    2.6841e-05    0.000192542   2.3644e-05    1.07979e-05      938    
produce:triggerrawdecoder:PDVDTriggerReader4       0.04411      0.053053      0.439685      0.0468698     0.0229686       938    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0222906     0.0237195     0.270108      0.0231258    0.00860264       938    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.110592       0.11919      0.367907      0.113751      0.0197021       938    
produce:beamevent:BeamEvent                      0.000448824     10.8357       1650.09      0.0041184      80.6144        938    
[art]:TriggerResults:TriggerResultInserter       1.2805e-05    2.46191e-05   0.00024491    2.1235e-05    1.27597e-05      938    
end_path:out1:RootOutput                          3.857e-06    6.33514e-06   0.000208261    5.36e-06     7.96314e-06      938    
end_path:out1:RootOutput(write)                  0.000190999   0.000584403   0.00706521    0.000433766   0.00061044       938    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2126.99 MB
  Peak resident set size usage (VmHWM): 1056.08 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2126.99 MB
  Peak resident set size usage (VmHWM): 1056.08 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 938 passed = 938 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        938        938          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 143.124827 Real = 11035.024289

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2126.99 VmHWM = 1056.08

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 93044
-rw-r--r-- 1 dune01 dune01 42781437 Nov 22 14:32 jobscript.log
-rw-r--r-- 1 dune01 dune01     3100 Nov 22 14:32 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01  9646208 Nov 22 14:32 pdhd_249618_14_1_20251122T112836Z_beam_hist.root
-rw-r--r-- 1 dune01 dune01 42195022 Nov 22 14:32 debug.log
-rw-r--r-- 1 dune01 dune01   620112 Nov 22 14:32 pdhd_249618_14_1_20251122T112836Z_beam.root
-rw-r--r-- 1 dune01 dune01     1500 Nov 22 11:28 all-input-dids.txt
justIN time: 2026-02-08 21:39:23 UTC       justIN version: 01.06.00