justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258741.0@dunegpschedd01.fnal.gov

Jobsub ID258741.0@dunegpschedd01.fnal.gov
Workflow ID10650
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-26 12:44:29
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc03
Last heartbeat2025-11-27 01:51:34
From worker nodeHostnamewn-da-22.gina.surf.nl
cpuinfoAMD EPYC-Rome Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-27 01:29:21
Input filesvd-protodune:np02vd_raw_run039305_0068_df-s03-d1_dw_0_20250904T172449.hdf5
vd-protodune:np02vd_raw_run039305_0300_df-s05-d2_dw_0_20250905T030824.hdf5
vd-protodune:np02vd_raw_run039305_0042_df-s03-d1_dw_0_20250904T160039.hdf5
vd-protodune:np02vd_raw_run039305_0402_df-s05-d0_dw_0_20250905T065045.hdf5
vd-protodune:np02vd_raw_run039305_0297_df-s02-d1_dw_0_20250905T030215.hdf5
vd-protodune:np02vd_raw_run039305_0097_df-s05-d3_dw_0_20250904T183609.hdf5
vd-protodune:np02vd_raw_run039305_0003_df-s03-d2_dw_0_20250904T141928.hdf5
vd-protodune:np02vd_raw_run039305_0172_df-s01-d2_dw_0_20250904T222906.hdf5
vd-protodune:np02vd_raw_run039305_0151_df-s04-d3_dw_0_20250904T210806.hdf5
vd-protodune:np02vd_raw_run039305_0186_df-s01-d3_dw_0_20250904T231758.hdf5
vd-protodune:np02vd_raw_run039305_0132_df-s01-d2_dw_0_20250904T195734.hdf5
vd-protodune:np02vd_raw_run039305_0290_df-s02-d0_dw_0_20250905T024925.hdf5
vd-protodune:np02vd_raw_run039305_0063_df-s02-d3_dw_0_20250904T165743.hdf5
vd-protodune:np02vd_raw_run039305_0096_df-s05-d1_dw_0_20250904T183405.hdf5
vd-protodune:np02vd_raw_run039305_0469_df-s04-d2_dw_0_20250905T111045.hdf5
vd-protodune:np02vd_raw_run039305_0185_df-s04-d3_dw_0_20250904T231537.hdf5
vd-protodune:np02vd_raw_run039305_0003_df-s05-d2_dw_0_20250904T141935.hdf5
JobscriptExit code0
Real time20m (1238s)
CPU time1m (91s = 7%)
Max RSS bytes1138163712 (1085 MiB)
Outputting started2025-11-27 01:50:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10650/1/001/pdhd_258741_0_1_20251127T012941Z_beam_hist.root
Finished2025-11-27 01:51:34
Saved logsjustin-logs:258741.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

amEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:829
Set event T0: 1.757e+09 2.21656e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:1239
Trigger: 94 1.757e+09

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:852
Setting beam event for matched event

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:853
SetActiveTrigger 94

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:854
Set T0  1.757e+09 2.21656e+08


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:879
beamevt has TOF 78.3086 and TOFChan 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:883
beamevt has Magnet Current 66.4

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:884
beamevt CKov0: 0 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:885
beamevt CKov1: 0 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:886
Finished adding info to beamevt 

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:1248
Added 0 tracks to the beam spill

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2492
Doing momentum spectrometry for trigger 1.757e+09 2.21656e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2518
XBPF021655 has 1 active fibers

%MSG
Data: 
	0
	0
	0
	262144
	0
	0
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2529
114 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2531


%MSG
Got 1 Fibers before Fix
After fix: 1
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2568
XBPF021659 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2570
150 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2572


%MSG
Got 1 Fibers before Fix
After Fix 1
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2594
XBPF021660 has 1 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2596
160 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2603
N1,N2,N3 1 1 1

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:2631
	0 0 0

%MSG
114 150 160
0.018499999999999999084 0.054499999999999999833 0.064500000000000001776
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 27-Nov-2025 02:49:58 CET  run: 39305 subRun: 1 event: 3796 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 1

%MSG
Timing trigger: 12
Matched: 1
CKovs: 0 0
TOF, P: 78.30859375 1.9709671140975799641
27-Nov-2025 02:49:59 CET  Closed output file "pdhd_258741_0_1_20251127T012941Z_beam.root"
27-Nov-2025 02:49:59 CET  Closed output file "pdhd_258741_0_1_20251127T012941Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.140752       1.1448        38.8376       0.15481       4.73204        791    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.0711e-05    1.66762e-05   0.000112394    1.59e-05     4.42812e-06      791    
produce:triggerrawdecoder:PDVDTriggerReader4      0.034668      0.0428375     0.261695      0.0390489     0.015277        791    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.017319      0.0189468     0.280855      0.0179508     0.0130394       791    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0863024     0.0954243      0.32862      0.0901414     0.0155694       791    
produce:beamevent:BeamEvent                      0.000279752     0.98695       38.6715     0.00195111      4.73268        791    
[art]:TriggerResults:TriggerResultInserter        8.887e-06    1.21027e-05    4.198e-05    1.1592e-05    2.64645e-06      791    
end_path:out1:RootOutput                          2.896e-06    4.34878e-06   4.7451e-05     4.077e-06    2.33523e-06      791    
end_path:out1:RootOutput(write)                  0.000174823   0.000349038   0.00292618    0.000237814   0.000222497      791    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.140752       1.1448        38.8376       0.15481       4.73204        791    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.0711e-05    1.66762e-05   0.000112394    1.59e-05     4.42812e-06      791    
produce:triggerrawdecoder:PDVDTriggerReader4      0.034668      0.0428375     0.261695      0.0390489     0.015277        791    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.017319      0.0189468     0.280855      0.0179508     0.0130394       791    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0863024     0.0954243      0.32862      0.0901414     0.0155694       791    
produce:beamevent:BeamEvent                      0.000279752     0.98695       38.6715     0.00195111      4.73268        791    
[art]:TriggerResults:TriggerResultInserter        8.887e-06    1.21027e-05    4.198e-05    1.1592e-05    2.64645e-06      791    
end_path:out1:RootOutput                          2.896e-06    4.34878e-06   4.7451e-05     4.077e-06    2.33523e-06      791    
end_path:out1:RootOutput(write)                  0.000174823   0.000349038   0.00292618    0.000237814   0.000222497      791    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2062.06 MB
  Peak resident set size usage (VmHWM): 1138.16 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2062.06 MB
  Peak resident set size usage (VmHWM): 1138.16 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 791 passed = 791 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        791        791          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 82.065082 Real = 1210.214855

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2062.06 VmHWM = 1138.16

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 108404
-rw-r--r--. 1 dune009 dune 35509655 Nov 27 02:49 jobscript.log
-rw-r--r--. 1 dune009 dune     2635 Nov 27 02:49 justin-processed-pfns.txt
-rw-r--r--. 1 dune009 dune  8342274 Nov 27 02:49 pdhd_258741_0_1_20251127T012941Z_beam_hist.root
-rw-r--r--. 1 dune009 dune 35000407 Nov 27 02:49 debug.log
-rw-r--r--. 1 dune009 dune   539598 Nov 27 02:49 pdhd_258741_0_1_20251127T012941Z_beam.root
-rw-r--r--. 1 dune009 dune     1275 Nov 27 02:29 all-input-dids.txt
justIN time: 2025-12-21 03:53:50 UTC       justIN version: 01.05.03