justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 251960.1@dunegpschedd02.fnal.gov

Jobsub ID251960.1@dunegpschedd02.fnal.gov
Workflow ID10706
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-25 18:18:41
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce510
Last heartbeat2025-11-26 08:50:53
From worker nodeHostnameb9p12p9960.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-25 18:20:45
Input filesvd-protodune:np02vd_raw_run039305_0153_df-s05-d2_dw_0_20250904T211740.hdf5
vd-protodune:np02vd_raw_run039305_0357_df-s05-d3_dw_0_20250905T050600.hdf5
vd-protodune:np02vd_raw_run039305_0358_df-s03-d0_dw_0_20250905T050726.hdf5
vd-protodune:np02vd_raw_run039305_0074_df-s05-d1_dw_0_20250904T174500.hdf5
vd-protodune:np02vd_raw_run039305_0202_df-s03-d1_dw_0_20250904T235234.hdf5
vd-protodune:np02vd_raw_run039305_0143_df-s05-d2_dw_0_20250904T203357.hdf5
vd-protodune:np02vd_raw_run039305_0354_df-s03-d2_dw_0_20250905T045901.hdf5
vd-protodune:np02vd_raw_run039305_0369_df-s03-d1_dw_0_20250905T053030.hdf5
vd-protodune:np02vd_raw_run039305_0293_df-s03-d0_dw_0_20250905T025437.hdf5
vd-protodune:np02vd_raw_run039305_0328_df-s02-d3_dw_0_20250905T040420.hdf5
vd-protodune:np02vd_raw_run039305_0168_df-s05-d3_dw_0_20250904T221524.hdf5
vd-protodune:np02vd_raw_run039305_0478_df-s01-d2_dw_0_20250905T114208.hdf5
vd-protodune:np02vd_raw_run039305_0113_df-s05-d0_dw_0_20250904T191921.hdf5
vd-protodune:np02vd_raw_run039305_0355_df-s04-d0_dw_0_20250905T050127.hdf5
JobscriptExit code0
Real time14h (52060s)
CPU time3m (183s = 0%)
Max RSS bytes1155440640 (1101 MiB)
Outputting started2025-11-26 08:48:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10706/1/001/pdhd_251960_1_1_20251125T182102Z_beam_hist.root
Finished2025-11-26 08:50:53
Saved logsjustin-logs:251960.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
69 diff: -1.31165

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
70 diff: -1.52932

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
71 diff: -1.56327

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
72 diff: -1.62093

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
73 diff: -1.63102

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
74 diff: -1.692

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
75 diff: -1.80042

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
76 diff: -1.82213

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
77 diff: -1.82738

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
78 diff: -1.83837

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
79 diff: -1.94493

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
80 diff: -1.9628

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
81 diff: -1.98257

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
82 diff: -2.10768

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
83 diff: -2.2592

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
84 diff: -2.29144

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
85 diff: -2.4576

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
86 diff: -2.48075

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
87 diff: -2.51642

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
88 diff: -2.64843

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
89 diff: -2.7224

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
90 diff: -2.7363

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
91 diff: -2.80031

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
92 diff: -2.82774

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
93 diff: -2.84939

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:817
94 diff: -2.93759

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 26-Nov-2025 09:48:24 CET  run: 39305 subRun: 1 event: 338450 BeamEvent_module.cc:836
Could not find matching time 

%MSG
Timing trigger: 12
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
26-Nov-2025 09:48:25 CET  Closed output file "pdhd_251960_1_1_20251125T182102Z_beam.root"
26-Nov-2025 09:48:25 CET  Closed output file "pdhd_251960_1_1_20251125T182102Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                       0.00400591      78.8917       3653.75      0.0155948      414.01         659    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                         7.4e-06      1.772e-05    0.000118462    1.678e-05    7.06717e-06      659    
produce:triggerrawdecoder:PDVDTriggerReader4     0.000680621    0.0070214     0.0790125    0.00524226    0.00791891       659    
produce:timingrawdecoder:PDHDTimingRawDecoder    0.000342136   0.000496757   0.00325106    0.000467897   0.000156492      659    
produce:ctbrawdecoder:PDHDCTBRawDecoder          0.00141794    0.00533574     0.0647247    0.00202868    0.00660654       659    
produce:beamevent:BeamEvent                      0.000232053     78.8782       3653.74     0.00225178      414.01         659    
[art]:TriggerResults:TriggerResultInserter        6.29e-06     1.38921e-05   7.3381e-05     1.256e-05    5.56773e-06      659    
end_path:out1:RootOutput                           9.2e-07     3.74404e-06   2.9931e-05     3.56e-06     1.9586e-06       659    
end_path:out1:RootOutput(write)                  8.6181e-05    0.000379548   0.00387022    0.000279734   0.000268878      659    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                       0.00400591      78.8917       3653.75      0.0155948      414.01         659    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                         7.4e-06      1.772e-05    0.000118462    1.678e-05    7.06717e-06      659    
produce:triggerrawdecoder:PDVDTriggerReader4     0.000680621    0.0070214     0.0790125    0.00524226    0.00791891       659    
produce:timingrawdecoder:PDHDTimingRawDecoder    0.000342136   0.000496757   0.00325106    0.000467897   0.000156492      659    
produce:ctbrawdecoder:PDHDCTBRawDecoder          0.00141794    0.00533574     0.0647247    0.00202868    0.00660654       659    
produce:beamevent:BeamEvent                      0.000232053     78.8782       3653.74     0.00225178      414.01         659    
[art]:TriggerResults:TriggerResultInserter        6.29e-06     1.38921e-05   7.3381e-05     1.256e-05    5.56773e-06      659    
end_path:out1:RootOutput                           9.2e-07     3.74404e-06   2.9931e-05     3.56e-06     1.9586e-06       659    
end_path:out1:RootOutput(write)                  8.6181e-05    0.000379548   0.00387022    0.000279734   0.000268878      659    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2331.62 MB
  Peak resident set size usage (VmHWM): 1155.44 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2331.62 MB
  Peak resident set size usage (VmHWM): 1155.44 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 659 passed = 659 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        659        659          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 173.448132 Real = 52036.805190

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2331.62 VmHWM = 1155.44

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 3420344
-rw-r--r--. 1 duneprd np-comp 2141410529 Nov 26 09:48 jobscript.log
-rw-r--r--. 1 duneprd np-comp       2170 Nov 26 09:48 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp    6968691 Nov 26 09:48 pdhd_251960_1_1_20251125T182102Z_beam_hist.root
-rw-r--r--. 1 duneprd np-comp 1085344531 Nov 26 09:48 debug.log
-rw-r--r--. 1 duneprd np-comp     467679 Nov 26 09:48 pdhd_251960_1_1_20251125T182102Z_beam.root
-rw-r--r--. 1 duneprd np-comp       1050 Nov 25 19:21 all-input-dids.txt
justIN time: 2026-02-08 12:14:30 UTC       justIN version: 01.06.00