justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262052.0@dunegpschedd02.fnal.gov

Jobsub ID262052.0@dunegpschedd02.fnal.gov
Workflow ID11169
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 07:50:22
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 18:09:19
From worker nodeHostnamedunegli-8047072-0-fnpc9021.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 07:52:35
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T031020Z_gen_004722_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time10h (36984s)
CPU time10h (36293s = 98%)
Max RSS bytes2805485568 (2675 MiB)
Outputting started2025-12-13 18:09:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11169/1/001/analysisLowE_20251213T075237Z.root
Finished2025-12-13 18:09:19
Saved logsjustin-logs:262052.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Dec-2025 18:07:40 UTC run: 5027 subRun: 0 event: 47220
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:07:40 UTC run: 5027 subRun: 0 event: 47220
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6634, 6523, 6570
minwire 0: 13
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1319, 1818
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.106988, 
Output 1: 0.0514023, 0.0445545, 0.0825131, 0.82153, 
Output 2: 0.0569572, 0.288116, 0.614465, 0.0404614, 
Output 3: 0.954399, 0.0313451, 0.00576181, 0.00849446, 
Output 4: 0.578249, 0.351284, 0.0631284, 0.00733781, 
Output 5: 0.57736, 0.318756, 0.0874606, 0.0164238, 
Output 6: 0.0197428, 0.0526789, 0.0697992, 0.857779, 

13-Dec-2025 18:07:44 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 18:07:44 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/15/a8/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T031020Z_gen_004722_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2622.08       3645.4        5979.39       3568.69       863.212        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00148533    0.00611331     0.0232242    0.00199934    0.00844974       10     
reco:pandora:StandardPandora                            2619.49       3608.26       5910.27       3529.66       841.553        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000672633    0.0934864     0.191721      0.104473      0.0660468       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00111717    0.00968137     0.0462191    0.00551001     0.0127341       10     
reco:pandoracalo:Calorimetry                          0.00037575    0.00211378     0.0130386    0.000723739   0.00368154       10     
reco:pandorapid:Chi2ParticleID                        0.000122472   0.000636427   0.00456401    0.000200235   0.00131023       10     
reco:cvnmap:CVNMapper                                  0.108608      0.142712      0.167747      0.145682      0.0190046       10     
reco:cvneva:CVNEvaluator                                1.45632       2.3871        7.41432       1.93764       1.70303        10     
reco:energyrecnumu:EnergyReco                          0.0976171      33.9458       72.3634       30.3932       33.9218        10     
reco:energyrecnue:EnergyReco                           0.0022263    0.00356863    0.00648707    0.00311394    0.00126044       10     
reco:energyrecnc:EnergyReco                            0.0109486     0.0125927     0.0164509     0.0120392    0.00157051       10     
[art]:TriggerResults:TriggerResultInserter            3.3543e-05    5.79501e-05   0.000187634   3.9746e-05    4.44277e-05      10     
end_path:out1:RootOutput                               1.069e-05    2.00189e-05   6.8692e-05    1.32745e-05   1.67362e-05      10     
end_path:out1:RootOutput(write)                        0.407459      0.536005      0.948551      0.435422      0.180716        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11912.7 MB
  Peak resident set size usage (VmHWM): 2805.49 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 59.9675 | hit correction : 1.24542
 *** Total Charge : 153.016
 Looking at view: 0 | Number of hits in view: 2
hit initial : 26.3031 | hit correction : 1.24542
hit initial : 76.1766 | hit correction : 1.24542
hit initial : 47.2438 | hit correction : 1.24541
 *** Total Charge : 186.468
 Looking at view: 1 | Number of hits in view: 3
hit initial : 39.3069 | hit correction : 1.24543
hit initial : 113.685 | hit correction : 1.24542
 *** Total Charge : 190.54
 Looking at view: 2 | Number of hits in view: 2
Begin processing the 10th record. run: 5027 subRun: 0 event: 47220 at 13-Dec-2025 18:08:54 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  53
Added hit list length: 53 | Max was set to: -3.40282e+38
This pfp has size:  7
True Neutron Energy: 939.568
True Electron Energy: 28.708
Completed MCParticle Loop
True Neutrino Energy: 34.2343
 Size of all hits: 53
hit initial : 17.1636 | hit correction : 1.09094
hit initial : 32.026 | hit correction : 1.06427
hit initial : 52.8249 | hit correction : 1.06426
hit initial : 239.154 | hit correction : 1.07215
hit initial : 121.65 | hit correction : 1.07227
hit initial : 627.85 | hit correction : 1.07242
hit initial : 53.8554 | hit correction : 1.07288
hit initial : 80.7613 | hit correction : 1.07286
hit initial : 70.3988 | hit correction : 1.08031
hit initial : 67.5829 | hit correction : 1.08029
hit initial : 277.861 | hit correction : 1.08144
hit initial : 73.7377 | hit correction : 1.0814
hit initial : 440.628 | hit correction : 1.08165
hit initial : 153.296 | hit correction : 1.08179
hit initial : 401.958 | hit correction : 1.08176
 *** Total Charge : 2920.18
 Looking at view: 0 | Number of hits in view: 15
hit initial : 28.1711 | hit correction : 1.06426
hit initial : 45.9493 | hit correction : 1.06426
hit initial : 146.339 | hit correction : 1.07217
hit initial : 404.494 | hit correction : 1.07219
hit initial : 304.703 | hit correction : 1.07224
hit initial : 225.164 | hit correction : 1.07242
hit initial : 272.494 | hit correction : 1.07268
hit initial : 258.158 | hit correction : 1.07288
hit initial : 98.3927 | hit correction : 1.07293
hit initial : 46.8267 | hit correction : 1.0803
hit initial : 66.2136 | hit correction : 1.0803
hit initial : 270.141 | hit correction : 1.08148
hit initial : 489.969 | hit correction : 1.0816
hit initial : 361.595 | hit correction : 1.08174
hit initial : 191.437 | hit correction : 1.08179
 *** Total Charge : 3454.97
 Looking at view: 1 | Number of hits in view: 15
hit initial : 25.3326 | hit correction : 1.07267
hit initial : 21.5478 | hit correction : 1.06504
hit initial : 90.5325 | hit correction : 1.06427
hit initial : 239.24 | hit correction : 1.07204
hit initial : 130.415 | hit correction : 1.07231
hit initial : 151.862 | hit correction : 1.07221
hit initial : 119.529 | hit correction : 1.07228
hit initial : 131.578 | hit correction : 1.07221
hit initial : 190.939 | hit correction : 1.07231
hit initial : 175.944 | hit correction : 1.07253
hit initial : 150.549 | hit correction : 1.07268
hit initial : 183.437 | hit correction : 1.07285
hit initial : 230.81 | hit correction : 1.07295
hit initial : 144.129 | hit correction : 1.0803
hit initial : 156.938 | hit correction : 1.0814
hit initial : 309.864 | hit correction : 1.08139
hit initial : 164.26 | hit correction : 1.08163
hit initial : 142.343 | hit correction : 1.08177
hit initial : 137.252 | hit correction : 1.0818
hit initial : 127.449 | hit correction : 1.08178
hit initial : 123.853 | hit correction : 1.08172
hit initial : 159.955 | hit correction : 1.08178
hit initial : 84.3168 | hit correction : 1.08185
 *** Total Charge : 3650.99
 Looking at view: 2 | Number of hits in view: 23
13-Dec-2025 18:08:59 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0847117      0.12395      0.186131      0.121339      0.0250873       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000634856   0.00330408     0.013139     0.000939947   0.00487695       10     
end_path:ana:AnalyzeEvents         0.0833855     0.120351      0.172363      0.118683      0.0224556       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9812.47 MB
  Peak resident set size usage (VmHWM): 1538.78 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:08:57 UTC       justIN version: 01.06.00