justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261339.1@dunegpschedd02.fnal.gov

Jobsub ID261339.1@dunegpschedd02.fnal.gov
Workflow ID11113
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 23:12:42
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 03:07:59
From worker nodeHostnamedunegli-7878613-0-fnpc19122.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 23:13:14
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T202120Z_gen_002765_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (14071s)
CPU time3h (13967s = 99%)
Max RSS bytes2934808576 (2798 MiB)
Outputting started2025-12-12 03:07:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11113/1/001/analysisLowE_20251211T231314Z.root
Finished2025-12-12 03:07:59
Saved logsjustin-logs:261339.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

howerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 03:07:04 UTC run: 5026 subRun: 0 event: 27650
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 03:07:04 UTC run: 5026 subRun: 0 event: 27650
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6783, 6697, 6688
minwire 0: 24
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.160709, 
Output 1: 0.0809805, 0.0631584, 0.131479, 0.724382, 
Output 2: 0.118746, 0.223392, 0.596707, 0.0611556, 
Output 3: 0.975676, 0.0101487, 0.00228708, 0.0118884, 
Output 4: 0.562506, 0.410095, 0.0246086, 0.0027902, 
Output 5: 0.33449, 0.515982, 0.120718, 0.0288101, 
Output 6: 0.0381424, 0.0800786, 0.0838769, 0.797902, 

12-Dec-2025 03:07:05 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:07:05 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/b9/cf/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T202120Z_gen_002765_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1365.1        1393.75       1490.15       1382.2        34.5261        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00106784    0.00421485     0.0156859    0.00341113    0.00392627       10     
reco:pandora:StandardPandora                            1363.88       1392.39       1488.95       1380.97       34.5359        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000496404    0.0127347     0.0580694    0.00398902     0.0175375       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000280472   0.00350898     0.0122499    0.00243593    0.00335242       10     
reco:pandoracalo:Calorimetry                          0.000250892   0.00770119     0.0320388    0.00412112     0.0102427       10     
reco:pandorapid:Chi2ParticleID                         4.831e-05     0.0001784    0.000957017   7.29955e-05   0.000268362      10     
reco:cvnmap:CVNMapper                                  0.0226635     0.0252505     0.0357722     0.0244389    0.00365953       10     
reco:cvneva:CVNEvaluator                               0.797859      0.944184       2.14926      0.810112      0.401761        10     
reco:energyrecnumu:EnergyReco                         0.00448638     0.0514203     0.0809334     0.0630874     0.0270087       10     
reco:energyrecnue:EnergyReco                          0.000867965   0.00392246    0.00729264     0.0038725    0.00291118       10     
reco:energyrecnc:EnergyReco                           0.00637412     0.0307941     0.0944392     0.0067212     0.0370191       10     
[art]:TriggerResults:TriggerResultInserter             1.131e-05    1.8884e-05     7.081e-05     1.286e-05    1.73626e-05      10     
end_path:out1:RootOutput                               5.77e-06      9.033e-06     2.296e-05     6.94e-06     5.2319e-06       10     
end_path:out1:RootOutput(write)                        0.267906      0.276929      0.299539      0.272494      0.009692        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21684.5 MB
  Peak resident set size usage (VmHWM): 2934.81 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 78.0854 | hit correction : 1.30133
hit initial : 157.395 | hit correction : 1.30343
hit initial : 402.37 | hit correction : 1.30321
hit initial : 532.089 | hit correction : 1.30267
hit initial : 111.958 | hit correction : 1.30252
hit initial : 234.111 | hit correction : 1.30093
hit initial : 261.09 | hit correction : 1.30036
hit initial : 134.697 | hit correction : 1.29988
 *** Total Charge : 3779.19
 Looking at view: 0 | Number of hits in view: 19
hit initial : 723.12 | hit correction : 1.29974
hit initial : 81.6621 | hit correction : 1.30027
hit initial : 185.038 | hit correction : 1.30258
hit initial : 217.575 | hit correction : 1.30322
hit initial : 531.626 | hit correction : 1.30293
hit initial : 67.3412 | hit correction : 1.30127
hit initial : 101.891 | hit correction : 1.30117
hit initial : 64.3301 | hit correction : 1.30022
 *** Total Charge : 2567.14
 Looking at view: 1 | Number of hits in view: 8
hit initial : 119.013 | hit correction : 1.29808
hit initial : 194.35 | hit correction : 1.29879
hit initial : 250.606 | hit correction : 1.29766
hit initial : 230.143 | hit correction : 1.29942
hit initial : 292.863 | hit correction : 1.29673
hit initial : 205.696 | hit correction : 1.29645
hit initial : 41.6003 | hit correction : 1.30548
hit initial : 50.0553 | hit correction : 1.30358
hit initial : 357.083 | hit correction : 1.30341
hit initial : 574.019 | hit correction : 1.3028
hit initial : 302.208 | hit correction : 1.30251
hit initial : 179.58 | hit correction : 1.30191
hit initial : 168.762 | hit correction : 1.30149
hit initial : 199.659 | hit correction : 1.30115
hit initial : 161.465 | hit correction : 1.30083
hit initial : 189.981 | hit correction : 1.30045
hit initial : 205.411 | hit correction : 1.30005
 *** Total Charge : 4841.42
 Looking at view: 2 | Number of hits in view: 17
Begin processing the 10th record. run: 5026 subRun: 0 event: 27650 at 12-Dec-2025 03:07:42 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  22
Added hit list length: 22 | Max was set to: -3.40282e+38
This pfp has size:  25
Added hit list length: 25 | Max was set to: 22
True Neutron Energy: 939.568
True Electron Energy: 35.3444
Completed MCParticle Loop
True Neutrino Energy: 42.5229
 Size of all hits: 25
hit initial : 67.0236 | hit correction : 1.16843
hit initial : 30.1901 | hit correction : 1.16939
hit initial : 13.4448 | hit correction : 1.16745
hit initial : 131.569 | hit correction : 1.16949
hit initial : 60.6338 | hit correction : 1.16953
hit initial : 126.184 | hit correction : 1.16862
hit initial : 138.857 | hit correction : 1.16851
hit initial : 87.5514 | hit correction : 1.16754
 *** Total Charge : 766.029
 Looking at view: 0 | Number of hits in view: 8
hit initial : 41.4618 | hit correction : 1.16949
hit initial : 83.2843 | hit correction : 1.16852
hit initial : 44.6035 | hit correction : 1.16756
hit initial : 96.2645 | hit correction : 1.16949
hit initial : 127.676 | hit correction : 1.16853
hit initial : 40.4906 | hit correction : 1.16959
hit initial : 328.673 | hit correction : 1.16848
hit initial : 31.3485 | hit correction : 1.17355
hit initial : 17.6545 | hit correction : 1.17201
hit initial : 76.6375 | hit correction : 1.17361
hit initial : 87.9782 | hit correction : 1.16709
hit initial : 61.0684 | hit correction : 1.16653
 *** Total Charge : 1212.4
 Looking at view: 1 | Number of hits in view: 12
hit initial : 27.8337 | hit correction : 1.16964
hit initial : 251.516 | hit correction : 1.16947
hit initial : 481.295 | hit correction : 1.16855
hit initial : 64.5654 | hit correction : 1.16836
hit initial : 389.855 | hit correction : 1.16744
 *** Total Charge : 1419.68
 Looking at view: 2 | Number of hits in view: 5
12-Dec-2025 03:07:45 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0655745     0.0803977     0.101138      0.0767954     0.0128431       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000353113   0.00234595     0.0176348    0.000412748   0.00511188       10     
end_path:ana:AnalyzeEvents         0.0651087     0.0779108     0.0955515     0.0763218     0.0107758       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19473.7 MB
  Peak resident set size usage (VmHWM): 1534.15 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 15:00:04 UTC       justIN version: 01.06.00