justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262126.1@dunegpschedd02.fnal.gov

Jobsub ID262126.1@dunegpschedd02.fnal.gov
Workflow ID11177
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 10:22:30
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-13 19:27:45
From worker nodeHostnamedunegli-7890611-0-fnpc9038.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 10:24:16
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T222338Z_gen_000208_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time9h (32598s)
CPU time8h (32041s = 98%)
Max RSS bytes2800791552 (2671 MiB)
Outputting started2025-12-13 19:27:35
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11177/1/001/analysisLowE_20251213T102418Z.root
Finished2025-12-13 19:27:45
Saved logsjustin-logs:262126.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

c-2025 19:26:36 UTC run: 5027 subRun: 0 event: 2080
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 19:26:36 UTC run: 5027 subRun: 0 event: 2080
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 7041, 7040, 6974
minwire 0: 14
minwire 1: 1
minwire 2: 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2312, 2811
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0433868, 
Output 1: 0.0227484, 0.0896794, 0.124322, 0.76325, 
Output 2: 0.0809898, 0.247477, 0.622201, 0.0493321, 
Output 3: 0.846909, 0.0994728, 0.0323071, 0.0213106, 
Output 4: 0.809507, 0.153634, 0.0296548, 0.00720492, 
Output 5: 0.871096, 0.114191, 0.0119618, 0.00275031, 
Output 6: 0.0120071, 0.0451982, 0.0525815, 0.890213, 

13-Dec-2025 19:26:39 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 19:26:39 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/69/57/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T222338Z_gen_000208_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1642.96       3220.86       4853.78       2924.77       1359.25        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000796903   0.00376601     0.0174762    0.00201657    0.00485199       10     
reco:pandora:StandardPandora                            1640.76       3191.06       4777.73       2921.63       1327.88        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00181528     0.110559      0.238119      0.0958256     0.0780933       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00181451     0.0133435     0.0638363    0.00593934     0.0175196       10     
reco:pandoracalo:Calorimetry                          0.000244293   0.00270871     0.0126359    0.000933922   0.00375635       10     
reco:pandorapid:Chi2ParticleID                        9.7398e-05    0.000966862    0.0043722    0.000259225   0.00151708       10     
reco:cvnmap:CVNMapper                                  0.0812956     0.185779      0.361485      0.170445      0.0986188       10     
reco:cvneva:CVNEvaluator                                1.21266       3.01666       11.9912       2.14862       3.0201         10     
reco:energyrecnumu:EnergyReco                          0.0756392      25.8933       69.2897      0.127791       31.6678        10     
reco:energyrecnue:EnergyReco                          0.00139287    0.00563454     0.0202905    0.00337661    0.00549667       10     
reco:energyrecnc:EnergyReco                           0.00852877     0.0129862     0.0182653     0.013163     0.00357243       10     
[art]:TriggerResults:TriggerResultInserter            2.0177e-05    6.30884e-05   0.000205924    3.908e-05    5.86597e-05      10     
end_path:out1:RootOutput                               6.993e-06    1.86505e-05   5.7131e-05    1.45815e-05   1.44889e-05      10     
end_path:out1:RootOutput(write)                        0.346165      0.546952       1.17577      0.480323      0.243796        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11907.6 MB
  Peak resident set size usage (VmHWM): 2800.79 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 Looking at view: 0 | Number of hits in view: 29
hit initial : 7.55959 | hit correction : 1.17416
hit initial : 36.2043 | hit correction : 1.20632
hit initial : 34.5529 | hit correction : 1.1818
hit initial : 36.887 | hit correction : 1.18179
hit initial : 23.9535 | hit correction : 1.17126
hit initial : 61.1076 | hit correction : 1.17126
hit initial : 20.2339 | hit correction : 1.17124
hit initial : 178.947 | hit correction : 1.17273
hit initial : 133.111 | hit correction : 1.17248
hit initial : 59.0211 | hit correction : 1.17243
hit initial : 61.8153 | hit correction : 1.17326
hit initial : 296.853 | hit correction : 1.17354
hit initial : 404.218 | hit correction : 1.17357
hit initial : 365.188 | hit correction : 1.17345
hit initial : 969.892 | hit correction : 1.17346
hit initial : 1129.41 | hit correction : 1.17345
hit initial : 264.516 | hit correction : 1.17344
 *** Total Charge : 4793.06
 Looking at view: 1 | Number of hits in view: 17
hit initial : 25.6285 | hit correction : 1.2099
hit initial : 52.5127 | hit correction : 1.2063
hit initial : 85.1639 | hit correction : 1.1818
hit initial : 24.7007 | hit correction : 1.17355
hit initial : 27.7852 | hit correction : 1.17358
hit initial : 35.9768 | hit correction : 1.17125
hit initial : 76.3769 | hit correction : 1.17125
hit initial : 200.251 | hit correction : 1.17275
hit initial : 26.7334 | hit correction : 1.1724
hit initial : 280.025 | hit correction : 1.17246
hit initial : 177.147 | hit correction : 1.17313
hit initial : 178.013 | hit correction : 1.17336
hit initial : 319.753 | hit correction : 1.17355
hit initial : 327.12 | hit correction : 1.17362
hit initial : 334.958 | hit correction : 1.17362
hit initial : 166.509 | hit correction : 1.17351
hit initial : 163.456 | hit correction : 1.17352
hit initial : 154.75 | hit correction : 1.17352
hit initial : 205.781 | hit correction : 1.1735
hit initial : 311.027 | hit correction : 1.17345
hit initial : 578.157 | hit correction : 1.17336
hit initial : 137.849 | hit correction : 1.17344
hit initial : 148.658 | hit correction : 1.17338
hit initial : 148.76 | hit correction : 1.17338
hit initial : 162.482 | hit correction : 1.17336
hit initial : 47.5493 | hit correction : 1.17346
hit initial : 164.533 | hit correction : 1.17337
hit initial : 129.3 | hit correction : 1.17341
 *** Total Charge : 5507.29
 Looking at view: 2 | Number of hits in view: 28
Begin processing the 9th record. run: 5027 subRun: 0 event: 2079 at 13-Dec-2025 19:27:27 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Electron Energy: 56.7001
Completed MCParticle Loop
True Neutrino Energy: 60.5641
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 2080 at 13-Dec-2025 19:27:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  8
Added hit list length: 8 | Max was set to: -3.40282e+38
This pfp has size:  6
True Neutron Energy: 939.576
True Electron Energy: 0.589616
Completed MCParticle Loop
True Neutrino Energy: 5.96717
 Size of all hits: 8
hit initial : 45.6968 | hit correction : 1.39082
hit initial : 100.644 | hit correction : 1.39078
hit initial : 32.0281 | hit correction : 1.3908
 *** Total Charge : 248.075
 Looking at view: 0 | Number of hits in view: 3
hit initial : 61.0772 | hit correction : 1.39079
hit initial : 74.0266 | hit correction : 1.39079
 *** Total Charge : 187.901
 Looking at view: 1 | Number of hits in view: 2
hit initial : 97.5144 | hit correction : 1.39078
hit initial : 59.4887 | hit correction : 1.3908
hit initial : 18.7505 | hit correction : 1.39102
 *** Total Charge : 244.441
 Looking at view: 2 | Number of hits in view: 3
13-Dec-2025 19:27:34 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0770561     0.110269       0.14337      0.108135      0.0185715       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000429592   0.00128768    0.00809044    0.00053736    0.00226837       10     
end_path:ana:AnalyzeEvents         0.0763029     0.108798      0.137659      0.107464      0.0172741       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9811.28 MB
  Peak resident set size usage (VmHWM): 1538.8 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:12:33 UTC       justIN version: 01.06.00