justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262004.5@dunegpschedd02.fnal.gov

Jobsub ID262004.5@dunegpschedd02.fnal.gov
Workflow ID11177
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 06:40:19
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 18:31:25
From worker nodeHostnamedunegli-8047072-0-fnpc9021.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 06:40:47
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T185901Z_gen_001789_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (42618s)
CPU time11h (42229s = 99%)
Max RSS bytes2788376576 (2659 MiB)
Outputting started2025-12-13 18:31:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11177/1/001/analysisLowE_20251213T064048Z.root
Finished2025-12-13 18:31:25
Saved logsjustin-logs:262004.5-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ec-2025 18:29:39 UTC run: 5026 subRun: 0 event: 17890
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:29:39 UTC run: 5026 subRun: 0 event: 17890
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6642, 6593, 6511
minwire 0: 10
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2170, 2669
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.130905, 
Output 1: 0.0498505, 0.187675, 0.140574, 0.621901, 
Output 2: 0.0559242, 0.201657, 0.715468, 0.026951, 
Output 3: 0.972901, 0.0178037, 0.00243374, 0.00686159, 
Output 4: 0.602091, 0.351662, 0.0403313, 0.00591651, 
Output 5: 0.36425, 0.46593, 0.13753, 0.0322897, 
Output 6: 0.0266768, 0.0717022, 0.0828993, 0.818722, 

13-Dec-2025 18:29:44 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 18:29:44 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/85/0d/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T185901Z_gen_001789_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3036.59        4225         5094.85       4382.54       682.006        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00163319     0.0074253     0.0318751    0.00234899     0.010322        10     
reco:pandora:StandardPandora                            3033.38       4221.21       5091.38       4375.66       681.721        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00174176     0.119338      0.232238       0.11031      0.0881267       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00080024     0.0138341     0.0729675    0.00427785     0.0204254       10     
reco:pandoracalo:Calorimetry                          0.000723543    0.0156369     0.132965     0.00115924     0.0393206       10     
reco:pandorapid:Chi2ParticleID                        0.000108658   0.000803387   0.00568553    0.000255621   0.00163244       10     
reco:cvnmap:CVNMapper                                  0.0952456     0.169545      0.234667      0.175773      0.0416241       10     
reco:cvneva:CVNEvaluator                                1.68499       2.67824       8.97117       2.03367       2.10634        10     
reco:energyrecnumu:EnergyReco                          0.101028      0.214223      0.858245       0.14032      0.217624        10     
reco:energyrecnue:EnergyReco                          0.00236519    0.00569215     0.013632     0.00390746    0.00356506       10     
reco:energyrecnc:EnergyReco                           0.00994841     0.0129667     0.0159611     0.013075     0.00156321       10     
[art]:TriggerResults:TriggerResultInserter            2.6089e-05    5.63143e-05   0.000223343   4.16675e-05   5.60966e-05      10     
end_path:out1:RootOutput                               9.089e-06    1.82731e-05   6.6034e-05    1.3634e-05    1.60933e-05      10     
end_path:out1:RootOutput(write)                        0.480547      0.550047      0.723656      0.532237      0.0648874       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11905 MB
  Peak resident set size usage (VmHWM): 2788.38 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 140.698 | hit correction : 1.33302
hit initial : 149.937 | hit correction : 1.33299
hit initial : 23.9586 | hit correction : 1.33235
hit initial : 246.28 | hit correction : 1.33233
hit initial : 217.963 | hit correction : 1.33259
 *** Total Charge : 8022.05
 Looking at view: 2 | Number of hits in view: 38
Begin processing the 9th record. run: 5026 subRun: 0 event: 17889 at 13-Dec-2025 18:30:55 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Electron Energy: 19.9247
Completed MCParticle Loop
True Neutrino Energy: 23.2118
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 17890 at 13-Dec-2025 18:31:00 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  50
Added hit list length: 50 | Max was set to: -3.40282e+38
This pfp has size:  8
This pfp has size:  3
True Neutron Energy: 939.576
True Electron Energy: 33.1356
Completed MCParticle Loop
True Neutrino Energy: 38.671
 Size of all hits: 50
hit initial : 83.0176 | hit correction : 1.3429
hit initial : 175.272 | hit correction : 1.34292
hit initial : 99.8625 | hit correction : 1.34296
hit initial : 117.024 | hit correction : 1.3439
hit initial : 318.835 | hit correction : 1.34407
hit initial : 134.623 | hit correction : 1.34566
hit initial : 437.076 | hit correction : 1.34668
hit initial : 36.649 | hit correction : 1.34742
hit initial : 587.689 | hit correction : 1.34788
hit initial : 66.1918 | hit correction : 1.34822
hit initial : 48.8615 | hit correction : 1.34928
hit initial : 161.589 | hit correction : 1.35015
 *** Total Charge : 3051.39
 Looking at view: 0 | Number of hits in view: 12
hit initial : 33.0658 | hit correction : 1.35038
hit initial : 33.842 | hit correction : 1.34923
hit initial : 259.785 | hit correction : 1.34482
hit initial : 56.6807 | hit correction : 1.34284
hit initial : 174.554 | hit correction : 1.3429
hit initial : 181.006 | hit correction : 1.34305
hit initial : 74.1052 | hit correction : 1.34316
hit initial : 136.446 | hit correction : 1.344
hit initial : 206.824 | hit correction : 1.34479
hit initial : 485.421 | hit correction : 1.34547
hit initial : 53.6627 | hit correction : 1.3457
hit initial : 100.184 | hit correction : 1.3463
hit initial : 167.554 | hit correction : 1.34711
hit initial : 283.462 | hit correction : 1.34747
hit initial : 249.918 | hit correction : 1.34815
hit initial : 86.0952 | hit correction : 1.34822
hit initial : 282.155 | hit correction : 1.34917
hit initial : 326.975 | hit correction : 1.34965
hit initial : 160.018 | hit correction : 1.35014
 *** Total Charge : 4513.25
 Looking at view: 1 | Number of hits in view: 19
hit initial : 20.3056 | hit correction : 1.34284
hit initial : 242.065 | hit correction : 1.34287
hit initial : 259.219 | hit correction : 1.34322
hit initial : 182.028 | hit correction : 1.34389
hit initial : 140.239 | hit correction : 1.34441
hit initial : 188.733 | hit correction : 1.34492
hit initial : 249.605 | hit correction : 1.34546
hit initial : 331.989 | hit correction : 1.34596
hit initial : 219.072 | hit correction : 1.34673
hit initial : 166.048 | hit correction : 1.3473
hit initial : 147.472 | hit correction : 1.34768
hit initial : 183.219 | hit correction : 1.34808
hit initial : 212.83 | hit correction : 1.34838
hit initial : 175.846 | hit correction : 1.34895
hit initial : 205.168 | hit correction : 1.34927
hit initial : 152.391 | hit correction : 1.34963
hit initial : 141.067 | hit correction : 1.35001
hit initial : 129.913 | hit correction : 1.35034
hit initial : 45.4406 | hit correction : 1.35052
 *** Total Charge : 4568.6
 Looking at view: 2 | Number of hits in view: 19
13-Dec-2025 18:31:05 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          0.10905      0.155706      0.236316       0.14779      0.0337165       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000691007   0.00247088     0.0154745    0.00107292    0.00433834       10     
end_path:ana:AnalyzeEvents         0.107715       0.15293      0.219942      0.146379      0.0303184       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9807.6 MB
  Peak resident set size usage (VmHWM): 1536.52 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:12:13 UTC       justIN version: 01.06.00