justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258309.1@dunegpschedd02.fnal.gov

Jobsub ID258309.1@dunegpschedd02.fnal.gov
Workflow ID11022
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 00:29:26
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 08:16:11
From worker nodeHostnamedunegli-7988825-0-fnpc17114.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:40:45
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T223947Z_gen_000392_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (23712s)
CPU time6h (23474s = 98%)
Max RSS bytes3060015104 (2918 MiB)
Outputting started2025-12-06 08:15:57
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11022/1/001/analysisLowE_20251206T014046Z.root
Finished2025-12-06 08:16:11
Saved logsjustin-logs:258309.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.0286571, 0.0655209, 0.0792214, 0.826601, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 3920 at 06-Dec-2025 07:36:18 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 08:14:41 UTC run: 5027 subRun: 0 event: 3920
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6790, 6721, 6533
minwire 0: 58
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 237, 736
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.119268, 
Output 1: 0.103834, 0.253318, 0.20912, 0.433728, 
Output 2: 0.0409067, 0.110302, 0.834744, 0.014047, 
Output 3: 0.976815, 0.0190499, 0.00133147, 0.00280343, 
Output 4: 0.672272, 0.29206, 0.0295108, 0.00615727, 
Output 5: 0.298342, 0.439707, 0.191427, 0.0705244, 
Output 6: 0.06985, 0.162155, 0.117565, 0.65043, 

06-Dec-2025 08:14:45 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 08:14:45 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/b4/bf/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T223947Z_gen_000392_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2300.16       2347.28       2408.15       2340.65       31.0066        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0031508    0.00974899     0.0221674    0.00837554     0.0055983       10     
reco:pandora:StandardPandora                            2297.81       2344.29       2400.48       2338.1        29.9996        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000593731    0.0286175     0.128392      0.013216      0.0358157       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000602009   0.00584174     0.0273807    0.00263616    0.00752333       10     
reco:pandoracalo:Calorimetry                          0.00031547     0.0101885     0.0497419    0.000671027    0.0178022       10     
reco:pandorapid:Chi2ParticleID                        0.000113779   0.00045942    0.00306208    0.000157867   0.000869519      10     
reco:cvnmap:CVNMapper                                  0.0608829     0.0770976     0.121628      0.0636854     0.0223793       10     
reco:cvneva:CVNEvaluator                                1.42152       1.97246       6.16979       1.5202        1.39964        10     
reco:energyrecnumu:EnergyReco                          0.0123962     0.0957969     0.150936      0.133307      0.0571644       10     
reco:energyrecnue:EnergyReco                          0.00193383    0.00609609     0.0151642    0.00243512    0.00576767       10     
reco:energyrecnc:EnergyReco                            0.0140176     0.0638907     0.185258      0.0153408     0.0630484       10     
[art]:TriggerResults:TriggerResultInserter            2.1738e-05    4.04194e-05   0.000128846   3.12645e-05   2.99132e-05      10     
end_path:out1:RootOutput                               8.709e-06    1.28475e-05   3.9452e-05    1.00195e-05   8.89615e-06      10     
end_path:out1:RootOutput(write)                        0.616411      0.716557      0.931276      0.706495      0.0828112       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14272.7 MB
  Peak resident set size usage (VmHWM): 3060.02 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 390.919 | hit correction : 1.17231
hit initial : 217.841 | hit correction : 1.17255
hit initial : 48.7878 | hit correction : 1.17316
hit initial : 540.484 | hit correction : 1.17409
hit initial : 151.977 | hit correction : 1.1742
hit initial : 183.842 | hit correction : 1.17452
hit initial : 213.146 | hit correction : 1.17527
hit initial : 98.7277 | hit correction : 1.1752
 *** Total Charge : 4758.99
 Looking at view: 0 | Number of hits in view: 19
hit initial : 64.9356 | hit correction : 1.17526
hit initial : 49.3221 | hit correction : 1.17528
hit initial : 136.898 | hit correction : 1.17344
hit initial : 83.6289 | hit correction : 1.1654
hit initial : 499.422 | hit correction : 1.16749
hit initial : 987.972 | hit correction : 1.16814
hit initial : 741.306 | hit correction : 1.16892
hit initial : 385.001 | hit correction : 1.17212
hit initial : 122.122 | hit correction : 1.17249
hit initial : 53.9864 | hit correction : 1.17254
hit initial : 107.408 | hit correction : 1.17426
hit initial : 215.487 | hit correction : 1.17419
hit initial : 49.7455 | hit correction : 1.17436
hit initial : 245.773 | hit correction : 1.1752
 *** Total Charge : 4380.22
 Looking at view: 1 | Number of hits in view: 14
hit initial : 71.1646 | hit correction : 1.1668
hit initial : 36.6414 | hit correction : 1.17538
hit initial : 132.356 | hit correction : 1.16657
hit initial : 35.52 | hit correction : 1.16659
hit initial : 27.508 | hit correction : 1.16533
hit initial : 11.0486 | hit correction : 1.16749
hit initial : 1586.83 | hit correction : 1.16858
hit initial : 26.7018 | hit correction : 1.16858
hit initial : 1625.58 | hit correction : 1.17219
hit initial : 112.992 | hit correction : 1.17278
hit initial : 54.6728 | hit correction : 1.17426
hit initial : 608.015 | hit correction : 1.17429
hit initial : 35.8955 | hit correction : 1.17491
hit initial : 158.118 | hit correction : 1.17511
 *** Total Charge : 5296.6
 Looking at view: 2 | Number of hits in view: 14
Begin processing the 10th record. run: 5027 subRun: 0 event: 3920 at 06-Dec-2025 08:15:52 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  24
Added hit list length: 24 | Max was set to: -3.40282e+38
True Neutron Energy: 939.566
True Electron Energy: 17.0108
Completed MCParticle Loop
True Neutrino Energy: 20.738
 Size of all hits: 24
hit initial : 139.061 | hit correction : 1.06005
hit initial : 236.041 | hit correction : 1.06016
hit initial : 17.9032 | hit correction : 1.0618
hit initial : 235.182 | hit correction : 1.06029
hit initial : 28.3482 | hit correction : 1.0618
hit initial : 260.252 | hit correction : 1.06032
hit initial : 95.9951 | hit correction : 1.06021
hit initial : 63.054 | hit correction : 1.06028
hit initial : 15.8845 | hit correction : 1.06032
hit initial : 377.603 | hit correction : 1.06018
hit initial : 315.675 | hit correction : 1.06017
 *** Total Charge : 1892.54
 Looking at view: 0 | Number of hits in view: 11
hit initial : 26.1955 | hit correction : 1.06031
hit initial : 58.1603 | hit correction : 1.06027
hit initial : 599.96 | hit correction : 1.06023
hit initial : 441.878 | hit correction : 1.06025
hit initial : 246.786 | hit correction : 1.06015
hit initial : 123.906 | hit correction : 1.06004
hit initial : 273.057 | hit correction : 1.06019
 *** Total Charge : 1876.51
 Looking at view: 1 | Number of hits in view: 7
hit initial : 56.3362 | hit correction : 1.06213
hit initial : 260.26 | hit correction : 1.06
hit initial : 481.038 | hit correction : 1.06017
hit initial : 245.73 | hit correction : 1.06022
hit initial : 188.915 | hit correction : 1.06025
hit initial : 572.298 | hit correction : 1.0603
 *** Total Charge : 1913.33
 Looking at view: 2 | Number of hits in view: 6
06-Dec-2025 08:15:57 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0922421     0.135117      0.197993      0.133308      0.0320469       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000491743   0.00070693    0.00139963    0.000629064   0.000248211      10     
end_path:ana:AnalyzeEvents         0.0915539     0.134166       0.19575      0.132521      0.0317059       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11962.4 MB
  Peak resident set size usage (VmHWM): 1540.33 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:03 UTC       justIN version: 01.06.00