justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 259580.0@dunegpschedd02.fnal.gov

Jobsub ID259580.0@dunegpschedd02.fnal.gov
Workflow ID11086
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-09 12:41:44
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-10 17:41:58
From worker nodeHostnamedunegli-7867863-0-fnpc22026.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-10 12:07:43
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T222333Z_gen_004762_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (20004s)
CPU time4h (14774s = 73%)
Max RSS bytes3057819648 (2916 MiB)
Outputting started2025-12-10 17:41:08
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11086/1/001/analysisLowE_20251210T120744Z.root
Finished2025-12-10 17:41:58
Saved logsjustin-logs:259580.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

werProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  10-Dec-2025 17:40:04 UTC run: 5026 subRun: 0 event: 47620
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  10-Dec-2025 17:40:04 UTC run: 5026 subRun: 0 event: 47620
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6810, 6815, 6599
minwire 0: 27
minwire 1: 0
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 174, 673
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.107188, 
Output 1: 0.498524, 0.0729346, 0.236761, 0.191781, 
Output 2: 0.0290033, 0.0580247, 0.906172, 0.00679994, 
Output 3: 0.938774, 0.0552872, 0.00271707, 0.0032221, 
Output 4: 0.552862, 0.390869, 0.044372, 0.0118978, 
Output 5: 0.242192, 0.419414, 0.228923, 0.109471, 
Output 6: 0.257307, 0.297542, 0.12469, 0.320461, 

10-Dec-2025 17:40:07 UTC  Closed output file "matt_reco2.root"
10-Dec-2025 17:40:07 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/8c/f4/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T222333Z_gen_004762_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              682.734       1987.61       4176.26       1102.73       1437.02        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00142247     0.0117608     0.0278755    0.00869353    0.00912259       10     
reco:pandora:StandardPandora                            680.195       1973.22       4108.26       1101.57       1419.09        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000429982    0.0277112     0.125908     0.00956447     0.0405634       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000317931    0.0174036     0.102429      0.0011375     0.0326931       10     
reco:pandoracalo:Calorimetry                          0.000212501   0.00113179    0.00626596    0.000325936   0.00183027       10     
reco:pandorapid:Chi2ParticleID                         6.887e-05    0.000188692   0.00107602    8.6153e-05    0.000296179      10     
reco:cvnmap:CVNMapper                                  0.0242849     0.0518193     0.0875805     0.0489403     0.0231317       10     
reco:cvneva:CVNEvaluator                               0.679805       1.11838       2.03684      0.948155      0.448252        10     
reco:energyrecnumu:EnergyReco                         0.00274339      6.67368       66.2335      0.0744318      19.8533        10     
reco:energyrecnue:EnergyReco                          0.000766989   0.00534238     0.015335     0.00405626    0.00475398       10     
reco:energyrecnc:EnergyReco                           0.00453457      6.15248       61.2525      0.0124637      18.3667        10     
[art]:TriggerResults:TriggerResultInserter            1.1682e-05    3.51383e-05   0.000104998   2.2938e-05    3.12688e-05      10     
end_path:out1:RootOutput                               4.93e-06     1.41797e-05   3.4885e-05    1.13815e-05   8.82279e-06      10     
end_path:out1:RootOutput(write)                        0.217283      0.327971      0.575931      0.278547      0.117625        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21775 MB
  Peak resident set size usage (VmHWM): 3057.82 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
True Electron Energy: 1.6417
Completed MCParticle Loop
True Neutrino Energy: 4.92544
 Size of all hits: 0
Begin processing the 5th record. run: 5026 subRun: 0 event: 47615 at 10-Dec-2025 17:40:48 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 29.8953
Completed MCParticle Loop
True Neutrino Energy: 35.4261
 Size of all hits: 0
Begin processing the 6th record. run: 5026 subRun: 0 event: 47616 at 10-Dec-2025 17:40:51 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.57
True Electron Energy: 4.05574
Completed MCParticle Loop
True Neutrino Energy: 9.43337
 Size of all hits: 0
Begin processing the 7th record. run: 5026 subRun: 0 event: 47617 at 10-Dec-2025 17:40:53 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 2.2447
Completed MCParticle Loop
True Neutrino Energy: 5.52869
 Size of all hits: 0
Begin processing the 8th record. run: 5026 subRun: 0 event: 47618 at 10-Dec-2025 17:40:56 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Electron Energy: 32.9183
Completed MCParticle Loop
True Neutrino Energy: 38.3149
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 47619 at 10-Dec-2025 17:41:00 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  26
Added hit list length: 26 | Max was set to: -3.40282e+38
True Electron Energy: 9.86303
Completed MCParticle Loop
True Neutrino Energy: 15.6262
 Size of all hits: 26
hit initial : 35.2719 | hit correction : 1.14536
hit initial : 95.032 | hit correction : 1.14538
hit initial : 52.654 | hit correction : 1.14542
hit initial : 30.0986 | hit correction : 1.14696
hit initial : 25.3422 | hit correction : 1.14713
hit initial : 44.3485 | hit correction : 1.14759
hit initial : 128.919 | hit correction : 1.14762
hit initial : 106.087 | hit correction : 1.14762
hit initial : 177.988 | hit correction : 1.14252
hit initial : 250.454 | hit correction : 1.1426
hit initial : 40.7607 | hit correction : 1.14224
hit initial : 201.995 | hit correction : 1.14313
hit initial : 306.907 | hit correction : 1.14316
hit initial : 140.42 | hit correction : 1.14315
 *** Total Charge : 1872.09
 Looking at view: 0 | Number of hits in view: 14
hit initial : 45.6862 | hit correction : 1.14045
hit initial : 72.0796 | hit correction : 1.14047
hit initial : 121.794 | hit correction : 1.14236
hit initial : 284.225 | hit correction : 1.14265
hit initial : 278.856 | hit correction : 1.14309
hit initial : 248.051 | hit correction : 1.14316
hit initial : 132.822 | hit correction : 1.14313
 *** Total Charge : 1352.36
 Looking at view: 1 | Number of hits in view: 7
hit initial : 60.7799 | hit correction : 1.14225
hit initial : 109.294 | hit correction : 1.14322
hit initial : 303.283 | hit correction : 1.14246
hit initial : 569.115 | hit correction : 1.1431
hit initial : 79.6311 | hit correction : 1.14311
 *** Total Charge : 1282.45
 Looking at view: 2 | Number of hits in view: 5
Begin processing the 10th record. run: 5026 subRun: 0 event: 47620 at 10-Dec-2025 17:41:04 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
True Neutron Energy: 939.573
True Electron Energy: 31.1403
Completed MCParticle Loop
True Neutrino Energy: 45.6551
 Size of all hits: 0
10-Dec-2025 17:41:07 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0548539     0.0782989     0.104098      0.0772934     0.0164228       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000554959   0.00126809    0.00308371    0.000908622   0.000783377      10     
end_path:ana:AnalyzeEvents         0.0539558     0.0765714     0.0993387     0.0755063     0.015726        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19476.1 MB
  Peak resident set size usage (VmHWM): 1535.52 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:46 UTC       justIN version: 01.06.00