justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261265.0@dunegpschedd02.fnal.gov

Jobsub ID261265.0@dunegpschedd02.fnal.gov
Workflow ID11108
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:10:38
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 03:33:37
From worker nodeHostnamedunegli-7876502-0-fnpc8023.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:12:21
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T010618Z_gen_004980_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (19251s)
CPU time5h (19039s = 98%)
Max RSS bytes2755547136 (2627 MiB)
Outputting started2025-12-12 03:33:13
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11108/1/001/analysisLowE_20251211T221221Z.root
Finished2025-12-12 03:33:37
Saved logsjustin-logs:261265.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Shower@BeginModule  12-Dec-2025 03:30:57 UTC run: 5026 subRun: 0 event: 49800
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 03:30:57 UTC run: 5026 subRun: 0 event: 49800
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6806, 6793, 6759
minwire 0: 63
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2254, 2753
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.192307, 
Output 1: 0.0924431, 0.177895, 0.272243, 0.457418, 
Output 2: 0.0385877, 0.131339, 0.811305, 0.0187679, 
Output 3: 0.976371, 0.0172052, 0.00217279, 0.00425059, 
Output 4: 0.325591, 0.585811, 0.0793364, 0.00926192, 
Output 5: 0.27218, 0.463071, 0.20721, 0.0575391, 
Output 6: 0.0628673, 0.135487, 0.114763, 0.686882, 

12-Dec-2025 03:31:04 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:31:04 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/b2/b1/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T010618Z_gen_004980_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1699.29       1890.63       2157.29       1897.81       140.368        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00179055    0.00850526     0.0323536    0.00527612    0.00852769       10     
reco:pandora:StandardPandora                            1697.54       1887.27       2154.37       1895.34       139.887        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00136072     0.0144181     0.0992577    0.00415128     0.0284834       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00145852     0.0159394     0.0625629    0.00502547     0.0210917       10     
reco:pandoracalo:Calorimetry                          0.000447165   0.00592094     0.0285568    0.00265473    0.00811706       10     
reco:pandorapid:Chi2ParticleID                        0.000104192   0.00103609    0.00787973    0.00019225    0.00229204       10     
reco:cvnmap:CVNMapper                                  0.0356921     0.0936753      0.41744      0.0530367     0.109958        10     
reco:cvneva:CVNEvaluator                                1.19574       2.36602       7.30831       1.96301       1.66487        10     
reco:energyrecnumu:EnergyReco                         0.00971331     0.104429      0.350774      0.113582      0.0986508       10     
reco:energyrecnue:EnergyReco                          0.00168798    0.00838966     0.0137658     0.0114057     0.0055267       10     
reco:energyrecnc:EnergyReco                           0.00945798     0.0587208     0.136669      0.0136166     0.0564636       10     
[art]:TriggerResults:TriggerResultInserter            1.3111e-05    3.17141e-05   9.7937e-05    2.4555e-05    2.26756e-05      10     
end_path:out1:RootOutput                               6.049e-06    1.00973e-05   3.4039e-05     7.61e-06     8.00644e-06      10     
end_path:out1:RootOutput(write)                        0.398208       0.67949       1.10212      0.674881      0.172858        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 10951.4 MB
  Peak resident set size usage (VmHWM): 2755.55 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 95.6327 | hit correction : 1.45427
hit initial : 108.428 | hit correction : 1.45421
hit initial : 154.782 | hit correction : 1.45415
hit initial : 151.414 | hit correction : 1.45406
hit initial : 34.2754 | hit correction : 1.45405
hit initial : 93.1838 | hit correction : 1.45429
hit initial : 175.914 | hit correction : 1.45443
hit initial : 132.219 | hit correction : 1.45461
hit initial : 124.385 | hit correction : 1.45461
hit initial : 114.361 | hit correction : 1.45455
hit initial : 126.793 | hit correction : 1.45443
hit initial : 152.453 | hit correction : 1.45413
hit initial : 87.0547 | hit correction : 1.45399
 *** Total Charge : 3225.54
 Looking at view: 2 | Number of hits in view: 23
Begin processing the 9th record. run: 5026 subRun: 0 event: 49799 at 12-Dec-2025 03:32:57 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 941.982
True Neutron Energy: 940.271
True Electron Energy: 13.64
Completed MCParticle Loop
True Neutrino Energy: 30.8839
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 49800 at 12-Dec-2025 03:33:04 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  40
Added hit list length: 40 | Max was set to: -3.40282e+38
True Neutron Energy: 939.572
True Neutron Energy: 941.945
True Neutron Energy: 940.015
True Electron Energy: 37.9671
Completed MCParticle Loop
True Neutrino Energy: 55.2464
 Size of all hits: 40
hit initial : 60.2098 | hit correction : 1.28863
hit initial : 177.387 | hit correction : 1.28667
hit initial : 192.594 | hit correction : 1.28846
hit initial : 158.957 | hit correction : 1.28668
hit initial : 226.601 | hit correction : 1.28809
hit initial : 145.323 | hit correction : 1.2867
hit initial : 208.617 | hit correction : 1.2878
hit initial : 277.676 | hit correction : 1.28671
hit initial : 266.925 | hit correction : 1.28663
hit initial : 37.9727 | hit correction : 1.28117
hit initial : 166.86 | hit correction : 1.28652
hit initial : 93.4485 | hit correction : 1.28116
hit initial : 141.947 | hit correction : 1.28648
hit initial : 121.418 | hit correction : 1.28116
hit initial : 138.465 | hit correction : 1.28649
hit initial : 66.202 | hit correction : 1.28652
 *** Total Charge : 3191.26
 Looking at view: 0 | Number of hits in view: 16
hit initial : 152.981 | hit correction : 1.2865
hit initial : 173.103 | hit correction : 1.28813
hit initial : 100.573 | hit correction : 1.28861
hit initial : 101.488 | hit correction : 1.28806
hit initial : 300.862 | hit correction : 1.28662
hit initial : 58.7744 | hit correction : 1.2886
hit initial : 264.98 | hit correction : 1.28667
hit initial : 258.539 | hit correction : 1.28665
hit initial : 289.297 | hit correction : 1.28652
 *** Total Charge : 2188.72
 Looking at view: 1 | Number of hits in view: 9
hit initial : 15.4966 | hit correction : 1.28633
hit initial : 52.8192 | hit correction : 1.28642
hit initial : 27.7169 | hit correction : 1.28869
hit initial : 307.022 | hit correction : 1.28846
hit initial : 22.0864 | hit correction : 1.28627
hit initial : 299.527 | hit correction : 1.28813
hit initial : 274.009 | hit correction : 1.28646
hit initial : 102.57 | hit correction : 1.28772
hit initial : 713.854 | hit correction : 1.28653
hit initial : 501.516 | hit correction : 1.28675
hit initial : 193.565 | hit correction : 1.28649
hit initial : 165.757 | hit correction : 1.28647
hit initial : 19.7414 | hit correction : 1.28654
hit initial : 137.004 | hit correction : 1.28651
hit initial : 362.224 | hit correction : 1.28664
 *** Total Charge : 4111.69
 Looking at view: 2 | Number of hits in view: 15
12-Dec-2025 03:33:11 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.138886      0.311598       1.02436      0.201555       0.25859        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000508004    0.0779872      0.49042     0.000659248    0.153624        10     
end_path:ana:AnalyzeEvents         0.138124      0.233425       0.53381      0.177779       0.12525        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8740.3 MB
  Peak resident set size usage (VmHWM): 1538.17 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:09 UTC       justIN version: 01.06.00