Jobsub ID 261351.0@dunegpschedd02.fnal.gov

Jobsub ID	261351.0@dunegpschedd02.fnal.gov
Workflow ID	11112
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-11 23:24:42
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-12-12 04:22:15
From worker node	Hostname	dunegli-7877274-0-fnpc9004.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-11 23:25:55
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T180257Z_gen_001330_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	4h (17763s)
	CPU time	4h (17568s = 98%)
	Max RSS bytes	2920435712 (2785 MiB)
Outputting started	2025-12-12 04:21:59
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11112/1/001/analysisLowE_20251211T232556Z.root
Finished	2025-12-12 04:22:15
Saved logs	justin-logs:261351.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

sifier summary: 
Output 0: 0.11366, 
Output 1: 0.0457053, 0.257284, 0.177814, 0.519196, 
Output 2: 0.0761968, 0.199589, 0.705397, 0.0188176, 
Output 3: 0.975534, 0.0201984, 0.00104051, 0.00322712, 
Output 4: 0.184422, 0.766393, 0.046682, 0.00250248, 
Output 5: 0.600135, 0.346716, 0.0413677, 0.011782, 
Output 6: 0.0295, 0.0827613, 0.0882946, 0.799444, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 13300 at 12-Dec-2025 03:42:58 UTC
Error: A CaloHitList is empty
Error: A CaloHitList is empty
Boundary wire vector sizes: 6808, 6815, 6643
minwire 0: 27
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0492817, 
Output 1: 0.0183294, 0.04761, 0.0567689, 0.877292, 
Output 2: 0.0911173, 0.242226, 0.626826, 0.0398304, 
Output 3: 0.957813, 0.0283599, 0.00403152, 0.00979526, 
Output 4: 0.761895, 0.203864, 0.0285368, 0.00570377, 
Output 5: 0.873227, 0.108932, 0.0134336, 0.00440798, 
Output 6: 0.00665222, 0.0249032, 0.038621, 0.929823, 

12-Dec-2025 04:20:35 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 04:20:35 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/03/59/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T180257Z_gen_001330_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1485.43       1745.19       2250.77       1650.74       228.465        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00114651    0.00861932     0.0257693    0.00621138    0.00692297       10     
reco:pandora:StandardPandora                            1483.27       1742.73       2248.74       1647.47       228.755        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00174863     0.0197718     0.0813156    0.00637631     0.0258344       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00158775     0.0923863     0.853632     0.00650271     0.253804        10     
reco:pandoracalo:Calorimetry                          0.000229791    0.0125138     0.0345622    0.00419035     0.0135475       10     
reco:pandorapid:Chi2ParticleID                        6.7897e-05    0.000282071    0.0011358    0.000198422   0.000300153      10     
reco:cvnmap:CVNMapper                                  0.0567592     0.0720945     0.113343      0.0693544     0.0154965       10     
reco:cvneva:CVNEvaluator                                1.08566       1.59219       3.51695       1.41602      0.686199        10     
reco:energyrecnumu:EnergyReco                         0.00699321     0.0825236     0.155368      0.086939      0.0495364       10     
reco:energyrecnue:EnergyReco                          0.00116854    0.00637705     0.0127101    0.00816606    0.00428792       10     
reco:energyrecnc:EnergyReco                           0.00796127     0.0405291     0.148107      0.0101707     0.050152        10     
[art]:TriggerResults:TriggerResultInserter            1.7466e-05    2.89609e-05   6.8937e-05    2.4942e-05    1.39433e-05      10     
end_path:out1:RootOutput                               5.937e-06    8.9101e-06    2.0819e-05     7.049e-06    4.23789e-06      10     
end_path:out1:RootOutput(write)                        0.341382      0.526874       1.41412      0.400243      0.308177        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12012.8 MB
  Peak resident set size usage (VmHWM): 2920.44 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  38
Added hit list length: 38 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Electron Energy: 39.1934
Completed MCParticle Loop
True Neutrino Energy: 44.586
 Size of all hits: 38
hit initial : 27.4777 | hit correction : 1.31283
hit initial : 24.4403 | hit correction : 1.31284
hit initial : 83.1782 | hit correction : 1.31
hit initial : 74.797 | hit correction : 1.30891
hit initial : 111.538 | hit correction : 1.30996
hit initial : 45.9891 | hit correction : 1.30996
hit initial : 19.1811 | hit correction : 1.31001
hit initial : 476.914 | hit correction : 1.30865
hit initial : 94.4037 | hit correction : 1.30868
hit initial : 745.867 | hit correction : 1.30871
hit initial : 445.822 | hit correction : 1.3089
 *** Total Charge : 2813.83
 Looking at view: 0 | Number of hits in view: 11
hit initial : 44.0368 | hit correction : 1.30851
hit initial : 170.912 | hit correction : 1.30858
hit initial : 15.7081 | hit correction : 1.30752
hit initial : 213.002 | hit correction : 1.30895
hit initial : 152.527 | hit correction : 1.30919
hit initial : 163.053 | hit correction : 1.30922
hit initial : 100.446 | hit correction : 1.30904
hit initial : 286.051 | hit correction : 1.30835
hit initial : 144.146 | hit correction : 1.30819
hit initial : 215.699 | hit correction : 1.30865
hit initial : 254.201 | hit correction : 1.30873
 *** Total Charge : 2303.05
 Looking at view: 1 | Number of hits in view: 11
hit initial : 109.597 | hit correction : 1.30846
hit initial : 115.81 | hit correction : 1.30857
hit initial : 160.885 | hit correction : 1.30915
hit initial : 216.853 | hit correction : 1.30924
hit initial : 225.326 | hit correction : 1.30904
hit initial : 117.307 | hit correction : 1.30847
hit initial : 34.5133 | hit correction : 1.31005
hit initial : 118.824 | hit correction : 1.3083
hit initial : 136.041 | hit correction : 1.30999
hit initial : 164.256 | hit correction : 1.3081
hit initial : 87.4474 | hit correction : 1.30991
hit initial : 47.0251 | hit correction : 1.30804
hit initial : 174.215 | hit correction : 1.3087
hit initial : 123.437 | hit correction : 1.30869
hit initial : 135.882 | hit correction : 1.30881
hit initial : 139.157 | hit correction : 1.30895
 *** Total Charge : 2757.27
 Looking at view: 2 | Number of hits in view: 16
Begin processing the 7th record. run: 5026 subRun: 0 event: 13297 at 12-Dec-2025 04:21:35 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 5.28283
Completed MCParticle Loop
True Neutrino Energy: 9.00771
 Size of all hits: 0
Begin processing the 8th record. run: 5026 subRun: 0 event: 13298 at 12-Dec-2025 04:21:41 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 1.83589
Completed MCParticle Loop
True Neutrino Energy: 6.34705
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 13299 at 12-Dec-2025 04:21:47 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 3.41265
Completed MCParticle Loop
True Neutrino Energy: 7.13666
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 13300 at 12-Dec-2025 04:21:52 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.574
True Electron Energy: 49.5194
Completed MCParticle Loop
True Neutrino Energy: 65.1469
 Size of all hits: 0
12-Dec-2025 04:21:58 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.137662      0.175351       0.27263       0.16572      0.0404943       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000500921   0.00784521     0.0340285    0.000671421    0.0125331       10     
end_path:ana:AnalyzeEvents         0.136972      0.167282      0.237922      0.146798      0.033975        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9805.48 MB
  Peak resident set size usage (VmHWM): 1530.18 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0