Jobsub ID 261277.0@dunegpschedd02.fnal.gov

Jobsub ID	261277.0@dunegpschedd02.fnal.gov
Workflow ID	11113
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-11 22:16:40
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-12-12 02:22:27
From worker node	Hostname	dunegli-7878607-0-fnpc9038.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-11 22:17:04
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T205052Z_gen_003256_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	4h (14708s)
	CPU time	4h (14545s = 98%)
	Max RSS bytes	2929074176 (2793 MiB)
Outputting started	2025-12-12 02:22:13
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11113/1/001/analysisLowE_20251211T221707Z.root
Finished	2025-12-12 02:22:27
Saved logs	justin-logs:261277.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.0256245, 0.00211075, 
Output 6: 0.0208278, 0.0550622, 0.0682618, 0.855848, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 32560 at 12-Dec-2025 01:56:03 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 02:20:22 UTC run: 5026 subRun: 0 event: 32560
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6900, 6808, 6736
minwire 0: 89
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2145, 2644
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0986209, 
Output 1: 0.0618951, 0.0498396, 0.125003, 0.763262, 
Output 2: 0.0651238, 0.204565, 0.708011, 0.0223008, 
Output 3: 0.970231, 0.023671, 0.00194518, 0.00415271, 
Output 4: 0.197041, 0.717177, 0.0805006, 0.00528135, 
Output 5: 0.69979, 0.254871, 0.0361949, 0.00914375, 
Output 6: 0.0235184, 0.0721408, 0.0814581, 0.822883, 

12-Dec-2025 02:20:32 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:20:32 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/2b/ac/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T205052Z_gen_003256_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1429.13       1446.81       1460.13       1449.45       9.21567        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0017167    0.00747953     0.0262777    0.00500534    0.00706001       10     
reco:pandora:StandardPandora                            1425.22       1444.87       1458.37       1447.67       9.6373         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00145977     0.0158025     0.0702245    0.00495866     0.024893        10     
reco:pandoraShower:LArPandoraModularShowerCreation     0.0013717    0.00603021     0.0264361    0.00381978    0.00687215       10     
reco:pandoracalo:Calorimetry                          0.000225367    0.0170797     0.0807914     0.0104557     0.0235067       10     
reco:pandorapid:Chi2ParticleID                        9.3131e-05    0.00131734    0.00959033    0.00023369    0.00279769       10     
reco:cvnmap:CVNMapper                                  0.0367379     0.0487173     0.0767541     0.0421882     0.0128748       10     
reco:cvneva:CVNEvaluator                                1.04586       1.29951       3.19072       1.08459      0.631884        10     
reco:energyrecnumu:EnergyReco                          0.0106686     0.078349      0.199431      0.0841467     0.0586041       10     
reco:energyrecnue:EnergyReco                          0.00105142    0.00524296    0.00833861    0.00783882    0.00336045       10     
reco:energyrecnc:EnergyReco                           0.00773726     0.039737      0.103371     0.00813397     0.0394235       10     
[art]:TriggerResults:TriggerResultInserter            1.4784e-05    2.2493e-05    7.2714e-05    1.7091e-05    1.67927e-05      10     
end_path:out1:RootOutput                               4.918e-06    7.7278e-06    2.2568e-05     5.592e-06    5.15625e-06      10     
end_path:out1:RootOutput(write)                        0.360273      0.425654      0.742369      0.383558       0.10921        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12023.5 MB
  Peak resident set size usage (VmHWM): 2929.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
Number of reconstructed particles:  0
True Electron Energy: 2.25764
Completed MCParticle Loop
True Neutrino Energy: 5.98218
 Size of all hits: 0
Begin processing the 8th record. run: 5026 subRun: 0 event: 32558 at 12-Dec-2025 02:21:55 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 1.03444
Completed MCParticle Loop
True Neutrino Energy: 4.31796
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 32559 at 12-Dec-2025 02:22:01 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 3.8552
Completed MCParticle Loop
True Neutrino Energy: 9.35715
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 32560 at 12-Dec-2025 02:22:05 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  47
Added hit list length: 47 | Max was set to: -3.40282e+38
True Neutron Energy: 939.575
True Electron Energy: 28.7175
Completed MCParticle Loop
True Neutrino Energy: 34.1017
 Size of all hits: 47
hit initial : 135.053 | hit correction : 1.06945
hit initial : 284.843 | hit correction : 1.06962
hit initial : 279.017 | hit correction : 1.0699
hit initial : 252.968 | hit correction : 1.07003
hit initial : 226.735 | hit correction : 1.07013
hit initial : 264.827 | hit correction : 1.07057
hit initial : 245.658 | hit correction : 1.07081
hit initial : 222.078 | hit correction : 1.07092
hit initial : 220.201 | hit correction : 1.07096
hit initial : 236.825 | hit correction : 1.071
hit initial : 261.299 | hit correction : 1.07107
hit initial : 190.7 | hit correction : 1.07114
hit initial : 46.8276 | hit correction : 1.07115
hit initial : 17.7672 | hit correction : 1.07017
hit initial : 25.8289 | hit correction : 1.07015
hit initial : 233.251 | hit correction : 1.07029
 *** Total Charge : 3365.41
 Looking at view: 0 | Number of hits in view: 16
hit initial : 329.264 | hit correction : 1.07098
hit initial : 559.937 | hit correction : 1.07099
hit initial : 185.399 | hit correction : 1.07099
hit initial : 278.843 | hit correction : 1.07006
hit initial : 30.9484 | hit correction : 1.07206
hit initial : 307.806 | hit correction : 1.06989
hit initial : 146.627 | hit correction : 1.07198
hit initial : 295.297 | hit correction : 1.06956
hit initial : 185.314 | hit correction : 1.07189
hit initial : 110.667 | hit correction : 1.06952
hit initial : 49.0307 | hit correction : 1.07187
hit initial : 93.9138 | hit correction : 1.07035
hit initial : 94.5341 | hit correction : 1.07016
 *** Total Charge : 2856.02
 Looking at view: 1 | Number of hits in view: 13
hit initial : 209.778 | hit correction : 1.06939
hit initial : 213.293 | hit correction : 1.06965
hit initial : 178.656 | hit correction : 1.07036
hit initial : 269.027 | hit correction : 1.07063
hit initial : 165.121 | hit correction : 1.07082
hit initial : 142.49 | hit correction : 1.07092
hit initial : 147.267 | hit correction : 1.07095
hit initial : 155.914 | hit correction : 1.07096
hit initial : 161.814 | hit correction : 1.07097
hit initial : 147.252 | hit correction : 1.07101
hit initial : 166.328 | hit correction : 1.07108
hit initial : 232.118 | hit correction : 1.07115
hit initial : 25.8114 | hit correction : 1.07116
hit initial : 47.1374 | hit correction : 1.06811
hit initial : 28.1764 | hit correction : 1.06807
hit initial : 185.649 | hit correction : 1.0702
hit initial : 220.022 | hit correction : 1.0701
hit initial : 491.838 | hit correction : 1.06995
 *** Total Charge : 3412.09
 Looking at view: 2 | Number of hits in view: 18
12-Dec-2025 02:22:09 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0736237     0.147225      0.284312      0.114935      0.0794354       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000366174    0.0211029      0.12472     0.000633207    0.0368614       10     
end_path:ana:AnalyzeEvents         0.0729615     0.125952      0.245802      0.100487      0.0635946       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9812.14 MB
  Peak resident set size usage (VmHWM): 1538.24 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0