Jobsub ID 262002.1@dunegpschedd02.fnal.gov

Jobsub ID	262002.1@dunegpschedd02.fnal.gov
Workflow ID	11176
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-13 06:38:19
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-12-13 18:07:10
From worker node	Hostname	dunegli-7890611-0-fnpc9038.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-13 06:39:54
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T002638Z_gen_001488_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	11h (41222s)
	CPU time	10h (39156s = 94%)
	Max RSS bytes	2793381888 (2663 MiB)
Outputting started	2025-12-13 18:06:57
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11176/1/001/analysisLowE_20251213T063956Z.root
Finished	2025-12-13 18:07:10
Saved logs	justin-logs:262002.1-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:05:50 UTC run: 5027 subRun: 0 event: 14880
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:05:50 UTC run: 5027 subRun: 0 event: 14880
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6903, 6753, 6679
minwire 0: 23
minwire 1: 1
minwire 2: 3
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 12, 511
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.114058, 
Output 1: 0.0694028, 0.0742704, 0.118643, 0.737684, 
Output 2: 0.0388869, 0.19408, 0.750088, 0.0169449, 
Output 3: 0.972795, 0.0191408, 0.00235682, 0.00570742, 
Output 4: 0.474046, 0.43095, 0.0831604, 0.0118433, 
Output 5: 0.500259, 0.398356, 0.0856849, 0.0157, 
Output 6: 0.0166711, 0.0485403, 0.0659241, 0.868865, 

13-Dec-2025 18:05:53 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 18:05:53 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/09/08/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T002638Z_gen_001488_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2065.5        4086.87       5198.37       4656.22       1154.72        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00141634    0.00542202     0.0192738    0.00219533    0.00600316       10     
reco:pandora:StandardPandora                            2063.6        4035.6        5119.72       4587.63       1123.61        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0111751     0.123609      0.217194      0.132982      0.0657162       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00233506     0.0144071     0.0549761     0.0051619     0.0167019       10     
reco:pandoracalo:Calorimetry                          0.000596326   0.00279809    0.00900584    0.000889417   0.00312918       10     
reco:pandorapid:Chi2ParticleID                        0.000144565   0.000845314   0.00258189    0.000279179   0.000943043      10     
reco:cvnmap:CVNMapper                                  0.102506      0.228243      0.428141      0.195199       0.11261        10     
reco:cvneva:CVNEvaluator                                1.2147        3.1805        11.568        2.48732       2.83655        10     
reco:energyrecnumu:EnergyReco                          0.0878394      47.1602       73.3098       63.3855       31.0682        10     
reco:energyrecnue:EnergyReco                          0.00185734    0.00501002     0.013485     0.00418356    0.00324783       10     
reco:energyrecnc:EnergyReco                            0.0090363     0.0122463     0.0157749     0.0121292    0.00207596       10     
[art]:TriggerResults:TriggerResultInserter             2.666e-05    5.85836e-05   0.000212865   4.21565e-05   5.22163e-05      10     
end_path:out1:RootOutput                               9.009e-06    1.84347e-05   5.9887e-05    1.3835e-05    1.40933e-05      10     
end_path:out1:RootOutput(write)                        0.364888      0.540512       1.22953       0.4728       0.243501        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11904.3 MB
  Peak resident set size usage (VmHWM): 2793.38 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
True Electron Energy: 18.8287
Completed MCParticle Loop
True Neutrino Energy: 24.2177
 Size of all hits: 41
hit initial : 105.605 | hit correction : 1.10567
hit initial : 138.439 | hit correction : 1.1057
hit initial : 28.9761 | hit correction : 1.12749
hit initial : 71.6731 | hit correction : 1.12931
hit initial : 121.07 | hit correction : 1.12928
hit initial : 24.4757 | hit correction : 1.15052
hit initial : 48.6072 | hit correction : 1.15053
hit initial : 24.3533 | hit correction : 1.15054
hit initial : 79.4291 | hit correction : 1.15256
hit initial : 234.23 | hit correction : 1.15256
hit initial : 234.721 | hit correction : 1.15255
hit initial : 238.257 | hit correction : 1.1526
hit initial : 55.9408 | hit correction : 1.15266
hit initial : 297.232 | hit correction : 1.15336
hit initial : 216.684 | hit correction : 1.15374
hit initial : 48.6107 | hit correction : 1.15392
 *** Total Charge : 2252.31
 Looking at view: 0 | Number of hits in view: 16
hit initial : 140.014 | hit correction : 1.10568
hit initial : 92.7689 | hit correction : 1.10567
hit initial : 76.1702 | hit correction : 1.12932
hit initial : 103.116 | hit correction : 1.12926
hit initial : 48.7336 | hit correction : 1.15053
hit initial : 36.8096 | hit correction : 1.15051
hit initial : 96.7204 | hit correction : 1.15256
hit initial : 308.451 | hit correction : 1.15255
hit initial : 284.277 | hit correction : 1.15257
hit initial : 104.199 | hit correction : 1.15262
hit initial : 178.956 | hit correction : 1.15358
hit initial : 88.6491 | hit correction : 1.15379
 *** Total Charge : 1781.72
 Looking at view: 1 | Number of hits in view: 12
hit initial : 148.644 | hit correction : 1.10562
hit initial : 129.284 | hit correction : 1.10573
hit initial : 38.9163 | hit correction : 1.12749
hit initial : 18.4967 | hit correction : 1.12797
hit initial : 49.2971 | hit correction : 1.1294
hit initial : 176.677 | hit correction : 1.12925
hit initial : 85.5895 | hit correction : 1.15052
hit initial : 127.313 | hit correction : 1.15255
hit initial : 216.548 | hit correction : 1.15257
hit initial : 268.165 | hit correction : 1.15253
hit initial : 320.313 | hit correction : 1.1527
hit initial : 297.958 | hit correction : 1.15344
hit initial : 193.74 | hit correction : 1.15395
 *** Total Charge : 2367.56
 Looking at view: 2 | Number of hits in view: 13
Begin processing the 10th record. run: 5027 subRun: 0 event: 14880 at 13-Dec-2025 18:06:53 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  6
This pfp has size:  12
Added hit list length: 12 | Max was set to: -3.40282e+38
This pfp has size:  8
This pfp has size:  6
True Neutron Energy: 939.578
True Neutron Energy: 940.632
True Electron Energy: 33.6178
Completed MCParticle Loop
True Neutrino Energy: 49.1429
 Size of all hits: 12
hit initial : 92.887 | hit correction : 1.10628
hit initial : 50.7176 | hit correction : 1.10628
hit initial : 54.2306 | hit correction : 1.1056
hit initial : 18.3235 | hit correction : 1.10558
 *** Total Charge : 239.083
 Looking at view: 0 | Number of hits in view: 4
hit initial : 26.135 | hit correction : 1.11836
hit initial : 40.2797 | hit correction : 1.10629
hit initial : 95.3269 | hit correction : 1.10628
hit initial : 64.4134 | hit correction : 1.10168
 *** Total Charge : 250.211
 Looking at view: 1 | Number of hits in view: 4
hit initial : 41.6632 | hit correction : 1.11834
hit initial : 169.496 | hit correction : 1.10628
hit initial : 22.7441 | hit correction : 1.10548
hit initial : 37.0657 | hit correction : 1.10164
 *** Total Charge : 300.08
 Looking at view: 2 | Number of hits in view: 4
13-Dec-2025 18:06:57 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0925248      0.11766       0.19234       0.10945      0.0265459       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000554644    0.0031759     0.013558     0.000630301   0.00506024       10     
end_path:ana:AnalyzeEvents         0.0917541     0.114228      0.178385      0.108653      0.0236967       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9810.85 MB
  Peak resident set size usage (VmHWM): 1539.49 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0