Jobsub ID 268034.1@dunegpschedd01.fnal.gov

Jobsub ID	268034.1@dunegpschedd01.fnal.gov
Workflow ID	11176
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-13 12:44:38
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-12-13 20:23:09
From worker node	Hostname	dunegli-8047072-0-fnpc9021.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-13 12:45:23
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T225501Z_gen_000883_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	7h (27453s)
	CPU time	7h (27171s = 98%)
	Max RSS bytes	2799054848 (2669 MiB)
Outputting started	2025-12-13 20:22:56
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11176/1/001/analysisLowE_20251213T124524Z.root
Finished	2025-12-13 20:23:09
Saved logs	justin-logs:268034.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

830
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 20:21:58 UTC run: 5027 subRun: 0 event: 8830
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 20:21:58 UTC run: 5027 subRun: 0 event: 8830
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 7012, 6905, 6865
minwire 0: 14
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 514, 1013
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0984458, 
Output 1: 0.0494114, 0.0546227, 0.103704, 0.792262, 
Output 2: 0.0507397, 0.226257, 0.700105, 0.0228991, 
Output 3: 0.953687, 0.0375412, 0.00376599, 0.00500532, 
Output 4: 0.256221, 0.619686, 0.11446, 0.00963279, 
Output 5: 0.628012, 0.293122, 0.0644698, 0.0143955, 
Output 6: 0.0275906, 0.0869414, 0.0976066, 0.787861, 

13-Dec-2025 20:22:01 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 20:22:01 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/10/1a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T225501Z_gen_000883_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1715.03       2717.43       3860.4        2671.11       753.935        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000872876    0.0067423     0.0256071    0.00175784    0.00867591       10     
reco:pandora:StandardPandora                            1713.36       2707.49       3779.15       2668.96       741.978        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00355235     0.0772678     0.193043      0.0733809     0.0516325       10     
reco:pandoraShower:LArPandoraModularShowerCreation     0.0016304     0.0282626     0.182184     0.00829968     0.0525997       10     
reco:pandoracalo:Calorimetry                          0.000381143   0.00171093     0.0117972    0.000552726   0.00336905       10     
reco:pandorapid:Chi2ParticleID                        0.000100239   0.000604155   0.00479153    0.000121595   0.00139624       10     
reco:cvnmap:CVNMapper                                  0.0653393     0.111024      0.190919      0.0976312     0.039793        10     
reco:cvneva:CVNEvaluator                                1.10344       2.0781        8.82519       1.3806        2.25541        10     
reco:energyrecnumu:EnergyReco                          0.0748417       7.213        71.3242      0.0920681      21.3704        10     
reco:energyrecnue:EnergyReco                          0.00158897    0.00271898    0.00567522    0.00241416    0.00115331       10     
reco:energyrecnc:EnergyReco                           0.00869314     0.0109236     0.0137882     0.0108938    0.00166511       10     
[art]:TriggerResults:TriggerResultInserter            2.0006e-05    4.30402e-05   0.00017294    3.2776e-05    4.3706e-05       10     
end_path:out1:RootOutput                               6.311e-06    1.49886e-05   4.9538e-05    1.1978e-05    1.1884e-05       10     
end_path:out1:RootOutput(write)                        0.348837      0.414468      0.636533      0.400538      0.0817372       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11908.8 MB
  Peak resident set size usage (VmHWM): 2799.05 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 *** Total Charge : 1612.43
 Looking at view: 1 | Number of hits in view: 6
hit initial : 52.4751 | hit correction : 1.02785
hit initial : 30.9683 | hit correction : 1.02025
hit initial : 92.6534 | hit correction : 1.02039
hit initial : 265.45 | hit correction : 1.01896
hit initial : 179.718 | hit correction : 1.01889
hit initial : 486.16 | hit correction : 1.01868
hit initial : 227.262 | hit correction : 1.0184
hit initial : 411.922 | hit correction : 1.0184
hit initial : 208.499 | hit correction : 1.01836
hit initial : 143.539 | hit correction : 1.01855
 *** Total Charge : 2138.39
 Looking at view: 2 | Number of hits in view: 10
Begin processing the 9th record. run: 5027 subRun: 0 event: 8829 at 13-Dec-2025 20:22:48 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  7
This pfp has size:  10
Added hit list length: 10 | Max was set to: -3.40282e+38
This pfp has size:  10
This pfp has size:  9
True Electron Energy: 6.09836
Completed MCParticle Loop
True Neutrino Energy: 11.4766
 Size of all hits: 10
hit initial : 64.3354 | hit correction : 1.07969
hit initial : 261.85 | hit correction : 1.07977
hit initial : 254.883 | hit correction : 1.0799
hit initial : 118.958 | hit correction : 1.07992
 *** Total Charge : 755.913
 Looking at view: 0 | Number of hits in view: 4
hit initial : 282.683 | hit correction : 1.0798
hit initial : 316.761 | hit correction : 1.07987
 *** Total Charge : 647.302
 Looking at view: 1 | Number of hits in view: 2
hit initial : 25.2924 | hit correction : 1.07975
hit initial : 400.986 | hit correction : 1.07975
hit initial : 160.963 | hit correction : 1.07992
hit initial : 142.421 | hit correction : 1.07991
 *** Total Charge : 787.903
 Looking at view: 2 | Number of hits in view: 4
Begin processing the 10th record. run: 5027 subRun: 0 event: 8830 at 13-Dec-2025 20:22:52 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  6
This pfp has size:  21
Added hit list length: 21 | Max was set to: -3.40282e+38
This pfp has size:  6
This pfp has size:  6
True Neutron Energy: 939.57
True Neutron Energy: 942.407
True Neutron Energy: 940.799
True Electron Energy: 15.7872
Completed MCParticle Loop
True Neutrino Energy: 43.2905
 Size of all hits: 21
hit initial : 157.424 | hit correction : 1.10933
hit initial : 241.81 | hit correction : 1.1092
hit initial : 278.695 | hit correction : 1.10877
hit initial : 234.374 | hit correction : 1.10876
hit initial : 288.311 | hit correction : 1.1092
hit initial : 333.046 | hit correction : 1.10938
hit initial : 277.798 | hit correction : 1.1096
hit initial : 195.797 | hit correction : 1.10982
 *** Total Charge : 2226.54
 Looking at view: 0 | Number of hits in view: 8
hit initial : 393.603 | hit correction : 1.10912
hit initial : 42.7687 | hit correction : 1.10927
hit initial : 71.3297 | hit correction : 1.10862
hit initial : 368.747 | hit correction : 1.10917
hit initial : 374.534 | hit correction : 1.10942
hit initial : 319.009 | hit correction : 1.10968
hit initial : 142.661 | hit correction : 1.10982
 *** Total Charge : 1899.92
 Looking at view: 1 | Number of hits in view: 7
hit initial : 77.9299 | hit correction : 1.10937
hit initial : 256.635 | hit correction : 1.10903
hit initial : 203.433 | hit correction : 1.10933
hit initial : 634.248 | hit correction : 1.10882
hit initial : 875.616 | hit correction : 1.10949
hit initial : 91.1484 | hit correction : 1.10985
 *** Total Charge : 2372.67
 Looking at view: 2 | Number of hits in view: 6
13-Dec-2025 20:22:56 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0911384     0.117561      0.221729       0.10774      0.0354219       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000405191   0.000559272    0.0014334    0.000469173   0.000294554      10     
end_path:ana:AnalyzeEvents         0.0906064     0.116813      0.219807       0.10712      0.0350323       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9810.23 MB
  Peak resident set size usage (VmHWM): 1535.88 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0