Jobsub ID 259793.0@dunegpschedd02.fnal.gov

Jobsub ID	259793.0@dunegpschedd02.fnal.gov
Workflow ID	11088
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-09 18:28:02
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-12-11 01:00:59
From worker node	Hostname	dunegli-7872308-0-fnpc9069.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-10 13:53:09
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213709Z_gen_004368_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	11h (40016s)
	CPU time	10h (39456s = 98%)
	Max RSS bytes	3041415168 (2900 MiB)
Outputting started	2025-12-11 01:00:05
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11088/1/001/analysisLowE_20251210T135310Z.root
Finished	2025-12-11 01:00:59
Saved logs	justin-logs:259793.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.128568, 
Output 1: 0.159047, 0.0861186, 0.240054, 0.514781, 
Output 2: 0.0362961, 0.0969151, 0.846142, 0.0206465, 
Output 3: 0.968845, 0.0208268, 0.00353284, 0.00679486, 
Output 4: 0.64308, 0.315886, 0.0341979, 0.00683649, 
Output 5: 0.23068, 0.387071, 0.279497, 0.102752, 
Output 6: 0.0947198, 0.157152, 0.106648, 0.64148, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 43680 at 10-Dec-2025 23:47:04 UTC
Boundary wire vector sizes: 6607, 6700, 6542
minwire 0: 34
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.113806, 
Output 1: 0.0527637, 0.0673836, 0.136436, 0.743417, 
Output 2: 0.0368373, 0.212848, 0.73052, 0.0197944, 
Output 3: 0.952144, 0.0298584, 0.00686832, 0.0111296, 
Output 4: 0.441557, 0.446499, 0.0989578, 0.0129862, 
Output 5: 0.407814, 0.491497, 0.0904481, 0.01024, 
Output 6: 0.0166158, 0.0466816, 0.0632755, 0.873427, 

11-Dec-2025 00:58:12 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 00:58:13 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/5f/46/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213709Z_gen_004368_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3487.97       3962.92       4629.38       3802.63       390.868        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0100625     0.0497755      0.3367       0.0168771     0.0958741       10     
reco:pandora:StandardPandora                            3485.57       3959.45       4627.04       3799.61       391.26         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000586955    0.0429977     0.325586     0.00913515     0.094901        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000539872    0.0112879     0.0333348     0.0114605    0.00921865       10     
reco:pandoracalo:Calorimetry                          0.000648127    0.0194257     0.084588      0.0011882     0.0309392       10     
reco:pandorapid:Chi2ParticleID                        0.000114881   0.000626319   0.00361898    0.000223466   0.00101466       10     
reco:cvnmap:CVNMapper                                  0.105674      0.117081      0.138889      0.112663      0.0114513       10     
reco:cvneva:CVNEvaluator                                1.4046        2.51349       8.23781       2.0956        1.9368         10     
reco:energyrecnumu:EnergyReco                         0.00628559     0.0845239     0.163133      0.0935558     0.0593458       10     
reco:energyrecnue:EnergyReco                          0.00249166    0.00847044     0.0154312    0.00845098    0.00511866       10     
reco:energyrecnc:EnergyReco                             0.01176      0.0761204     0.174932      0.0582292     0.0649765       10     
[art]:TriggerResults:TriggerResultInserter            2.8528e-05    5.46011e-05   0.000203873   3.74445e-05   5.03223e-05      10     
end_path:out1:RootOutput                              1.0675e-05    1.95772e-05   5.5057e-05    1.6346e-05    1.22028e-05      10     
end_path:out1:RootOutput(write)                        0.410466      0.549631      0.673324      0.579479      0.0944929       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12114.2 MB
  Peak resident set size usage (VmHWM): 3041.42 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 267.854 | hit correction : 1.2383
hit initial : 228.44 | hit correction : 1.23899
hit initial : 20.3975 | hit correction : 1.2392
hit initial : 156.589 | hit correction : 1.23739
 *** Total Charge : 1645.14
 Looking at view: 2 | Number of hits in view: 7
Begin processing the 6th record. run: 5026 subRun: 0 event: 43676 at 11-Dec-2025 00:59:34 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.565
True Electron Energy: 3.69699
Completed MCParticle Loop
True Neutrino Energy: 9.07564
 Size of all hits: 0
Begin processing the 7th record. run: 5026 subRun: 0 event: 43677 at 11-Dec-2025 00:59:40 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 7.90461
Completed MCParticle Loop
True Neutrino Energy: 11.629
 Size of all hits: 0
Begin processing the 8th record. run: 5026 subRun: 0 event: 43678 at 11-Dec-2025 00:59:46 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 5.89259
Completed MCParticle Loop
True Neutrino Energy: 9.61882
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 43679 at 11-Dec-2025 00:59:53 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 6.17955
Completed MCParticle Loop
True Neutrino Energy: 9.90663
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 43680 at 11-Dec-2025 00:59:59 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  31
Added hit list length: 31 | Max was set to: -3.40282e+38
True Neutron Energy: 939.579
True Electron Energy: 24.4841
Completed MCParticle Loop
True Neutrino Energy: 39.9868
 Size of all hits: 31
hit initial : 63.2133 | hit correction : 1.2315
hit initial : 73.6411 | hit correction : 1.23355
hit initial : 222.247 | hit correction : 1.23362
hit initial : 277.376 | hit correction : 1.23403
hit initial : 191.753 | hit correction : 1.23461
hit initial : 205.018 | hit correction : 1.23466
hit initial : 201.043 | hit correction : 1.23469
hit initial : 210.693 | hit correction : 1.23487
hit initial : 310.99 | hit correction : 1.2356
hit initial : 323.635 | hit correction : 1.23631
hit initial : 197.886 | hit correction : 1.23691
hit initial : 71.4331 | hit correction : 1.23725
 *** Total Charge : 2900.94
 Looking at view: 0 | Number of hits in view: 12
hit initial : 48.7374 | hit correction : 1.23724
hit initial : 85.5481 | hit correction : 1.2348
hit initial : 51.1551 | hit correction : 1.23462
hit initial : 54.3758 | hit correction : 1.23433
hit initial : 171.837 | hit correction : 1.23359
hit initial : 79.4222 | hit correction : 1.23366
hit initial : 280.744 | hit correction : 1.23464
hit initial : 253.052 | hit correction : 1.23471
hit initial : 242.458 | hit correction : 1.23564
hit initial : 430.385 | hit correction : 1.23625
hit initial : 204.044 | hit correction : 1.23649
 *** Total Charge : 2349.18
 Looking at view: 1 | Number of hits in view: 11
hit initial : 46.4776 | hit correction : 1.23354
hit initial : 179.777 | hit correction : 1.23717
hit initial : 424.098 | hit correction : 1.23371
hit initial : 330.262 | hit correction : 1.23458
hit initial : 267.117 | hit correction : 1.23465
hit initial : 206.548 | hit correction : 1.23478
hit initial : 359.192 | hit correction : 1.23548
hit initial : 396.992 | hit correction : 1.23644
 *** Total Charge : 2730.17
 Looking at view: 2 | Number of hits in view: 8
11-Dec-2025 01:00:04 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0927415     0.160261       0.29763      0.152405      0.0569141       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00102492    0.00949314     0.0288197     0.0014297     0.0104889       10     
end_path:ana:AnalyzeEvents         0.0911539     0.150321      0.273594      0.143034      0.0528254       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9808.37 MB
  Peak resident set size usage (VmHWM): 1533.29 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0