Jobsub ID 267988.1@dunegpschedd01.fnal.gov

Jobsub ID	267988.1@dunegpschedd01.fnal.gov
Workflow ID	11172
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-13 10:32:38
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-12-13 17:28:16
From worker node	Hostname	dunegli-7890435-0-fnpc17109.fnal.gov
	cpuinfo	Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-13 10:33:19
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T183239Z_gen_001562_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	6h (24886s)
	CPU time	6h (24639s = 99%)
	Max RSS bytes	2846625792 (2714 MiB)
Outputting started	2025-12-13 17:28:06
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11172/1/001/analysisLowE_20251213T103320Z.root
Finished	2025-12-13 17:28:16
Saved logs	justin-logs:267988.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

m Alg0015, LArNeutrinoEventValidation, STATUS_CODE_NOT_INITIALIZED
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 17:27:04 UTC run: 5026 subRun: 0 event: 15620
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 17:27:04 UTC run: 5026 subRun: 0 event: 15620
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6861, 6779, 6710
minwire 0: 53
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2281, 2780
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.04802, 
Output 1: 0.120079, 0.225849, 0.155386, 0.498686, 
Output 2: 0.0433113, 0.137138, 0.80604, 0.0135115, 
Output 3: 0.888089, 0.0996996, 0.00735993, 0.00485119, 
Output 4: 0.874479, 0.115957, 0.00782532, 0.00173823, 
Output 5: 0.145201, 0.611023, 0.209416, 0.0343604, 
Output 6: 0.138158, 0.30592, 0.141595, 0.414327, 

13-Dec-2025 17:27:07 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 17:27:07 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/6e/a0/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T183239Z_gen_001562_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1307.95       2458.59        3663         2590.17        786.7         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000722528   0.00379157     0.0151509    0.00150261    0.00497419       10     
reco:pandora:StandardPandora                            1306.61       2455.75       3652.57        2588         785.093        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000660203    0.0688567     0.174852      0.061685      0.0494458       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000614512   0.00798976     0.0503037    0.00362018     0.0141835       10     
reco:pandoracalo:Calorimetry                          0.000387681   0.00955672     0.0780067    0.000611177    0.0231139       10     
reco:pandorapid:Chi2ParticleID                        9.8417e-05    0.000718002   0.00565448    0.000137449    0.0016473       10     
reco:cvnmap:CVNMapper                                  0.0927614     0.145493      0.195899      0.149759      0.0358302       10     
reco:cvneva:CVNEvaluator                               0.824044       1.95552       8.84792       1.25303       2.31665        10     
reco:energyrecnumu:EnergyReco                          0.0738419     0.115233      0.186017      0.115705      0.0307421       10     
reco:energyrecnue:EnergyReco                          0.00126888    0.00503302     0.0153751    0.00258191    0.00484376       10     
reco:energyrecnc:EnergyReco                           0.00791975     0.0122695     0.0165631     0.013154     0.00307077       10     
[art]:TriggerResults:TriggerResultInserter             1.308e-05    4.39636e-05   0.00020649    2.52415e-05   5.52096e-05      10     
end_path:out1:RootOutput                               5.716e-06    1.57359e-05   5.5355e-05    1.22845e-05   1.35168e-05      10     
end_path:out1:RootOutput(write)                        0.292065      0.512659       0.91614      0.530527      0.180833        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14056.8 MB
  Peak resident set size usage (VmHWM): 2846.63 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 350.727 | hit correction : 1.10361
hit initial : 169.102 | hit correction : 1.10363
hit initial : 199.487 | hit correction : 1.10428
hit initial : 256.646 | hit correction : 1.10457
hit initial : 197.803 | hit correction : 1.1048
hit initial : 120.608 | hit correction : 1.10488
 *** Total Charge : 1556.93
 Looking at view: 1 | Number of hits in view: 7
hit initial : 231.306 | hit correction : 1.10345
hit initial : 189.68 | hit correction : 1.1036
hit initial : 181.669 | hit correction : 1.10378
hit initial : 363.528 | hit correction : 1.10431
hit initial : 355.558 | hit correction : 1.10478
hit initial : 110.989 | hit correction : 1.1049
 *** Total Charge : 1581.99
 Looking at view: 2 | Number of hits in view: 6
Begin processing the 9th record. run: 5026 subRun: 0 event: 15619 at 13-Dec-2025 17:27:57 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  13
Added hit list length: 13 | Max was set to: -3.40282e+38
This pfp has size:  8
This pfp has size:  3
True Electron Energy: 23.0803
Completed MCParticle Loop
True Neutrino Energy: 30.8851
 Size of all hits: 13
hit initial : 72.0778 | hit correction : 1.01785
hit initial : 500.896 | hit correction : 1.00884
hit initial : 351.804 | hit correction : 1.00881
hit initial : 157.345 | hit correction : 1.00804
 *** Total Charge : 1092.2
 Looking at view: 0 | Number of hits in view: 4
hit initial : 59.3485 | hit correction : 1.01786
hit initial : 281.752 | hit correction : 1.00881
hit initial : 617.386 | hit correction : 1.00879
 *** Total Charge : 967.454
 Looking at view: 1 | Number of hits in view: 3
hit initial : 25.3358 | hit correction : 1.01231
hit initial : 113.775 | hit correction : 1.01786
hit initial : 175.016 | hit correction : 1.009
hit initial : 487.746 | hit correction : 1.00888
hit initial : 206.771 | hit correction : 1.00871
hit initial : 407.93 | hit correction : 1.00816
 *** Total Charge : 1429.95
 Looking at view: 2 | Number of hits in view: 6
Begin processing the 10th record. run: 5026 subRun: 0 event: 15620 at 13-Dec-2025 17:28:00 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  18
Added hit list length: 18 | Max was set to: -3.40282e+38
This pfp has size:  7
This pfp has size:  6
True Neutron Energy: 939.568
True Electron Energy: 10.7791
Completed MCParticle Loop
True Neutrino Energy: 16.1627
 Size of all hits: 18
hit initial : 166.478 | hit correction : 1.44036
hit initial : 190.223 | hit correction : 1.44051
hit initial : 76.9337 | hit correction : 1.44045
hit initial : 186.046 | hit correction : 1.44141
hit initial : 288.43 | hit correction : 1.44164
hit initial : 149.557 | hit correction : 1.44169
 *** Total Charge : 1524.22
 Looking at view: 0 | Number of hits in view: 6
hit initial : 113.652 | hit correction : 1.44036
hit initial : 280.765 | hit correction : 1.44059
hit initial : 114.847 | hit correction : 1.44062
hit initial : 207.144 | hit correction : 1.44157
hit initial : 216.772 | hit correction : 1.44167
hit initial : 73.6989 | hit correction : 1.44177
 *** Total Charge : 1451
 Looking at view: 1 | Number of hits in view: 6
hit initial : 218.805 | hit correction : 1.44034
hit initial : 25.5527 | hit correction : 1.44025
hit initial : 182.627 | hit correction : 1.44064
hit initial : 200.995 | hit correction : 1.44154
hit initial : 260.977 | hit correction : 1.44159
hit initial : 83.631 | hit correction : 1.4418
 *** Total Charge : 1401.6
 Looking at view: 2 | Number of hits in view: 6
13-Dec-2025 17:28:04 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0694112     0.296288       1.11133      0.122866      0.329882        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00036413    0.00682684     0.0372372    0.000453125    0.0116079       10     
end_path:ana:AnalyzeEvents         0.068804      0.289287       1.1107       0.121331       0.32742        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11956 MB
  Peak resident set size usage (VmHWM): 1531.99 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0