Jobsub ID 261359.1@dunegpschedd02.fnal.gov

Jobsub ID	261359.1@dunegpschedd02.fnal.gov
Workflow ID	11108
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-11 23:46:43
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-12-12 04:05:33
From worker node	Hostname	dunegli-7876355-0-fnpc9028.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-11 23:48:00
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T010204Z_gen_002886_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	4h (15440s)
	CPU time	4h (15338s = 99%)
	Max RSS bytes	2955980800 (2819 MiB)
Outputting started	2025-12-12 04:05:21
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11108/1/001/analysisLowE_20251211T234801Z.root
Finished	2025-12-12 04:05:33
Saved logs	justin-logs:261359.1-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

t 2: 0.0349924, 0.16677, 0.765868, 0.0323701, 
Output 3: 0.940269, 0.0427662, 0.00965903, 0.0073062, 
Output 4: 0.638604, 0.301875, 0.0515966, 0.00792429, 
Output 5: 0.281079, 0.368885, 0.276607, 0.0734292, 
Output 6: 0.0726848, 0.138627, 0.110097, 0.678592, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 28860 at 12-Dec-2025 03:39:45 UTC
Error: A CaloHitList is empty
Error: A CaloHitList is empty
Boundary wire vector sizes: 6677, 6720, 6663
minwire 0: 26
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2149, 2648
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.125069, 
Output 1: 0.0797501, 0.0557929, 0.1013, 0.763157, 
Output 2: 0.0612624, 0.184093, 0.727486, 0.027159, 
Output 3: 0.981077, 0.00911876, 0.0014234, 0.00838118, 
Output 4: 0.478533, 0.463974, 0.0505971, 0.00689646, 
Output 5: 0.456516, 0.407404, 0.106225, 0.0298553, 
Output 6: 0.0279635, 0.06557, 0.0769007, 0.829566, 

12-Dec-2025 04:04:19 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 04:04:19 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/25/f5/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T010204Z_gen_002886_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1448.17       1521.5        1627.23       1504.21       61.8101        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00128686    0.00751987     0.0228454    0.00539018    0.00622182       10     
reco:pandora:StandardPandora                            1446.58       1519.46       1625.35       1502.63       61.4012        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00131997     0.0199903      0.10652      0.0100896     0.029962        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00135141    0.00795926     0.0184447    0.00460993    0.00645935       10     
reco:pandoracalo:Calorimetry                          0.00019916    0.00396482     0.026012     0.00041201    0.00761511       10     
reco:pandorapid:Chi2ParticleID                        5.8194e-05    0.000285873   0.00100554    0.000102167   0.000326126      10     
reco:cvnmap:CVNMapper                                  0.035847      0.0441879     0.0846121     0.0394389     0.013771        10     
reco:cvneva:CVNEvaluator                                1.04613       1.4767        5.12178       1.07003       1.21519        10     
reco:energyrecnumu:EnergyReco                         0.00561112     0.0419335     0.134063      0.0156907     0.0427496       10     
reco:energyrecnue:EnergyReco                          0.00105776    0.00450514     0.0124847    0.00144056    0.00418642       10     
reco:energyrecnc:EnergyReco                           0.00788056     0.0532069     0.0963503     0.072125      0.0366871       10     
[art]:TriggerResults:TriggerResultInserter            1.4716e-05    2.59337e-05   0.00010581    1.7486e-05    2.66689e-05      10     
end_path:out1:RootOutput                               5.533e-06    8.4964e-06    3.1425e-05     5.978e-06    7.64538e-06      10     
end_path:out1:RootOutput(write)                        0.345443      0.378992      0.573964      0.352826      0.066253        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12024.6 MB
  Peak resident set size usage (VmHWM): 2955.98 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 88.475 | hit correction : 1.43644
hit initial : 191.949 | hit correction : 1.43648
hit initial : 221.096 | hit correction : 1.43642
hit initial : 232.243 | hit correction : 1.43594
hit initial : 146.874 | hit correction : 1.43562
hit initial : 120.922 | hit correction : 1.43462
hit initial : 156.515 | hit correction : 1.43472
 *** Total Charge : 3022.94
 Looking at view: 0 | Number of hits in view: 12
hit initial : 36.1631 | hit correction : 1.43651
hit initial : 27.1199 | hit correction : 1.43619
hit initial : 77.3225 | hit correction : 1.43618
hit initial : 34.038 | hit correction : 1.43643
 *** Total Charge : 250.84
 Looking at view: 1 | Number of hits in view: 4
hit initial : 79.3641 | hit correction : 1.43621
hit initial : 119.115 | hit correction : 1.43615
hit initial : 236.56 | hit correction : 1.43647
hit initial : 177.121 | hit correction : 1.43647
hit initial : 171.857 | hit correction : 1.43607
hit initial : 167.126 | hit correction : 1.43565
hit initial : 153.432 | hit correction : 1.43503
hit initial : 123.42 | hit correction : 1.43451
hit initial : 43.4242 | hit correction : 1.43422
hit initial : 30.1988 | hit correction : 1.43643
hit initial : 53.702 | hit correction : 1.4365
 *** Total Charge : 1946.05
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 7th record. run: 5027 subRun: 0 event: 28857 at 12-Dec-2025 04:05:05 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 16.1086
Completed MCParticle Loop
True Neutrino Energy: 21.6154
 Size of all hits: 0
Begin processing the 8th record. run: 5027 subRun: 0 event: 28858 at 12-Dec-2025 04:05:09 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 18.6692
Completed MCParticle Loop
True Neutrino Energy: 22.4008
 Size of all hits: 0
Begin processing the 9th record. run: 5027 subRun: 0 event: 28859 at 12-Dec-2025 04:05:13 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  18
Added hit list length: 18 | Max was set to: -3.40282e+38
This pfp has size:  16
True Electron Energy: 31.7255
Completed MCParticle Loop
True Neutrino Energy: 37.1508
 Size of all hits: 18
hit initial : 189.122 | hit correction : 1.2956
hit initial : 386.924 | hit correction : 1.2956
hit initial : 64.4932 | hit correction : 1.29559
hit initial : 304.141 | hit correction : 1.29649
hit initial : 892.414 | hit correction : 1.29656
hit initial : 218.732 | hit correction : 1.29667
 *** Total Charge : 2664.89
 Looking at view: 1 | Number of hits in view: 6
hit initial : 198.26 | hit correction : 1.29773
hit initial : 217.103 | hit correction : 1.2972
hit initial : 163.987 | hit correction : 1.29682
hit initial : 329.946 | hit correction : 1.29669
hit initial : 213.046 | hit correction : 1.29652
hit initial : 174.348 | hit correction : 1.29631
hit initial : 173.674 | hit correction : 1.29603
hit initial : 201.682 | hit correction : 1.29579
hit initial : 290.895 | hit correction : 1.29566
hit initial : 158.825 | hit correction : 1.29554
hit initial : 150.578 | hit correction : 1.29543
hit initial : 68.7141 | hit correction : 1.2954
 *** Total Charge : 3034.81
 Looking at view: 2 | Number of hits in view: 12
Begin processing the 10th record. run: 5027 subRun: 0 event: 28860 at 12-Dec-2025 04:05:17 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.571
True Electron Energy: 22.4672
Completed MCParticle Loop
True Neutrino Energy: 35.0697
 Size of all hits: 0
12-Dec-2025 04:05:20 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0717787     0.140501      0.195317      0.156166      0.0500621       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000347095   0.00475098     0.0184811    0.000497518   0.00610084       10     
end_path:ana:AnalyzeEvents         0.0712418     0.135592       0.19365      0.147112      0.0486566       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9817.55 MB
  Peak resident set size usage (VmHWM): 1544.64 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0