Jobsub ID 267996.1@dunegpschedd01.fnal.gov

Jobsub ID	267996.1@dunegpschedd01.fnal.gov
Workflow ID	11169
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-13 10:50:31
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-12-13 18:44:49
From worker node	Hostname	dunegli-8047088-0-fnpc17005.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-13 10:51:31
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T191745Z_gen_002097_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	7h (28381s)
	CPU time	7h (28010s = 98%)
	Max RSS bytes	2810138624 (2679 MiB)
Outputting started	2025-12-13 18:44:33
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11169/1/001/analysisLowE_20251213T105133Z.root
Finished	2025-12-13 18:44:49
Saved logs	justin-logs:267996.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: 0 event: 20970
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:42:47 UTC run: 5026 subRun: 0 event: 20970
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6759, 6712, 6798
minwire 0: 19
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0867888, 
Output 1: 0.0495888, 0.0706938, 0.0819912, 0.797726, 
Output 2: 0.0924971, 0.322927, 0.548457, 0.0361186, 
Output 3: 0.963697, 0.0197687, 0.00367534, 0.0128588, 
Output 4: 0.620967, 0.331541, 0.041729, 0.00576362, 
Output 5: 0.714461, 0.265518, 0.01737, 0.00265115, 
Output 6: 0.00928468, 0.0324862, 0.0508236, 0.907405, 

13-Dec-2025 18:42:52 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 18:42:52 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/0a/ab/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T191745Z_gen_002097_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1734.78       2799.05       4072.88       2666.02       798.522        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00110946    0.00589682     0.0290787    0.00151202    0.00928155       10     
reco:pandora:StandardPandora                            1732.59       2795.94        4070         2663.91       797.475        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00189323     0.0900042     0.187509      0.0829102     0.0499165       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00179991    0.00971795     0.0515192    0.00560636     0.014096        10     
reco:pandoracalo:Calorimetry                          0.000486495   0.00222746     0.0119824    0.000731112   0.00348339       10     
reco:pandorapid:Chi2ParticleID                        9.6484e-05    0.000689972   0.00490396    0.000138198   0.00141964       10     
reco:cvnmap:CVNMapper                                  0.0561833     0.108181      0.171159       0.10602      0.0335121       10     
reco:cvneva:CVNEvaluator                                1.24216       2.30474       7.85768       1.73117       1.86498        10     
reco:energyrecnumu:EnergyReco                          0.0878416     0.112974      0.145263      0.110688      0.021179        10     
reco:energyrecnue:EnergyReco                          0.00141542     0.0028323    0.00613155    0.00239642    0.00131812       10     
reco:energyrecnc:EnergyReco                           0.00764985     0.0114683     0.0170404     0.0108636    0.00301592       10     
[art]:TriggerResults:TriggerResultInserter            1.8246e-05    4.23997e-05   0.000168202   2.8709e-05    4.24353e-05      10     
end_path:out1:RootOutput                               8.319e-06    1.61652e-05   5.3902e-05     9.995e-06    1.35547e-05      10     
end_path:out1:RootOutput(write)                        0.317289      0.463116      0.771765      0.423895      0.136271        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11922.1 MB
  Peak resident set size usage (VmHWM): 2810.14 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 92.187 | hit correction : 1.26498
hit initial : 68.611 | hit correction : 1.26084
hit initial : 98.176 | hit correction : 1.26071
hit initial : 44.7143 | hit correction : 1.26069
hit initial : 83.7889 | hit correction : 1.25736
hit initial : 238.064 | hit correction : 1.25737
hit initial : 131.335 | hit correction : 1.25743
hit initial : 607.34 | hit correction : 1.25967
hit initial : 145.68 | hit correction : 1.25969
hit initial : 907.563 | hit correction : 1.25952
hit initial : 741.84 | hit correction : 1.25913
hit initial : 404.207 | hit correction : 1.25888
hit initial : 87.3312 | hit correction : 1.25877
 *** Total Charge : 5133.59
 Looking at view: 0 | Number of hits in view: 19
hit initial : 35.8728 | hit correction : 1.27484
hit initial : 41.5935 | hit correction : 1.27485
hit initial : 23.7885 | hit correction : 1.26758
hit initial : 39.5303 | hit correction : 1.26759
hit initial : 14.2261 | hit correction : 1.26761
hit initial : 139.005 | hit correction : 1.26497
hit initial : 140.67 | hit correction : 1.26496
hit initial : 30.9178 | hit correction : 1.26497
hit initial : 20.0431 | hit correction : 1.26099
hit initial : 37.5613 | hit correction : 1.26102
hit initial : 17.651 | hit correction : 1.26067
hit initial : 71.665 | hit correction : 1.26066
hit initial : 65.3493 | hit correction : 1.26065
hit initial : 116.845 | hit correction : 1.25729
hit initial : 225.296 | hit correction : 1.25735
hit initial : 141.52 | hit correction : 1.25839
hit initial : 189.188 | hit correction : 1.25744
hit initial : 174.833 | hit correction : 1.25908
hit initial : 126.499 | hit correction : 1.25823
hit initial : 70.7272 | hit correction : 1.25756
hit initial : 247.686 | hit correction : 1.25941
hit initial : 263.41 | hit correction : 1.25967
hit initial : 268.939 | hit correction : 1.25977
hit initial : 230.026 | hit correction : 1.25978
hit initial : 221.587 | hit correction : 1.25972
hit initial : 239.243 | hit correction : 1.25955
hit initial : 283.85 | hit correction : 1.25931
hit initial : 238.728 | hit correction : 1.2592
hit initial : 185.781 | hit correction : 1.25908
hit initial : 179.181 | hit correction : 1.25899
hit initial : 186.734 | hit correction : 1.25889
hit initial : 178.411 | hit correction : 1.25877
hit initial : 113.11 | hit correction : 1.25866
 *** Total Charge : 5744.36
 Looking at view: 1 | Number of hits in view: 33
hit initial : 40.7723 | hit correction : 1.27494
hit initial : 75.9646 | hit correction : 1.27488
hit initial : 20.0634 | hit correction : 1.26761
hit initial : 55.1705 | hit correction : 1.2676
hit initial : 239.03 | hit correction : 1.26497
hit initial : 22.9271 | hit correction : 1.26508
hit initial : 85.9871 | hit correction : 1.26493
hit initial : 46.3859 | hit correction : 1.261
hit initial : 27.6269 | hit correction : 1.26101
hit initial : 39.7712 | hit correction : 1.26068
hit initial : 117.894 | hit correction : 1.26067
hit initial : 156.616 | hit correction : 1.25724
hit initial : 263.713 | hit correction : 1.25737
hit initial : 276.669 | hit correction : 1.25887
hit initial : 440.975 | hit correction : 1.25784
hit initial : 177.702 | hit correction : 1.25944
hit initial : 163.769 | hit correction : 1.25962
hit initial : 209.339 | hit correction : 1.25976
hit initial : 222.985 | hit correction : 1.25979
hit initial : 193.958 | hit correction : 1.25978
hit initial : 231.92 | hit correction : 1.25972
hit initial : 190.923 | hit correction : 1.25959
hit initial : 320.179 | hit correction : 1.25931
hit initial : 211.767 | hit correction : 1.2592
hit initial : 194.891 | hit correction : 1.25907
hit initial : 157.07 | hit correction : 1.259
hit initial : 164.113 | hit correction : 1.25891
hit initial : 154.682 | hit correction : 1.25881
hit initial : 145.521 | hit correction : 1.2587
hit initial : 85.7729 | hit correction : 1.2586
 *** Total Charge : 5965.03
 Looking at view: 2 | Number of hits in view: 30
13-Dec-2025 18:44:31 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.182572      0.281774      0.441649      0.277057      0.0863419       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000713932   0.00287963     0.0212669    0.000840349    0.0061294       10     
end_path:ana:AnalyzeEvents         0.181525       0.27859      0.440717      0.265762      0.0859192       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9817.97 MB
  Peak resident set size usage (VmHWM): 1544.82 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0