Jobsub ID 249054.0@dunegpschedd02.fnal.gov

Jobsub ID	249054.0@dunegpschedd02.fnal.gov
Workflow ID	10411
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-21 00:11:43
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-11-21 11:05:49
From worker node	Hostname	dunegli-7833861-0-fnpc22006.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-21 06:59:10
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T234123Z_gen_004301_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	4h (14782s)
	CPU time	4h (14535s = 98%)
	Max RSS bytes	3052392448 (2910 MiB)
Outputting started	2025-11-21 11:05:33
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/10411/1/001/analysisLowE_20251121T065911Z.root
Finished	2025-11-21 11:05:49
Saved logs	justin-logs:249054.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ov-2025 11:04:34 UTC run: 3799 subRun: 0 event: 43010
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  21-Nov-2025 11:04:34 UTC run: 3799 subRun: 0 event: 43010
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6812, 6754, 6780
minwire 0: 45
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1524, 2023
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0878433, 
Output 1: 0.0564148, 0.120545, 0.117212, 0.705829, 
Output 2: 0.0450121, 0.272091, 0.654501, 0.0283967, 
Output 3: 0.960792, 0.0258696, 0.00447186, 0.00886625, 
Output 4: 0.581692, 0.361441, 0.0514816, 0.00538469, 
Output 5: 0.740881, 0.213087, 0.0377031, 0.0083289, 
Output 6: 0.0126814, 0.0371888, 0.0528705, 0.897259, 

21-Nov-2025 11:04:38 UTC  Closed output file "matt_reco2.root"
21-Nov-2025 11:04:38 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d9/49/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T234123Z_gen_004301_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                               1288         1460.07       1731.71       1433.94       114.427        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00155926    0.00934052     0.019297     0.00927058    0.00500222       10     
reco:pandora:StandardPandora                            1285.83       1457.75       1729.59       1430.89       114.473        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00384907     0.0310056     0.0849468     0.0116709     0.029787        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00586249    0.00872568     0.0197563    0.00772229    0.00382581       10     
reco:pandoracalo:Calorimetry                          0.00059765    0.00823849     0.0497298    0.000703139    0.0153885       10     
reco:pandorapid:Chi2ParticleID                        9.1353e-05    0.000364405    0.0019718    0.00019049    0.000540663      10     
reco:cvnmap:CVNMapper                                  0.0325029     0.0486236     0.0682099     0.0450555     0.0136774       10     
reco:cvneva:CVNEvaluator                                1.43016       1.64895       3.14044       1.44634      0.501508        10     
reco:energyrecnumu:EnergyReco                         0.00589647     0.0685634     0.149517      0.0934796      0.05247        10     
reco:energyrecnue:EnergyReco                          0.00128311    0.00364988     0.0113763    0.00163718    0.00382854       10     
reco:energyrecnc:EnergyReco                           0.00936541     0.0441066     0.0972027     0.0112109     0.041643        10     
[art]:TriggerResults:TriggerResultInserter            1.8886e-05    3.89184e-05   0.000101532   2.9846e-05    2.3566e-05       10     
end_path:out1:RootOutput                               1.038e-05    1.67998e-05   4.4103e-05    1.35955e-05   9.34449e-06      10     
end_path:out1:RootOutput(write)                        0.412632      0.447032      0.525985       0.43679      0.030589        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21785.7 MB
  Peak resident set size usage (VmHWM): 3052.39 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 192.491 | hit correction : 1.44475
hit initial : 188.071 | hit correction : 1.44407
hit initial : 93.4594 | hit correction : 1.4438
 *** Total Charge : 3498.2
 Looking at view: 2 | Number of hits in view: 13
Begin processing the 9th record. run: 3799 subRun: 0 event: 43009 at 21-Nov-2025 11:05:26 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  14
Added hit list length: 14 | Max was set to: -3.40282e+38
True Electron Energy: 10.6207
Completed MCParticle Loop
True Neutrino Energy: 13.9111
 Size of all hits: 14
hit initial : 111.38 | hit correction : 1.08669
hit initial : 139.519 | hit correction : 1.08707
hit initial : 210.694 | hit correction : 1.08663
hit initial : 220.091 | hit correction : 1.08713
hit initial : 100.36 | hit correction : 1.08665
hit initial : 219.855 | hit correction : 1.08714
hit initial : 172.161 | hit correction : 1.08714
hit initial : 65.5257 | hit correction : 1.08712
 *** Total Charge : 1347.38
 Looking at view: 1 | Number of hits in view: 8
hit initial : 221.503 | hit correction : 1.08664
hit initial : 183.57 | hit correction : 1.08664
hit initial : 55.4396 | hit correction : 1.0871
hit initial : 261.552 | hit correction : 1.08709
hit initial : 353.097 | hit correction : 1.08713
hit initial : 170.677 | hit correction : 1.08715
 *** Total Charge : 1354.18
 Looking at view: 2 | Number of hits in view: 6
Begin processing the 10th record. run: 3799 subRun: 0 event: 43010 at 21-Nov-2025 11:05:29 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  34
Added hit list length: 34 | Max was set to: -3.40282e+38
True Neutron Energy: 939.566
True Electron Energy: 27.3088
Completed MCParticle Loop
True Neutrino Energy: 32.7166
 Size of all hits: 34
hit initial : 184.364 | hit correction : 1.35269
hit initial : 165.202 | hit correction : 1.35278
hit initial : 119.238 | hit correction : 1.3243
hit initial : 44.2802 | hit correction : 1.32423
hit initial : 272.85 | hit correction : 1.32305
hit initial : 43.5012 | hit correction : 1.32439
hit initial : 148.996 | hit correction : 1.32435
hit initial : 59.424 | hit correction : 1.3245
hit initial : 219.331 | hit correction : 1.32451
hit initial : 375.257 | hit correction : 1.32442
hit initial : 418.078 | hit correction : 1.32396
hit initial : 406.461 | hit correction : 1.32337
 *** Total Charge : 3262.97
 Looking at view: 0 | Number of hits in view: 12
hit initial : 100.682 | hit correction : 1.32454
hit initial : 353.459 | hit correction : 1.32448
hit initial : 329.288 | hit correction : 1.32315
hit initial : 191.866 | hit correction : 1.32297
hit initial : 452.368 | hit correction : 1.32423
hit initial : 385.562 | hit correction : 1.32365
 *** Total Charge : 2400.42
 Looking at view: 1 | Number of hits in view: 6
hit initial : 34.5655 | hit correction : 1.3244
hit initial : 182.146 | hit correction : 1.32451
hit initial : 224.166 | hit correction : 1.3246
hit initial : 119.725 | hit correction : 1.32352
hit initial : 126.651 | hit correction : 1.32333
hit initial : 154.163 | hit correction : 1.32314
hit initial : 144.324 | hit correction : 1.32303
hit initial : 114.171 | hit correction : 1.32286
hit initial : 35.7655 | hit correction : 1.32145
hit initial : 70.4805 | hit correction : 1.32277
hit initial : 109.551 | hit correction : 1.32147
hit initial : 148.092 | hit correction : 1.32444
hit initial : 133.418 | hit correction : 1.32422
hit initial : 154.283 | hit correction : 1.32402
hit initial : 130.065 | hit correction : 1.32385
hit initial : 114.014 | hit correction : 1.32369
 *** Total Charge : 2641.43
 Looking at view: 2 | Number of hits in view: 16
21-Nov-2025 11:05:32 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0622086     0.0982672     0.151977      0.101912      0.0264574       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000426226   0.00068761    0.00169682    0.000581944   0.000343533      10     
end_path:ana:AnalyzeEvents         0.0613134     0.0972759     0.149222      0.101167      0.0260691       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19480.1 MB
  Peak resident set size usage (VmHWM): 1535.14 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0