justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266792.0@dunegpschedd01.fnal.gov

Jobsub ID266792.0@dunegpschedd01.fnal.gov
Workflow ID11087
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 13:34:10
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 16:49:42
From worker nodeHostnamedunegli-7872540-0-fnpc22014.fnal.gov
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 13:35:53
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T215124Z_gen_004473_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (11616s)
CPU time3h (11421s = 98%)
Max RSS bytes3042095104 (2901 MiB)
Outputting started2025-12-11 16:49:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11087/1/001/analysisLowE_20251211T133554Z.root
Finished2025-12-11 16:49:42
Saved logsjustin-logs:266792.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

oraShower@BeginModule  11-Dec-2025 16:48:58 UTC run: 5026 subRun: 0 event: 44730
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 16:48:58 UTC run: 5026 subRun: 0 event: 44730
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6803, 6688, 6608
minwire 0: 32
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1299, 1798
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.134905, 
Output 1: 0.076472, 0.0397655, 0.0823813, 0.801381, 
Output 2: 0.123811, 0.158112, 0.692654, 0.0254228, 
Output 3: 0.990183, 0.0066213, 0.000305884, 0.00289004, 
Output 4: 0.287346, 0.674547, 0.0347898, 0.00331695, 
Output 5: 0.358159, 0.495211, 0.106828, 0.0398023, 
Output 6: 0.0422112, 0.102783, 0.104296, 0.75071, 

11-Dec-2025 16:49:00 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 16:49:00 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/38/03/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T215124Z_gen_004473_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              726.498       1147.67       3770.16       844.995       877.523        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00232395    0.00940792     0.0265986    0.00676324    0.00713729       10     
reco:pandora:StandardPandora                            725.426       1139.61        3700         843.857        856.9         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000305868    0.0307647     0.171857     0.00827571     0.0503811       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000537957   0.00327307    0.00890292    0.00149237    0.00305246       10     
reco:pandoracalo:Calorimetry                          0.000115439   0.00423989     0.026657     0.000379808   0.00804701       10     
reco:pandorapid:Chi2ParticleID                        3.5657e-05    0.000228436   0.000764615   8.5983e-05    0.000274084      10     
reco:cvnmap:CVNMapper                                  0.0217258      0.03201      0.0601428     0.0289696    0.00998006       10     
reco:cvneva:CVNEvaluator                               0.776272       1.05578       3.32905      0.809381      0.758036        10     
reco:energyrecnumu:EnergyReco                         0.00269171      6.65109       66.2606      0.0237846      19.8698        10     
reco:energyrecnue:EnergyReco                          0.000882909   0.00203456    0.00560435    0.000992225   0.00178652       10     
reco:energyrecnc:EnergyReco                           0.00514163     0.0330482     0.0629126     0.0316151     0.0277228       10     
[art]:TriggerResults:TriggerResultInserter            1.1422e-05    2.2806e-05    0.00010065    1.44475e-05   2.59935e-05      10     
end_path:out1:RootOutput                               8.686e-06    1.4294e-05    3.8392e-05    1.20125e-05   8.11922e-06      10     
end_path:out1:RootOutput(write)                         0.22188      0.233342      0.297471      0.226905      0.0214587       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38949.7 MB
  Peak resident set size usage (VmHWM): 3042.1 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 341.253 | hit correction : 1.38976
hit initial : 121.073 | hit correction : 1.38973
 *** Total Charge : 1967.34
 Looking at view: 0 | Number of hits in view: 9
hit initial : 70.0001 | hit correction : 1.38974
hit initial : 80.7162 | hit correction : 1.39074
hit initial : 310.878 | hit correction : 1.38978
hit initial : 168.605 | hit correction : 1.39076
hit initial : 412.725 | hit correction : 1.38981
hit initial : 89.2428 | hit correction : 1.39072
hit initial : 82.2548 | hit correction : 1.38967
hit initial : 228.773 | hit correction : 1.38972
 *** Total Charge : 2006.04
 Looking at view: 1 | Number of hits in view: 8
hit initial : 88.0879 | hit correction : 1.39048
hit initial : 157.279 | hit correction : 1.39086
hit initial : 183.121 | hit correction : 1.39018
hit initial : 39.1882 | hit correction : 1.39085
hit initial : 252.474 | hit correction : 1.38987
hit initial : 483.038 | hit correction : 1.3897
hit initial : 218.571 | hit correction : 1.38965
hit initial : 19.6243 | hit correction : 1.38965
 *** Total Charge : 2003.5
 Looking at view: 2 | Number of hits in view: 8
Begin processing the 8th record. run: 5026 subRun: 0 event: 44728 at 11-Dec-2025 16:49:23 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 25.4953
Completed MCParticle Loop
True Neutrino Energy: 32.6192
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 44729 at 11-Dec-2025 16:49:25 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  27
Added hit list length: 27 | Max was set to: -3.40282e+38
True Electron Energy: 11.1924
Completed MCParticle Loop
True Neutrino Energy: 16.57
 Size of all hits: 27
hit initial : 73.8607 | hit correction : 1.13395
hit initial : 106.954 | hit correction : 1.13397
hit initial : 14.9158 | hit correction : 1.13293
hit initial : 27.6803 | hit correction : 1.13393
hit initial : 11.0256 | hit correction : 1.13291
hit initial : 96.5454 | hit correction : 1.13223
hit initial : 201.077 | hit correction : 1.13173
hit initial : 565.334 | hit correction : 1.1319
hit initial : 212.131 | hit correction : 1.13193
 *** Total Charge : 1482.71
 Looking at view: 0 | Number of hits in view: 9
hit initial : 64.6997 | hit correction : 1.13396
hit initial : 112.682 | hit correction : 1.13395
hit initial : 29.151 | hit correction : 1.1323
hit initial : 120.168 | hit correction : 1.13223
hit initial : 234.59 | hit correction : 1.13211
hit initial : 304.138 | hit correction : 1.13167
hit initial : 148.027 | hit correction : 1.13154
hit initial : 334.79 | hit correction : 1.1319
 *** Total Charge : 1526.42
 Looking at view: 1 | Number of hits in view: 8
hit initial : 190.91 | hit correction : 1.13396
hit initial : 22.2248 | hit correction : 1.1339
hit initial : 32.6895 | hit correction : 1.13291
hit initial : 234.821 | hit correction : 1.13224
hit initial : 25.4657 | hit correction : 1.13287
hit initial : 303.267 | hit correction : 1.1321
hit initial : 256.886 | hit correction : 1.13162
hit initial : 122.838 | hit correction : 1.13145
hit initial : 151.162 | hit correction : 1.13173
hit initial : 146.192 | hit correction : 1.13191
 *** Total Charge : 1683
 Looking at view: 2 | Number of hits in view: 10
Begin processing the 10th record. run: 5026 subRun: 0 event: 44730 at 11-Dec-2025 16:49:27 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Neutron Energy: 939.566
True Neutron Energy: 940.878
True Electron Energy: 5.37485
Completed MCParticle Loop
True Neutrino Energy: 20.8465
 Size of all hits: 0
11-Dec-2025 16:49:29 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0528708     0.0622354     0.0749453     0.0621914    0.00638529       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000345162   0.000448436   0.000582141   0.000440568   6.51479e-05      10     
end_path:ana:AnalyzeEvents         0.0523407     0.0616091     0.0739361     0.061561     0.00629164       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 36647.7 MB
  Peak resident set size usage (VmHWM): 1523.31 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:56 UTC       justIN version: 01.06.00