justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258286.0@dunegpschedd02.fnal.gov

Jobsub ID258286.0@dunegpschedd02.fnal.gov
Workflow ID11022
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 23:37:15
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 07:44:13
From worker nodeHostnamedunegli-7989157-0-fnpc19130.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:39:23
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T224507Z_gen_000579_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (21880s)
CPU time6h (21631s = 98%)
Max RSS bytes3065499648 (2923 MiB)
Outputting started2025-12-06 07:44:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11022/1/001/analysisLowE_20251206T013924Z.root
Finished2025-12-06 07:44:13
Saved logsjustin-logs:258286.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

176, 0.906303, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 5790 at 06-Dec-2025 07:11:14 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 07:43:17 UTC run: 5027 subRun: 0 event: 5790
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6798, 6694, 6747
minwire 0: 27
minwire 1: 1
minwire 2: 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1815, 2314
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0918962, 
Output 1: 0.0461201, 0.111474, 0.173585, 0.668821, 
Output 2: 0.0578921, 0.186399, 0.727778, 0.027931, 
Output 3: 0.94064, 0.0439149, 0.00698815, 0.00845734, 
Output 4: 0.644571, 0.306775, 0.0418474, 0.00680614, 
Output 5: 0.520391, 0.381274, 0.0818743, 0.0164601, 
Output 6: 0.0204492, 0.056401, 0.0644725, 0.858677, 

06-Dec-2025 07:43:20 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 07:43:20 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/ef/e4/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T224507Z_gen_000579_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1920.12       2168.25       2546.16       2095.45       208.883        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00162182    0.00794757     0.0232428    0.00581576    0.00601122       10     
reco:pandora:StandardPandora                            1918.11       2165.98       2544.06       2093.34       209.085        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000485755    0.0242459     0.0863532     0.0208503     0.0249549       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000489285   0.00467526     0.0171109    0.00301189    0.00448359       10     
reco:pandoracalo:Calorimetry                          0.000259942   0.00581016     0.0387841    0.000696356    0.011506        10     
reco:pandorapid:Chi2ParticleID                         7.405e-05    0.000260024   0.00131937    0.000133581   0.00035954       10     
reco:cvnmap:CVNMapper                                  0.030891      0.0439233     0.0631516     0.0428072    0.00854605       10     
reco:cvneva:CVNEvaluator                                1.26912       1.59215       3.29759       1.42421      0.570988        10     
reco:energyrecnumu:EnergyReco                          0.0022214     0.0786261     0.117727      0.0997205     0.0409113       10     
reco:energyrecnue:EnergyReco                          0.00133265     0.0060763     0.0128301    0.00212824     0.0053021       10     
reco:energyrecnc:EnergyReco                            0.0119804     0.0416575     0.139672      0.0125563     0.0460841       10     
[art]:TriggerResults:TriggerResultInserter             1.861e-05    3.20273e-05   0.000119391   2.2755e-05    2.92277e-05      10     
end_path:out1:RootOutput                               6.68e-06     1.24991e-05    3.796e-05      8.7e-06     9.03935e-06      10     
end_path:out1:RootOutput(write)                         0.42396      0.467741      0.582386      0.457103      0.0402837       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21779.4 MB
  Peak resident set size usage (VmHWM): 3065.5 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 30.7172 | hit correction : 1.41895
hit initial : 52.3175 | hit correction : 1.41678
hit initial : 37.6477 | hit correction : 1.41676
hit initial : 35.0458 | hit correction : 1.42413
hit initial : 50.7813 | hit correction : 1.42169
hit initial : 18.9037 | hit correction : 1.42292
hit initial : 116.307 | hit correction : 1.42391
hit initial : 243.76 | hit correction : 1.42374
hit initial : 276.558 | hit correction : 1.4231
hit initial : 139.587 | hit correction : 1.42304
hit initial : 34.3598 | hit correction : 1.42281
hit initial : 162.803 | hit correction : 1.4221
hit initial : 155.331 | hit correction : 1.42185
hit initial : 186.75 | hit correction : 1.4216
hit initial : 206.178 | hit correction : 1.42135
hit initial : 180.922 | hit correction : 1.42106
hit initial : 225.117 | hit correction : 1.42063
hit initial : 238.104 | hit correction : 1.4203
hit initial : 214.032 | hit correction : 1.41995
hit initial : 244.559 | hit correction : 1.41955
hit initial : 321.918 | hit correction : 1.41941
hit initial : 200.493 | hit correction : 1.41932
 *** Total Charge : 4792.39
 Looking at view: 1 | Number of hits in view: 22
Begin processing the 10th record. run: 5027 subRun: 0 event: 5790 at 06-Dec-2025 07:44:00 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  42
Added hit list length: 42 | Max was set to: -3.40282e+38
This pfp has size:  12
True Neutron Energy: 945.087
True Neutron Energy: 941.263
True Electron Energy: 33.5782
Completed MCParticle Loop
True Neutrino Energy: 38.9686
 Size of all hits: 42
hit initial : 29.0833 | hit correction : 1.05335
hit initial : 68.7874 | hit correction : 1.05337
hit initial : 6.63231 | hit correction : 1.05242
hit initial : 35.6707 | hit correction : 1.05338
hit initial : 14.1002 | hit correction : 1.05233
hit initial : 86.5285 | hit correction : 1.046
hit initial : 161.66 | hit correction : 1.04599
hit initial : 79.8876 | hit correction : 1.04656
hit initial : 69.0012 | hit correction : 1.04599
hit initial : 301.502 | hit correction : 1.0466
hit initial : 182.685 | hit correction : 1.04732
hit initial : 43.6146 | hit correction : 1.04773
hit initial : 82.2454 | hit correction : 1.04808
hit initial : 234.139 | hit correction : 1.0481
hit initial : 288.43 | hit correction : 1.04809
hit initial : 90.8782 | hit correction : 1.04809
hit initial : 71.6894 | hit correction : 1.04912
hit initial : 165.282 | hit correction : 1.04928
hit initial : 68.3912 | hit correction : 1.04928
hit initial : 246.102 | hit correction : 1.05009
hit initial : 444.338 | hit correction : 1.05055
hit initial : 380.461 | hit correction : 1.05117
hit initial : 251.139 | hit correction : 1.05163
hit initial : 69.789 | hit correction : 1.05173
 *** Total Charge : 3642.66
 Looking at view: 0 | Number of hits in view: 24
hit initial : 56.1523 | hit correction : 1.04601
hit initial : 153.185 | hit correction : 1.04599
hit initial : 116.569 | hit correction : 1.04601
hit initial : 164.82 | hit correction : 1.04664
hit initial : 160.427 | hit correction : 1.04662
hit initial : 83.265 | hit correction : 1.04726
hit initial : 55.8703 | hit correction : 1.04748
hit initial : 66.6043 | hit correction : 1.04809
hit initial : 284.331 | hit correction : 1.04809
hit initial : 247.264 | hit correction : 1.04809
hit initial : 63.345 | hit correction : 1.04809
hit initial : 81.7335 | hit correction : 1.04914
hit initial : 128.259 | hit correction : 1.04932
hit initial : 166.49 | hit correction : 1.04996
hit initial : 359.546 | hit correction : 1.05032
hit initial : 323.849 | hit correction : 1.05084
hit initial : 274.56 | hit correction : 1.0513
hit initial : 200.832 | hit correction : 1.05168
 *** Total Charge : 3133.34
 Looking at view: 1 | Number of hits in view: 18
06-Dec-2025 07:44:03 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0710204     0.089705      0.113466      0.0888538     0.0113891       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000363393   0.000534883   0.00114899    0.000440518   0.00023655       10     
end_path:ana:AnalyzeEvents         0.0704844     0.0889701     0.111801      0.0882449     0.0111662       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19472.1 MB
  Peak resident set size usage (VmHWM): 1536.39 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:04 UTC       justIN version: 01.06.00