justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249059.0@dunegpschedd02.fnal.gov

Jobsub ID249059.0@dunegpschedd02.fnal.gov
Workflow ID10411
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-21 00:19:44
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-11-21 10:42:52
From worker nodeHostnamedunegli-7673436-0-fnpc23014.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-21 06:59:25
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T195306Z_gen_001246_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (13355s)
CPU time3h (13245s = 99%)
Max RSS bytes3076591616 (2934 MiB)
Outputting started2025-11-21 10:42:01
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/10411/1/001/analysisLowE_20251121T065926Z.root
Finished2025-11-21 10:42:52
Saved logsjustin-logs:249059.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

4, 0.0042504, 
Output 4: 0.463725, 0.476432, 0.0526727, 0.00717028, 
Output 5: 0.23451, 0.400845, 0.273979, 0.0906663, 
Output 6: 0.0538375, 0.120918, 0.105033, 0.720211, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 12460 at 21-Nov-2025 10:28:30 UTC
Boundary wire vector sizes: 6668, 6588, 6681
minwire 0: 48
minwire 1: 1
minwire 2: 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2198, 2697
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.162513, 
Output 1: 0.0613889, 0.120044, 0.186174, 0.632394, 
Output 2: 0.0258252, 0.170461, 0.786524, 0.0171901, 
Output 3: 0.963854, 0.0282223, 0.00368775, 0.00423609, 
Output 4: 0.209359, 0.633093, 0.145723, 0.0118252, 
Output 5: 0.345025, 0.391933, 0.214821, 0.0482215, 
Output 6: 0.0449085, 0.11337, 0.114243, 0.727479, 

21-Nov-2025 10:41:33 UTC  Closed output file "matt_reco2.root"
21-Nov-2025 10:41:33 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/70/77/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T195306Z_gen_001246_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              626.794       1325.34       2675.45       1282.58       638.046        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00429577     0.0107901     0.0284387    0.00745206    0.00778791       10     
reco:pandora:StandardPandora                            625.81        1323.96       2674.24       1281.49       637.825        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000587466    0.0491643     0.159878      0.0253329     0.0534952       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000255761   0.00298377     0.0122562    0.00152537    0.00349001       10     
reco:pandoracalo:Calorimetry                          0.000234851    0.0099942     0.0899827    0.000438445    0.0266893       10     
reco:pandorapid:Chi2ParticleID                        5.8722e-05    0.000222533   0.00107189    0.000117135   0.000290139      10     
reco:cvnmap:CVNMapper                                  0.0190063     0.046941      0.128993      0.0374034     0.0333868       10     
reco:cvneva:CVNEvaluator                               0.686686      0.924117       2.61057      0.727591      0.564641        10     
reco:energyrecnumu:EnergyReco                         0.00282741     0.038146      0.148056      0.0123964     0.0449177       10     
reco:energyrecnue:EnergyReco                          0.00076146    0.00213894    0.00570528    0.00108348     0.0017064       10     
reco:energyrecnc:EnergyReco                           0.00457294     0.0449987     0.127555      0.055565      0.0381444       10     
[art]:TriggerResults:TriggerResultInserter            1.0851e-05    3.17205e-05   9.2737e-05    2.14105e-05   2.62872e-05      10     
end_path:out1:RootOutput                               7.845e-06    1.57001e-05   3.3154e-05    1.24335e-05   8.82539e-06      10     
end_path:out1:RootOutput(write)                        0.193515      0.250798      0.437429      0.219812      0.0773924       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21788.8 MB
  Peak resident set size usage (VmHWM): 3076.59 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 278.54 | hit correction : 1.15962
hit initial : 73.3884 | hit correction : 1.15961
hit initial : 132.252 | hit correction : 1.15957
hit initial : 32.1479 | hit correction : 1.16755
hit initial : 40.1642 | hit correction : 1.16763
hit initial : 212.796 | hit correction : 1.16921
hit initial : 68.2994 | hit correction : 1.16921
hit initial : 32.0206 | hit correction : 1.16917
hit initial : 44.6844 | hit correction : 1.16993
hit initial : 167.079 | hit correction : 1.17007
hit initial : 206.955 | hit correction : 1.17026
hit initial : 204.7 | hit correction : 1.17043
hit initial : 235.176 | hit correction : 1.17072
hit initial : 255.971 | hit correction : 1.1711
hit initial : 304.102 | hit correction : 1.17143
hit initial : 374.47 | hit correction : 1.17156
hit initial : 230.905 | hit correction : 1.17184
hit initial : 183.227 | hit correction : 1.17214
hit initial : 198.069 | hit correction : 1.17233
hit initial : 189.67 | hit correction : 1.1725
hit initial : 196.012 | hit correction : 1.17272
 *** Total Charge : 6656.35
 Looking at view: 0 | Number of hits in view: 35
hit initial : 68.3055 | hit correction : 1.15966
hit initial : 402.928 | hit correction : 1.173
hit initial : 101.129 | hit correction : 1.17311
hit initial : 42.3196 | hit correction : 1.174
hit initial : 80.4197 | hit correction : 1.17385
hit initial : 289.43 | hit correction : 1.15962
hit initial : 359.153 | hit correction : 1.15958
hit initial : 111.097 | hit correction : 1.15957
hit initial : 36.0416 | hit correction : 1.16623
hit initial : 24.8113 | hit correction : 1.16622
hit initial : 48.725 | hit correction : 1.16782
hit initial : 161.652 | hit correction : 1.16785
hit initial : 212.663 | hit correction : 1.16788
hit initial : 101.114 | hit correction : 1.16797
hit initial : 233.197 | hit correction : 1.16901
hit initial : 197.984 | hit correction : 1.16919
hit initial : 530.692 | hit correction : 1.16923
hit initial : 59.0495 | hit correction : 1.16921
hit initial : 113.442 | hit correction : 1.17017
hit initial : 240.423 | hit correction : 1.17035
hit initial : 434.707 | hit correction : 1.17084
hit initial : 117.112 | hit correction : 1.17138
hit initial : 601.937 | hit correction : 1.17145
hit initial : 581.743 | hit correction : 1.1721
hit initial : 620.125 | hit correction : 1.17264
 *** Total Charge : 6746.7
 Looking at view: 1 | Number of hits in view: 25
hit initial : 22.3908 | hit correction : 1.17395
hit initial : 58.8654 | hit correction : 1.17322
hit initial : 45.0929 | hit correction : 1.174
hit initial : 179.412 | hit correction : 1.17318
hit initial : 200.75 | hit correction : 1.17304
hit initial : 212.221 | hit correction : 1.17289
hit initial : 44.6141 | hit correction : 1.15965
hit initial : 596.759 | hit correction : 1.1596
hit initial : 151.169 | hit correction : 1.15958
hit initial : 50.7259 | hit correction : 1.16757
hit initial : 16.0507 | hit correction : 1.16757
hit initial : 124.001 | hit correction : 1.16921
hit initial : 329.013 | hit correction : 1.16918
hit initial : 30.7254 | hit correction : 1.16919
hit initial : 18.6782 | hit correction : 1.16811
hit initial : 259.194 | hit correction : 1.16799
hit initial : 245.344 | hit correction : 1.16788
hit initial : 29.3743 | hit correction : 1.16793
hit initial : 47.3953 | hit correction : 1.16881
hit initial : 437.886 | hit correction : 1.16905
hit initial : 268.782 | hit correction : 1.17018
hit initial : 574.97 | hit correction : 1.17037
hit initial : 286.114 | hit correction : 1.17101
hit initial : 410.745 | hit correction : 1.17143
hit initial : 409.018 | hit correction : 1.1716
hit initial : 187.675 | hit correction : 1.17197
hit initial : 172.958 | hit correction : 1.17217
hit initial : 186.222 | hit correction : 1.17235
hit initial : 191.565 | hit correction : 1.17253
hit initial : 194.712 | hit correction : 1.17271
 *** Total Charge : 6995.27
 Looking at view: 2 | Number of hits in view: 30
21-Nov-2025 10:42:00 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0505037     0.0650448     0.0932479     0.0607941     0.012043        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000425506   0.000572338   0.000862393   0.000571811   0.000122499      10     
end_path:ana:AnalyzeEvents         0.0498585     0.0642178     0.0916363     0.0600727     0.0118381       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19476.6 MB
  Peak resident set size usage (VmHWM): 1540.03 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-09 03:26:56 UTC       justIN version: 01.06.00