justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260225.0@dunegpschedd02.fnal.gov

Jobsub ID260225.0@dunegpschedd02.fnal.gov
Workflow ID11089
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 11:40:53
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 11:38:44
From worker nodeHostnamedunegli-7867979-0-fnpc22003.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 05:18:53
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T024552Z_gen_004157_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (22781s)
CPU time6h (21763s = 95%)
Max RSS bytes3054047232 (2912 MiB)
Outputting started2025-12-11 11:38:35
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11089/1/001/analysisLowE_20251211T051855Z.root
Finished2025-12-11 11:38:44
Saved logsjustin-logs:260225.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Output 6: 0.00982031, 0.0326264, 0.0474798, 0.910074, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 41570 at 11-Dec-2025 11:14:20 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 11:37:57 UTC run: 5027 subRun: 0 event: 41570
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6914, 6859, 6663
minwire 0: 29
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 234, 733
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.119414, 
Output 1: 0.054597, 0.0401618, 0.0764949, 0.828746, 
Output 2: 0.0797897, 0.26565, 0.620924, 0.0336359, 
Output 3: 0.978524, 0.0159696, 0.00142113, 0.00408559, 
Output 4: 0.317272, 0.614973, 0.0633355, 0.00441916, 
Output 5: 0.561128, 0.353164, 0.0699897, 0.0157179, 
Output 6: 0.025692, 0.0716603, 0.0862666, 0.816381, 

11-Dec-2025 11:37:59 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 11:37:59 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/13/14/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T024552Z_gen_004157_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1416.18       2261.37       2727.13       2389.27       387.098        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0103633     0.0231084     0.0933498     0.0146528     0.0238435       10     
reco:pandora:StandardPandora                            1414.97       2259.26       2725.17       2385.21       386.912        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000648489    0.0602856     0.286431      0.0300484     0.0820686       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00133429     0.012951      0.0525986    0.00185998     0.0182846       10     
reco:pandoracalo:Calorimetry                          0.000187175    0.0112259     0.100315     0.000520542    0.0297578       10     
reco:pandorapid:Chi2ParticleID                        6.6175e-05    0.00133105     0.0122336    0.00010828    0.00363438       10     
reco:cvnmap:CVNMapper                                  0.0385384     0.0991051     0.180915      0.0715785     0.048569        10     
reco:cvneva:CVNEvaluator                               0.776886       1.43003       5.19648      0.953447       1.26915        10     
reco:energyrecnumu:EnergyReco                         0.00384434     0.0378036     0.0989271     0.0114959     0.0376077       10     
reco:energyrecnue:EnergyReco                          0.000872594   0.00188653    0.00635452    0.00135647     0.0015855       10     
reco:energyrecnc:EnergyReco                            0.0055944     0.0571275     0.104674      0.0621272     0.0371654       10     
[art]:TriggerResults:TriggerResultInserter            1.7312e-05    4.51322e-05   0.000187094   3.15045e-05   4.76996e-05      10     
end_path:out1:RootOutput                               7.925e-06    1.82845e-05   5.2249e-05    1.58695e-05   1.17391e-05      10     
end_path:out1:RootOutput(write)                        0.248065      0.377577      0.670072      0.299837      0.138221        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21779.7 MB
  Peak resident set size usage (VmHWM): 3054.05 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 142.906 | hit correction : 1.07486
hit initial : 151.531 | hit correction : 1.07269
hit initial : 50.3305 | hit correction : 1.07515
hit initial : 534.715 | hit correction : 1.07418
 *** Total Charge : 1879.59
 Looking at view: 0 | Number of hits in view: 6
hit initial : 227.048 | hit correction : 1.07256
hit initial : 392.889 | hit correction : 1.07262
hit initial : 187.367 | hit correction : 1.07472
hit initial : 221.049 | hit correction : 1.07277
hit initial : 105.324 | hit correction : 1.07308
hit initial : 28.3676 | hit correction : 1.07417
hit initial : 21.3083 | hit correction : 1.07351
hit initial : 281.974 | hit correction : 1.07415
hit initial : 118.453 | hit correction : 1.07495
 *** Total Charge : 1700.03
 Looking at view: 1 | Number of hits in view: 9
hit initial : 14.9444 | hit correction : 1.07464
hit initial : 123.014 | hit correction : 1.07255
hit initial : 367.358 | hit correction : 1.07255
hit initial : 159.121 | hit correction : 1.07264
hit initial : 264.896 | hit correction : 1.07281
hit initial : 295.334 | hit correction : 1.07473
hit initial : 350.137 | hit correction : 1.07396
hit initial : 229.847 | hit correction : 1.0732
hit initial : 26.5021 | hit correction : 1.07526
hit initial : 27.1755 | hit correction : 1.07428
hit initial : 88.3906 | hit correction : 1.07504
 *** Total Charge : 2089.7
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 9th record. run: 5027 subRun: 0 event: 41569 at 11-Dec-2025 11:38:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Electron Energy: 6.12837
Completed MCParticle Loop
True Neutrino Energy: 9.85308
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 41570 at 11-Dec-2025 11:38:32 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  28
Added hit list length: 28 | Max was set to: -3.40282e+38
This pfp has size:  11
True Neutron Energy: 939.568
True Electron Energy: 15.1194
Completed MCParticle Loop
True Neutrino Energy: 22.9078
 Size of all hits: 28
hit initial : 48.3963 | hit correction : 1.26203
hit initial : 147.243 | hit correction : 1.26277
hit initial : 390.105 | hit correction : 1.26251
hit initial : 467.197 | hit correction : 1.26208
hit initial : 125.817 | hit correction : 1.26208
hit initial : 191.958 | hit correction : 1.26124
hit initial : 154.027 | hit correction : 1.26094
hit initial : 105.357 | hit correction : 1.26079
hit initial : 87.0741 | hit correction : 1.26061
hit initial : 130.085 | hit correction : 1.26061
 *** Total Charge : 2330.86
 Looking at view: 0 | Number of hits in view: 10
hit initial : 82.3975 | hit correction : 1.26275
hit initial : 39.6416 | hit correction : 1.26204
hit initial : 79.8971 | hit correction : 1.26204
hit initial : 41.7798 | hit correction : 1.26204
hit initial : 53.2449 | hit correction : 1.26064
hit initial : 39.8665 | hit correction : 1.26063
hit initial : 362.435 | hit correction : 1.26254
hit initial : 559.418 | hit correction : 1.2621
hit initial : 474.255 | hit correction : 1.26118
hit initial : 270.439 | hit correction : 1.26074
hit initial : 100.414 | hit correction : 1.26063
 *** Total Charge : 2654.31
 Looking at view: 1 | Number of hits in view: 11
hit initial : 208.289 | hit correction : 1.26234
hit initial : 248.935 | hit correction : 1.26276
hit initial : 41.2506 | hit correction : 1.26292
hit initial : 43.1325 | hit correction : 1.26207
hit initial : 112.219 | hit correction : 1.26202
hit initial : 605.262 | hit correction : 1.26192
hit initial : 31.6058 | hit correction : 1.26183
 *** Total Charge : 1629.1
 Looking at view: 2 | Number of hits in view: 7
11-Dec-2025 11:38:34 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0498272     0.0625469     0.0854227     0.0637694    0.00981411       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000460172   0.000759696   0.00172963    0.000553078   0.000374985      10     
end_path:ana:AnalyzeEvents         0.0490748     0.0615316     0.0829658     0.0628659    0.00942678       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19478.9 MB
  Peak resident set size usage (VmHWM): 1539.39 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:30:07 UTC       justIN version: 01.06.00