justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258473.0@dunegpschedd02.fnal.gov

Jobsub ID258473.0@dunegpschedd02.fnal.gov
Workflow ID11023
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 10:05:51
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 14:59:13
From worker nodeHostnamedunegli-7988628-0-fnpc19109.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 10:07:25
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T132848Z_gen_000426_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (17474s)
CPU time4h (17277s = 98%)
Max RSS bytes3048534016 (2907 MiB)
Outputting started2025-12-06 14:58:39
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11023/1/001/analysisLowE_20251206T100726Z.root
Finished2025-12-06 14:59:13
Saved logsjustin-logs:258473.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

32778, 0.00982818, 
Output 5: 0.341324, 0.393683, 0.209084, 0.0559084, 
Output 6: 0.0329742, 0.0689824, 0.081335, 0.816708, 

Begin processing the 10th record. run: 4696 subRun: 0 event: 4260 at 06-Dec-2025 14:30:33 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 14:57:48 UTC run: 4696 subRun: 0 event: 4260
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6668, 6705, 6740
minwire 0: 26
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0742597, 
Output 1: 0.0368911, 0.0359417, 0.0766705, 0.850497, 
Output 2: 0.0557849, 0.202588, 0.711974, 0.0296536, 
Output 3: 0.958224, 0.0202886, 0.00499136, 0.0164956, 
Output 4: 0.676205, 0.275786, 0.0405954, 0.00741374, 
Output 5: 0.601842, 0.323138, 0.0624067, 0.0126134, 
Output 6: 0.01089, 0.0285486, 0.0424872, 0.918074, 

06-Dec-2025 14:57:50 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 14:57:50 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/5c/59/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T132848Z_gen_000426_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1611.74       1728.91       1940.85       1701.59       112.697        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0018792     0.0110682     0.0550004    0.00516087     0.0152553       10     
reco:pandora:StandardPandora                            1607.66       1726.99       1939.03       1700.19       112.76         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00199415     0.0213006     0.106029      0.0103709     0.029794        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00104177    0.00504891     0.0180539    0.00289636    0.00509134       10     
reco:pandoracalo:Calorimetry                          0.000257702   0.00446535     0.0281136    0.000428103   0.00828302       10     
reco:pandorapid:Chi2ParticleID                         5.933e-05    0.000341964   0.00242725    9.5851e-05    0.000696417      10     
reco:cvnmap:CVNMapper                                  0.0256069     0.0343302     0.0518813     0.0321105    0.00816687       10     
reco:cvneva:CVNEvaluator                               0.900219       1.32481       3.00288       1.15495      0.602403        10     
reco:energyrecnumu:EnergyReco                         0.00725712     0.0640911     0.109447      0.0770775     0.0399045       10     
reco:energyrecnue:EnergyReco                          0.00102373    0.00347749     0.0082196    0.00196442    0.00293203       10     
reco:energyrecnc:EnergyReco                           0.00754994     0.0415197     0.114307      0.0125165     0.0405982       10     
[art]:TriggerResults:TriggerResultInserter             1.34e-05     2.94933e-05   0.000117841    1.85e-05     2.98437e-05      10     
end_path:out1:RootOutput                               6.92e-06     1.34482e-05    5.399e-05     8.315e-06    1.36931e-05      10     
end_path:out1:RootOutput(write)                        0.324214      0.405796       0.71139      0.338899       0.12331        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21789.4 MB
  Peak resident set size usage (VmHWM): 3048.53 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 44.8322 | hit correction : 1.05201
hit initial : 152.724 | hit correction : 1.05236
hit initial : 135.583 | hit correction : 1.05139
hit initial : 143.713 | hit correction : 1.05232
hit initial : 24.683 | hit correction : 1.05305
hit initial : 53.7441 | hit correction : 1.0524
hit initial : 57.7478 | hit correction : 1.05284
hit initial : 119.078 | hit correction : 1.0512
hit initial : 27.8453 | hit correction : 1.05284
hit initial : 29.18 | hit correction : 1.05324
hit initial : 209.869 | hit correction : 1.0509
hit initial : 274.966 | hit correction : 1.05054
hit initial : 24.3265 | hit correction : 1.0507
hit initial : 784.293 | hit correction : 1.05028
hit initial : 31.9811 | hit correction : 1.04998
hit initial : 347.162 | hit correction : 1.04949
hit initial : 267.196 | hit correction : 1.04922
hit initial : 86.3643 | hit correction : 1.04855
hit initial : 176.038 | hit correction : 1.0483
hit initial : 235.495 | hit correction : 1.04795
 *** Total Charge : 3612.27
 Looking at view: 1 | Number of hits in view: 23
hit initial : 16.4733 | hit correction : 1.05246
hit initial : 505.201 | hit correction : 1.05229
hit initial : 107.966 | hit correction : 1.05286
hit initial : 333.09 | hit correction : 1.05146
hit initial : 138.156 | hit correction : 1.0512
hit initial : 147.171 | hit correction : 1.05111
hit initial : 249.796 | hit correction : 1.05087
hit initial : 399.667 | hit correction : 1.0506
hit initial : 213.33 | hit correction : 1.05031
hit initial : 234.69 | hit correction : 1.05006
hit initial : 337.763 | hit correction : 1.04977
hit initial : 305.516 | hit correction : 1.04941
hit initial : 268.07 | hit correction : 1.04902
hit initial : 267.347 | hit correction : 1.04857
hit initial : 251.704 | hit correction : 1.04811
hit initial : 180.883 | hit correction : 1.04775
 *** Total Charge : 4155.73
 Looking at view: 2 | Number of hits in view: 16
Begin processing the 10th record. run: 4696 subRun: 0 event: 4260 at 06-Dec-2025 14:58:36 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  26
Added hit list length: 26 | Max was set to: -3.40282e+38
True Neutron Energy: 939.574
True Neutron Energy: 942.524
True Neutron Energy: 940.699
True Electron Energy: 38.235
Completed MCParticle Loop
True Neutrino Energy: 61.4269
 Size of all hits: 26
hit initial : 115.373 | hit correction : 1.30152
hit initial : 220.015 | hit correction : 1.30164
hit initial : 234.453 | hit correction : 1.30195
hit initial : 263.742 | hit correction : 1.30227
hit initial : 71.0075 | hit correction : 1.30014
hit initial : 268.38 | hit correction : 1.30231
hit initial : 176.37 | hit correction : 1.30018
hit initial : 141.458 | hit correction : 1.3023
hit initial : 145.03 | hit correction : 1.30023
hit initial : 34.6983 | hit correction : 1.30484
hit initial : 37.1928 | hit correction : 1.30028
hit initial : 40.9481 | hit correction : 1.30484
 *** Total Charge : 2276.26
 Looking at view: 1 | Number of hits in view: 12
hit initial : 103.411 | hit correction : 1.3022
hit initial : 127.396 | hit correction : 1.30235
hit initial : 148.793 | hit correction : 1.30238
hit initial : 272.852 | hit correction : 1.3023
hit initial : 54.4963 | hit correction : 1.30232
hit initial : 32.1534 | hit correction : 1.30015
hit initial : 170.593 | hit correction : 1.30017
hit initial : 209.498 | hit correction : 1.30022
hit initial : 22.5132 | hit correction : 1.30033
hit initial : 78.3975 | hit correction : 1.30141
hit initial : 105.192 | hit correction : 1.30151
hit initial : 120.131 | hit correction : 1.30166
hit initial : 140.308 | hit correction : 1.30182
hit initial : 114.303 | hit correction : 1.30203
 *** Total Charge : 2212.73
 Looking at view: 2 | Number of hits in view: 14
06-Dec-2025 14:58:39 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0729802     0.0887998     0.105014      0.088572      0.0102636       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000363532   0.00048389    0.000966597   0.000439993   0.000166611      10     
end_path:ana:AnalyzeEvents         0.0724618     0.0881484      0.1036       0.0880252     0.0101255       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19480.8 MB
  Peak resident set size usage (VmHWM): 1543.87 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:42 UTC       justIN version: 01.06.00