justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257913.144@dunegpschedd02.fnal.gov

Jobsub ID257913.144@dunegpschedd02.fnal.gov
Workflow ID11027
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 11:27:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 12:00:48
From worker nodeHostnamedunegli-7832230-0-fnpc18004.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 00:49:49
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T014711Z_gen_003250_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (40230s)
CPU time10h (39342s = 97%)
Max RSS bytes2887008256 (2753 MiB)
Outputting started2025-12-06 12:00:20
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11027/1/001/analysisLowE_20251206T004951Z.root
Finished2025-12-06 12:00:48
Saved logsjustin-logs:257913.144-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.148188, 
Output 1: 0.107006, 0.0791238, 0.119404, 0.694467, 
Output 2: 0.0429005, 0.191135, 0.738749, 0.0272155, 
Output 3: 0.978127, 0.0147166, 0.00189722, 0.00525896, 
Output 4: 0.651181, 0.310818, 0.033516, 0.0044849, 
Output 5: 0.231428, 0.440081, 0.264321, 0.0641701, 
Output 6: 0.0337355, 0.0777642, 0.0874407, 0.80106, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 32500 at 06-Dec-2025 10:54:07 UTC
Boundary wire vector sizes: 6587, 6512, 6573
minwire 0: 14
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.101544, 
Output 1: 0.0812296, 0.108721, 0.132747, 0.677302, 
Output 2: 0.0575721, 0.184922, 0.732309, 0.0251961, 
Output 3: 0.974095, 0.0173512, 0.00221037, 0.0063437, 
Output 4: 0.682206, 0.287245, 0.0265278, 0.00402125, 
Output 5: 0.40545, 0.451178, 0.116395, 0.026978, 
Output 6: 0.0336985, 0.0779624, 0.0789127, 0.809426, 

06-Dec-2025 11:58:35 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 11:58:35 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/06/e4/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T014711Z_gen_003250_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3665.71       3986.2        4115.91       4087.83       154.364        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0024689     0.0154425      0.04793      0.0102593     0.0125774       10     
reco:pandora:StandardPandora                            3661.31       3980.25       4109.2        4082.15       153.659        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00127214     0.0446018      0.24137      0.0162015     0.0689603       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00208954     0.0150047     0.0515058     0.0058028     0.0163468       10     
reco:pandoracalo:Calorimetry                          0.000688551    0.019668      0.0906799     0.0036235     0.0308568       10     
reco:pandorapid:Chi2ParticleID                        0.000135967    0.002146      0.0140166    0.000270386   0.00410525       10     
reco:cvnmap:CVNMapper                                  0.070853      0.130036      0.329378      0.113287      0.0712213       10     
reco:cvneva:CVNEvaluator                                3.44481       4.89072       11.3611       4.04769       2.25503        10     
reco:energyrecnumu:EnergyReco                         0.00925817     0.0774582     0.214635      0.0338885     0.0728166       10     
reco:energyrecnue:EnergyReco                          0.00280585    0.00773215     0.0212674     0.0034204    0.00658605       10     
reco:energyrecnc:EnergyReco                            0.0152818     0.0928804     0.221496      0.117577      0.0679249       10     
[art]:TriggerResults:TriggerResultInserter            3.0718e-05    5.32514e-05   0.000184728   4.06365e-05   4.40314e-05      10     
end_path:out1:RootOutput                               8.877e-06    1.71174e-05    5.787e-05    1.2839e-05    1.3704e-05       10     
end_path:out1:RootOutput(write)                        0.594471      0.654383      0.808582      0.626181      0.0754302       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21743.9 MB
  Peak resident set size usage (VmHWM): 2887.01 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 *** Total Charge : 4286.23
 Looking at view: 2 | Number of hits in view: 18
Begin processing the 7th record. run: 5027 subRun: 0 event: 32497 at 06-Dec-2025 11:59:50 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 3.91706
Completed MCParticle Loop
True Neutrino Energy: 7.642
 Size of all hits: 0
Begin processing the 8th record. run: 5027 subRun: 0 event: 32498 at 06-Dec-2025 11:59:58 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  14
Added hit list length: 14 | Max was set to: -3.40282e+38
True Electron Energy: 8.83401
Completed MCParticle Loop
True Neutrino Energy: 26.0695
 Size of all hits: 14
hit initial : 284.204 | hit correction : 1.18484
hit initial : 149.807 | hit correction : 1.18443
hit initial : 29.6853 | hit correction : 1.18437
hit initial : 112.941 | hit correction : 1.18476
hit initial : 283.979 | hit correction : 1.18479
hit initial : 251.385 | hit correction : 1.1847
 *** Total Charge : 1317.41
 Looking at view: 0 | Number of hits in view: 6
hit initial : 144.015 | hit correction : 1.18447
hit initial : 184.716 | hit correction : 1.18477
hit initial : 372.875 | hit correction : 1.18479
hit initial : 350.654 | hit correction : 1.18472
 *** Total Charge : 1246.64
 Looking at view: 1 | Number of hits in view: 4
hit initial : 18.3698 | hit correction : 1.18496
hit initial : 102.97 | hit correction : 1.18437
hit initial : 523.391 | hit correction : 1.1848
hit initial : 510.183 | hit correction : 1.18468
 *** Total Charge : 1368.24
 Looking at view: 2 | Number of hits in view: 4
Begin processing the 9th record. run: 5027 subRun: 0 event: 32499 at 06-Dec-2025 12:00:07 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 0.727503
Completed MCParticle Loop
True Neutrino Energy: 6.10508
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 32500 at 06-Dec-2025 12:00:13 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  23
Added hit list length: 23 | Max was set to: -3.40282e+38
True Neutron Energy: 939.566
True Electron Energy: 22.2314
Completed MCParticle Loop
True Neutrino Energy: 27.7448
 Size of all hits: 23
hit initial : 139.985 | hit correction : 1.28347
hit initial : 72.4393 | hit correction : 1.2835
hit initial : 19.7667 | hit correction : 1.28344
hit initial : 41.0309 | hit correction : 1.28341
hit initial : 225.685 | hit correction : 1.28431
hit initial : 465.772 | hit correction : 1.28434
hit initial : 372.337 | hit correction : 1.28465
hit initial : 276.422 | hit correction : 1.28538
hit initial : 219.604 | hit correction : 1.28592
hit initial : 56.2957 | hit correction : 1.286
hit initial : 56.5913 | hit correction : 1.28666
hit initial : 76.3687 | hit correction : 1.28671
hit initial : 72.1229 | hit correction : 1.28673
 *** Total Charge : 2691.03
 Looking at view: 0 | Number of hits in view: 13
hit initial : 338.107 | hit correction : 1.28423
hit initial : 77.838 | hit correction : 1.28425
hit initial : 258.382 | hit correction : 1.28434
hit initial : 140.194 | hit correction : 1.28445
hit initial : 133.818 | hit correction : 1.28466
hit initial : 166.36 | hit correction : 1.28496
hit initial : 161.096 | hit correction : 1.2853
hit initial : 172.416 | hit correction : 1.28566
hit initial : 293.984 | hit correction : 1.28638
hit initial : 67.9723 | hit correction : 1.28666
 *** Total Charge : 2326.12
 Looking at view: 2 | Number of hits in view: 10
06-Dec-2025 12:00:19 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.141834      0.232895      0.439185      0.221758      0.077951        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000872188   0.00129903    0.00286833    0.000934901   0.000714563      10     
end_path:ana:AnalyzeEvents         0.140429       0.23103      0.437933      0.219924      0.0783002       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.3 MB
  Peak resident set size usage (VmHWM): 1531.23 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:10:29 UTC       justIN version: 01.06.00