justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267081.1@dunegpschedd01.fnal.gov

Jobsub ID267081.1@dunegpschedd01.fnal.gov
Workflow ID11108
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:40:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 02:45:03
From worker nodeHostnamedunegli-7878620-0-fnpc19118.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:42:27
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T012939Z_gen_003232_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (14540s)
CPU time4h (14420s = 99%)
Max RSS bytes2741960704 (2614 MiB)
Outputting started2025-12-12 02:44:47
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11108/1/001/analysisLowE_20251211T224228Z.root
Finished2025-12-12 02:45:03
Saved logsjustin-logs:267081.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

9
Classifier summary: 
Output 0: 0.0835108, 
Output 1: 0.0449013, 0.0633009, 0.116363, 0.775434, 
Output 2: 0.0445335, 0.1548, 0.781113, 0.0195542, 
Output 3: 0.948479, 0.0384289, 0.00528409, 0.00780788, 
Output 4: 0.627821, 0.302049, 0.0581399, 0.01199, 
Output 5: 0.398355, 0.435679, 0.138399, 0.0275666, 
Output 6: 0.0332081, 0.0703754, 0.0743842, 0.822032, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 32320 at 12-Dec-2025 02:19:44 UTC
Boundary wire vector sizes: 6616, 6566, 6548
minwire 0: 6
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.104518, 
Output 1: 0.314664, 0.0671418, 0.205342, 0.412853, 
Output 2: 0.0589954, 0.0777386, 0.851955, 0.0113115, 
Output 3: 0.965495, 0.0315146, 0.00109707, 0.00189372, 
Output 4: 0.493922, 0.459556, 0.0387414, 0.00778014, 
Output 5: 0.274722, 0.451302, 0.186675, 0.0873009, 
Output 6: 0.220183, 0.296805, 0.131867, 0.351145, 

12-Dec-2025 02:44:07 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:44:07 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/39/a3/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T012939Z_gen_003232_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1406.61       1440.93       1487.43       1438.12       23.1382        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00100724     0.0062407     0.0194459    0.00334458    0.00661798       10     
reco:pandora:StandardPandora                            1405.34       1439.48       1484.27       1436.86       22.7549        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000794146    0.0139861     0.0624666    0.00376493     0.0189342       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000255082   0.00334356     0.013123     0.00177507    0.00348291       10     
reco:pandoracalo:Calorimetry                          0.000209351   0.00852888      0.02279     0.00464296    0.00940054       10     
reco:pandorapid:Chi2ParticleID                         6.292e-05    0.000218865   0.00106107    8.6921e-05    0.000295198      10     
reco:cvnmap:CVNMapper                                  0.0225203     0.0332693     0.0402037     0.0353751    0.00531688       10     
reco:cvneva:CVNEvaluator                               0.802825      0.997474       2.54257      0.825143      0.515183        10     
reco:energyrecnumu:EnergyReco                         0.00596387     0.0631829     0.130285      0.0773129     0.0389954       10     
reco:energyrecnue:EnergyReco                          0.000861226   0.00456463    0.00712843    0.00663262    0.00276753       10     
reco:energyrecnc:EnergyReco                           0.00654669     0.026554      0.0763769    0.00702124     0.0301599       10     
[art]:TriggerResults:TriggerResultInserter             1.091e-05    2.29911e-05   0.000104901   1.4635e-05    2.7372e-05       10     
end_path:out1:RootOutput                               5.421e-06    9.8054e-06    3.5651e-05    6.9255e-06    8.65796e-06      10     
end_path:out1:RootOutput(write)                        0.269392      0.292136      0.346555      0.287379      0.0205538       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21685.4 MB
  Peak resident set size usage (VmHWM): 2741.96 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 Looking at view: 1 | Number of hits in view: 10
hit initial : 375.643 | hit correction : 1.09528
hit initial : 1127.64 | hit correction : 1.09462
hit initial : 903.048 | hit correction : 1.09495
 *** Total Charge : 2634.57
 Looking at view: 2 | Number of hits in view: 3
Begin processing the 7th record. run: 5026 subRun: 0 event: 32317 at 12-Dec-2025 02:44:36 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 12.5621
Completed MCParticle Loop
True Neutrino Energy: 16.2939
 Size of all hits: 0
Begin processing the 8th record. run: 5026 subRun: 0 event: 32318 at 12-Dec-2025 02:44:39 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 11.7823
Completed MCParticle Loop
True Neutrino Energy: 16.6258
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 32319 at 12-Dec-2025 02:44:41 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  39
Added hit list length: 39 | Max was set to: -3.40282e+38
True Electron Energy: 43.4305
Completed MCParticle Loop
True Neutrino Energy: 48.868
 Size of all hits: 39
hit initial : 228.044 | hit correction : 1.30179
hit initial : 43.4175 | hit correction : 1.3019
hit initial : 22.169 | hit correction : 1.30157
hit initial : 36.2362 | hit correction : 1.3016
hit initial : 454.526 | hit correction : 1.30137
hit initial : 710.811 | hit correction : 1.30123
hit initial : 331.285 | hit correction : 1.30159
hit initial : 339.107 | hit correction : 1.30136
hit initial : 634.922 | hit correction : 1.30125
hit initial : 236.921 | hit correction : 1.30167
hit initial : 235.674 | hit correction : 1.30187
hit initial : 191.522 | hit correction : 1.30206
hit initial : 200.847 | hit correction : 1.30235
hit initial : 180.788 | hit correction : 1.30253
hit initial : 85.0475 | hit correction : 1.30265
 *** Total Charge : 5116.96
 Looking at view: 0 | Number of hits in view: 15
hit initial : 139.639 | hit correction : 1.29901
hit initial : 220.884 | hit correction : 1.29907
hit initial : 94.5854 | hit correction : 1.29911
hit initial : 147.128 | hit correction : 1.30122
hit initial : 991.946 | hit correction : 1.30141
hit initial : 745.623 | hit correction : 1.30149
hit initial : 1615.87 | hit correction : 1.30171
 *** Total Charge : 5147.4
 Looking at view: 1 | Number of hits in view: 7
hit initial : 311.061 | hit correction : 1.30127
hit initial : 466.291 | hit correction : 1.30148
hit initial : 493.325 | hit correction : 1.30126
hit initial : 248.312 | hit correction : 1.30135
hit initial : 368.814 | hit correction : 1.30121
hit initial : 353.202 | hit correction : 1.30178
hit initial : 419.832 | hit correction : 1.30121
hit initial : 65.8684 | hit correction : 1.30198
hit initial : 135.878 | hit correction : 1.30152
hit initial : 163.005 | hit correction : 1.3017
hit initial : 200.293 | hit correction : 1.30185
hit initial : 117.109 | hit correction : 1.30197
hit initial : 111.862 | hit correction : 1.30213
hit initial : 121.084 | hit correction : 1.30228
hit initial : 123.087 | hit correction : 1.30245
hit initial : 124.957 | hit correction : 1.30257
hit initial : 79.1642 | hit correction : 1.30264
 *** Total Charge : 5080.27
 Looking at view: 2 | Number of hits in view: 17
Begin processing the 10th record. run: 5026 subRun: 0 event: 32320 at 12-Dec-2025 02:44:44 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.569
True Electron Energy: 20.0752
Completed MCParticle Loop
True Neutrino Energy: 23.379
 Size of all hits: 0
12-Dec-2025 02:44:47 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0665738     0.086198      0.154414      0.0769203     0.0253944       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000334843   0.00184335     0.0125772    0.000446064   0.00359943       10     
end_path:ana:AnalyzeEvents         0.0660916     0.0841844     0.152404      0.0710363     0.0253615       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19473.5 MB
  Peak resident set size usage (VmHWM): 1534.62 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 15:01:02 UTC       justIN version: 01.06.00