justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261442.1@dunegpschedd02.fnal.gov

Jobsub ID261442.1@dunegpschedd02.fnal.gov
Workflow ID11117
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-12 01:58:50
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-13 03:27:26
From worker nodeHostnamedunegli-7890506-0-fnpc22032.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 00:49:04
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T191510Z_gen_002030_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time2h (9453s)
CPU time2h (9322s = 98%)
Max RSS bytes2925756416 (2790 MiB)
Outputting started2025-12-13 03:26:37
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11117/1/001/analysisLowE_20251213T004905Z.root
Finished2025-12-13 03:27:26
Saved logsjustin-logs:261442.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

, 0.112637, 0.711359, 
Output 2: 0.0451708, 0.203465, 0.727593, 0.0237712, 
Output 3: 0.972911, 0.0156369, 0.00253251, 0.0089196, 
Output 4: 0.502706, 0.437727, 0.0529743, 0.00659233, 
Output 5: 0.262883, 0.514235, 0.185859, 0.0370224, 
Output 6: 0.0371005, 0.0877462, 0.0969963, 0.778157, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 20300 at 13-Dec-2025 03:09:20 UTC
Boundary wire vector sizes: 6869, 6805, 6772
minwire 0: 27
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 146, 645
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0760236, 
Output 1: 0.0606686, 0.092345, 0.119677, 0.72731, 
Output 2: 0.0289539, 0.101784, 0.859633, 0.00962932, 
Output 3: 0.970121, 0.023744, 0.00209477, 0.00404052, 
Output 4: 0.534548, 0.386013, 0.0660624, 0.0133767, 
Output 5: 0.260778, 0.480511, 0.207966, 0.0507459, 
Output 6: 0.0893818, 0.180697, 0.122758, 0.607163, 

13-Dec-2025 03:26:03 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 03:26:03 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/74/51/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T191510Z_gen_002030_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              862.958       935.708       1000.56       934.955       40.7886        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00126757     0.0105207     0.0283925    0.00795245    0.00810106       10     
reco:pandora:StandardPandora                            859.67        934.17        999.107       933.785       41.1534        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00268552     0.0345538     0.157028      0.0131485     0.0459612       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00258973    0.00702576     0.0263799    0.00581173    0.00663981       10     
reco:pandoracalo:Calorimetry                          0.000269891    0.0161317     0.060404     0.00291859     0.0226176       10     
reco:pandorapid:Chi2ParticleID                        7.6384e-05    0.000419059    0.0022575    0.000199968   0.00062792       10     
reco:cvnmap:CVNMapper                                  0.0476215     0.0544794     0.061729      0.054295     0.00456407       10     
reco:cvneva:CVNEvaluator                               0.724586       1.08897       2.56352      0.892573      0.534665        10     
reco:energyrecnumu:EnergyReco                         0.00396099     0.0503177     0.101622      0.0619664     0.0312402       10     
reco:energyrecnue:EnergyReco                          0.000793069    0.0031637    0.00529828    0.00316392    0.00203174       10     
reco:energyrecnc:EnergyReco                           0.00489646     0.0353768     0.0847693     0.0104676     0.0353154       10     
[art]:TriggerResults:TriggerResultInserter            1.4397e-05    2.8091e-05    0.000123143   1.8294e-05    3.17487e-05      10     
end_path:out1:RootOutput                               7.705e-06    1.50483e-05   3.9524e-05    1.05545e-05   9.23808e-06      10     
end_path:out1:RootOutput(write)                        0.206542       0.23585      0.320646      0.232169      0.0298222       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21678.7 MB
  Peak resident set size usage (VmHWM): 2925.76 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
True Neutrino Energy: 12.8528
 Size of all hits: 0
Begin processing the 8th record. run: 5026 subRun: 0 event: 20298 at 13-Dec-2025 03:26:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 22.1814
Completed MCParticle Loop
True Neutrino Energy: 25.4861
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 20299 at 13-Dec-2025 03:26:32 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 11.0961
Completed MCParticle Loop
True Neutrino Energy: 14.3858
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 20300 at 13-Dec-2025 03:26:34 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  50
Added hit list length: 50 | Max was set to: -3.40282e+38
True Neutron Energy: 939.57
True Electron Energy: 36.6616
Completed MCParticle Loop
True Neutrino Energy: 42.0954
 Size of all hits: 50
hit initial : 47.6833 | hit correction : 1.18957
hit initial : 39.8573 | hit correction : 1.19414
hit initial : 71.4853 | hit correction : 1.18956
hit initial : 69.1195 | hit correction : 1.19428
hit initial : 85.9588 | hit correction : 1.19337
hit initial : 109.973 | hit correction : 1.19276
hit initial : 33.444 | hit correction : 1.18958
hit initial : 58.1761 | hit correction : 1.191
hit initial : 16.1737 | hit correction : 1.19431
hit initial : 36.325 | hit correction : 1.19336
hit initial : 102.106 | hit correction : 1.18951
hit initial : 72.2952 | hit correction : 1.19431
hit initial : 76.4083 | hit correction : 1.19339
hit initial : 86.6803 | hit correction : 1.19233
hit initial : 62.8367 | hit correction : 1.19228
hit initial : 61.1812 | hit correction : 1.19181
hit initial : 703.442 | hit correction : 1.19098
hit initial : 116.794 | hit correction : 1.19097
hit initial : 287.571 | hit correction : 1.18973
 *** Total Charge : 2546.58
 Looking at view: 0 | Number of hits in view: 19
hit initial : 55.4809 | hit correction : 1.1894
hit initial : 48.5144 | hit correction : 1.19094
hit initial : 48.5198 | hit correction : 1.19103
hit initial : 41.173 | hit correction : 1.18958
hit initial : 88.2206 | hit correction : 1.18957
hit initial : 39.2024 | hit correction : 1.18958
hit initial : 81.6944 | hit correction : 1.19336
hit initial : 72.8639 | hit correction : 1.19924
hit initial : 77.8539 | hit correction : 1.19432
hit initial : 69.599 | hit correction : 1.1943
hit initial : 38.975 | hit correction : 1.19339
hit initial : 208.901 | hit correction : 1.19329
hit initial : 248.266 | hit correction : 1.19259
hit initial : 294.096 | hit correction : 1.1921
hit initial : 442.356 | hit correction : 1.1912
hit initial : 419.006 | hit correction : 1.19073
hit initial : 259.475 | hit correction : 1.18983
hit initial : 153.176 | hit correction : 1.18944
 *** Total Charge : 3202.34
 Looking at view: 1 | Number of hits in view: 18
hit initial : 31.338 | hit correction : 1.19096
hit initial : 22.1296 | hit correction : 1.18954
hit initial : 53.5654 | hit correction : 1.19423
hit initial : 120.334 | hit correction : 1.19432
hit initial : 143.35 | hit correction : 1.19339
hit initial : 251.52 | hit correction : 1.19323
hit initial : 454.676 | hit correction : 1.19244
hit initial : 139.085 | hit correction : 1.19181
hit initial : 462.072 | hit correction : 1.19149
hit initial : 414.929 | hit correction : 1.19087
hit initial : 166.123 | hit correction : 1.18989
hit initial : 487.525 | hit correction : 1.18964
hit initial : 95.1539 | hit correction : 1.18926
 *** Total Charge : 3385.96
 Looking at view: 2 | Number of hits in view: 13
13-Dec-2025 03:26:36 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0474389     0.0612609     0.0794777     0.0608284    0.00870239       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000543587   0.000730903   0.00162049    0.000649612   0.000300009      10     
end_path:ana:AnalyzeEvents         0.0467348     0.0602957     0.0770523     0.0600178    0.00835698       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19470 MB
  Peak resident set size usage (VmHWM): 1531.6 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:49 UTC       justIN version: 01.06.00