justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261332.1@dunegpschedd02.fnal.gov

Jobsub ID261332.1@dunegpschedd02.fnal.gov
Workflow ID11091
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 23:02:41
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 03:18:26
From worker nodeHostnamedunegli-7877333-0-fnpc19105.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 23:04:30
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T205658Z_gen_003497_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (15221s)
CPU time4h (15087s = 99%)
Max RSS bytes3055079424 (2913 MiB)
Outputting started2025-12-12 03:18:12
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11091/1/001/analysisLowE_20251211T230431Z.root
Finished2025-12-12 03:18:26
Saved logsjustin-logs:261332.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Output 1: 0.0581641, 0.0676934, 0.128435, 0.745708, 
Output 2: 0.0751828, 0.207988, 0.694672, 0.0221577, 
Output 3: 0.963982, 0.0304613, 0.00201477, 0.00354149, 
Output 4: 0.378418, 0.566369, 0.0508518, 0.00436135, 
Output 5: 0.540848, 0.394971, 0.0538615, 0.0103194, 
Output 6: 0.0198552, 0.0659241, 0.0763939, 0.837827, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 34970 at 12-Dec-2025 02:48:50 UTC
Boundary wire vector sizes: 6559, 6468, 6622
minwire 0: 30
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0983134, 
Output 1: 0.137843, 0.183729, 0.163743, 0.514685, 
Output 2: 0.0137437, 0.138624, 0.842074, 0.00555883, 
Output 3: 0.966118, 0.0253731, 0.00251068, 0.00599816, 
Output 4: 0.523235, 0.406475, 0.0622675, 0.00802267, 
Output 5: 0.260904, 0.560017, 0.158315, 0.020764, 
Output 6: 0.0195274, 0.0500903, 0.0656488, 0.864734, 

12-Dec-2025 03:17:32 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:17:32 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/b3/09/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T205658Z_gen_003497_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1446.33       1508.43       1718.54       1495.27       73.8096        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00156367    0.00662548     0.0260757    0.00377953    0.00705528       10     
reco:pandora:StandardPandora                            1443.4        1507.02       1717.24       1494.01       73.9308        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0015789     0.019075      0.0633754     0.016423      0.0183469       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00129322    0.00457032     0.0112116    0.00428247    0.00274246       10     
reco:pandoracalo:Calorimetry                          0.000194532   0.00480758     0.0226327    0.000356647   0.00858492       10     
reco:pandorapid:Chi2ParticleID                         5.717e-05    0.000193408   0.000846256   9.00355e-05   0.000228927      10     
reco:cvnmap:CVNMapper                                  0.0231879     0.0262058     0.0343784     0.0255135    0.00296755       10     
reco:cvneva:CVNEvaluator                               0.794349      0.966758       2.31227      0.813781      0.448796        10     
reco:energyrecnumu:EnergyReco                         0.00172659     0.0475782     0.134909      0.0409911     0.0423596       10     
reco:energyrecnue:EnergyReco                          0.000814596   0.00273987    0.00666831    0.00123154    0.00256874       10     
reco:energyrecnc:EnergyReco                           0.00644417     0.042995      0.0860889     0.0400143     0.0365393       10     
[art]:TriggerResults:TriggerResultInserter             1.163e-05    1.85652e-05   5.9871e-05     1.281e-05    1.39908e-05      10     
end_path:out1:RootOutput                               4.69e-06     7.7802e-06     2.092e-05    6.0505e-06    4.51612e-06      10     
end_path:out1:RootOutput(write)                        0.263441      0.293675      0.343069      0.291463      0.0191006       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21779.1 MB
  Peak resident set size usage (VmHWM): 3055.08 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 153.383 | hit correction : 1.06643
 *** Total Charge : 4965.57
 Looking at view: 0 | Number of hits in view: 26
hit initial : 98.5372 | hit correction : 1.06766
hit initial : 160.778 | hit correction : 1.06769
hit initial : 63.259 | hit correction : 1.06646
hit initial : 86.5206 | hit correction : 1.0677
hit initial : 107.017 | hit correction : 1.06725
hit initial : 304.354 | hit correction : 1.06724
hit initial : 230.626 | hit correction : 1.06723
hit initial : 48.3067 | hit correction : 1.06723
hit initial : 143.003 | hit correction : 1.06698
hit initial : 167.941 | hit correction : 1.06689
hit initial : 350.683 | hit correction : 1.06685
hit initial : 279.918 | hit correction : 1.06686
hit initial : 270.931 | hit correction : 1.06679
hit initial : 281.993 | hit correction : 1.06669
hit initial : 307.33 | hit correction : 1.06657
hit initial : 375.7 | hit correction : 1.06652
hit initial : 317.454 | hit correction : 1.06649
hit initial : 243.889 | hit correction : 1.06647
hit initial : 229.537 | hit correction : 1.06646
hit initial : 199.027 | hit correction : 1.06644
hit initial : 98.6176 | hit correction : 1.06643
 *** Total Charge : 4657.12
 Looking at view: 1 | Number of hits in view: 21
Begin processing the 10th record. run: 5026 subRun: 0 event: 34970 at 12-Dec-2025 03:18:09 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  42
Added hit list length: 42 | Max was set to: -3.40282e+38
True Neutron Energy: 939.573
True Electron Energy: 29.1114
Completed MCParticle Loop
True Neutrino Energy: 35.3031
 Size of all hits: 42
hit initial : 21.2417 | hit correction : 1.21135
hit initial : 47.2023 | hit correction : 1.21131
hit initial : 39.9176 | hit correction : 1.21132
hit initial : 80.5275 | hit correction : 1.21063
hit initial : 279.486 | hit correction : 1.21074
hit initial : 103.729 | hit correction : 1.21147
hit initial : 147.215 | hit correction : 1.21076
hit initial : 26.4185 | hit correction : 1.21115
hit initial : 119.029 | hit correction : 1.2121
hit initial : 259.215 | hit correction : 1.21239
hit initial : 358.415 | hit correction : 1.21286
hit initial : 306.321 | hit correction : 1.21327
hit initial : 210.075 | hit correction : 1.21348
hit initial : 178.235 | hit correction : 1.21354
hit initial : 181.663 | hit correction : 1.21358
hit initial : 211.326 | hit correction : 1.21363
hit initial : 224.709 | hit correction : 1.21369
hit initial : 230.419 | hit correction : 1.21375
hit initial : 165.056 | hit correction : 1.21379
hit initial : 48.6389 | hit correction : 1.21382
 *** Total Charge : 3927.87
 Looking at view: 0 | Number of hits in view: 20
hit initial : 47.886 | hit correction : 1.21131
hit initial : 56.5068 | hit correction : 1.21129
hit initial : 85.6677 | hit correction : 1.2106
hit initial : 217.391 | hit correction : 1.21163
hit initial : 365.446 | hit correction : 1.2107
hit initial : 57.5169 | hit correction : 1.21129
hit initial : 169.17 | hit correction : 1.21217
hit initial : 142.315 | hit correction : 1.21245
hit initial : 127.138 | hit correction : 1.21267
hit initial : 151.578 | hit correction : 1.2129
hit initial : 145.523 | hit correction : 1.21308
hit initial : 156.44 | hit correction : 1.21335
hit initial : 210.528 | hit correction : 1.21346
hit initial : 180.727 | hit correction : 1.21352
hit initial : 196.662 | hit correction : 1.21358
hit initial : 197.954 | hit correction : 1.21361
hit initial : 185.452 | hit correction : 1.21363
hit initial : 152.513 | hit correction : 1.2137
hit initial : 163.591 | hit correction : 1.21376
hit initial : 122.127 | hit correction : 1.21379
hit initial : 106.43 | hit correction : 1.21381
hit initial : 35.2732 | hit correction : 1.21383
 *** Total Charge : 3970.31
 Looking at view: 2 | Number of hits in view: 22
12-Dec-2025 03:18:12 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0666577     0.0855928     0.101331      0.0860837     0.0124474       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000361922   0.00168148     0.0118483    0.000469594   0.00339479       10     
end_path:ana:AnalyzeEvents         0.0650639     0.0837518     0.100535      0.0852725     0.0134969       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19477.7 MB
  Peak resident set size usage (VmHWM): 1539.78 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:25:18 UTC       justIN version: 01.06.00