justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261264.1@dunegpschedd02.fnal.gov

Jobsub ID261264.1@dunegpschedd02.fnal.gov
Workflow ID11093
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:10:38
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 02:35:18
From worker nodeHostnamedunegli-7875881-0-fnpc19128.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:11:33
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T004118Z_gen_002683_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (15800s)
CPU time4h (15658s = 99%)
Max RSS bytes2977767424 (2839 MiB)
Outputting started2025-12-12 02:34:53
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11093/1/001/analysisLowE_20251211T221133Z.root
Finished2025-12-12 02:35:18
Saved logsjustin-logs:261264.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

519, 0.889345, 0.0102641, 
Output 3: 0.961675, 0.0327387, 0.00247756, 0.00310905, 
Output 4: 0.535118, 0.40353, 0.0508875, 0.010464, 
Output 5: 0.166041, 0.410871, 0.311433, 0.111656, 
Output 6: 0.106536, 0.206974, 0.127225, 0.559264, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 26830 at 12-Dec-2025 02:05:26 UTC
Boundary wire vector sizes: 6770, 6720, 6712
minwire 0: 49
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 792, 1291
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.126804, 
Output 1: 0.109474, 0.0693667, 0.127063, 0.694096, 
Output 2: 0.0531125, 0.252973, 0.660677, 0.0332372, 
Output 3: 0.966766, 0.0185065, 0.00333796, 0.0113899, 
Output 4: 0.432572, 0.516297, 0.0473294, 0.00380126, 
Output 5: 0.558244, 0.339541, 0.0824718, 0.0197427, 
Output 6: 0.0157734, 0.0426256, 0.0615325, 0.880069, 

12-Dec-2025 02:33:47 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:33:48 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/dd/96/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T004118Z_gen_002683_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1390.02       1563.31       1890.66       1529.15       134.129        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00211284    0.00565067     0.0189569    0.00471663    0.00458938       10     
reco:pandora:StandardPandora                            1386.86       1561.66       1889.38       1527.57       134.307        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00175285     0.023051      0.0961345     0.0114894     0.0267444       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00182077    0.00548571     0.0118114    0.00504942    0.00256961       10     
reco:pandoracalo:Calorimetry                          0.000232292   0.00142941     0.0080749    0.000492376   0.00227618       10     
reco:pandorapid:Chi2ParticleID                        7.7951e-05    0.00022374    0.000659988   0.000116686   0.000214309      10     
reco:cvnmap:CVNMapper                                  0.0283983     0.0435337     0.0737766     0.0387848     0.0141688       10     
reco:cvneva:CVNEvaluator                               0.809197       1.10541       2.52321       0.91381      0.497119        10     
reco:energyrecnumu:EnergyReco                         0.00677037     0.0769981     0.141914      0.0909381     0.0489823       10     
reco:energyrecnue:EnergyReco                          0.00089127    0.00353493     0.0115776    0.00178617    0.00354297       10     
reco:energyrecnc:EnergyReco                           0.00689012     0.0304163     0.0819453     0.0120062     0.0313817       10     
[art]:TriggerResults:TriggerResultInserter             1.332e-05    2.39672e-05   5.6701e-05     1.827e-05    1.40978e-05      10     
end_path:out1:RootOutput                               8.51e-06     1.25131e-05    2.389e-05    1.1525e-05    4.0752e-06       10     
end_path:out1:RootOutput(write)                        0.278131      0.356201      0.447235      0.312975      0.0727997       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21741 MB
  Peak resident set size usage (VmHWM): 2977.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 526.048 | hit correction : 1.16886
hit initial : 192.412 | hit correction : 1.16938
hit initial : 241.829 | hit correction : 1.17009
hit initial : 233.314 | hit correction : 1.17065
hit initial : 376.797 | hit correction : 1.17146
hit initial : 323.838 | hit correction : 1.17254
hit initial : 222.9 | hit correction : 1.17326
hit initial : 219.346 | hit correction : 1.1738
hit initial : 215.198 | hit correction : 1.1743
hit initial : 234.615 | hit correction : 1.17478
hit initial : 233.313 | hit correction : 1.17529
hit initial : 98.5457 | hit correction : 1.17559
 *** Total Charge : 3902.29
 Looking at view: 2 | Number of hits in view: 14
Begin processing the 10th record. run: 5027 subRun: 0 event: 26830 at 12-Dec-2025 02:34:49 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  52
Added hit list length: 52 | Max was set to: -3.40282e+38
True Neutron Energy: 944.738
True Electron Energy: 33.0556
Completed MCParticle Loop
True Neutrino Energy: 38.4861
 Size of all hits: 52
hit initial : 34.5728 | hit correction : 1.46365
hit initial : 19.8107 | hit correction : 1.46364
hit initial : 26.7082 | hit correction : 1.47064
hit initial : 28.8298 | hit correction : 1.47067
hit initial : 23.4415 | hit correction : 1.47271
hit initial : 73.2722 | hit correction : 1.47192
hit initial : 22.2634 | hit correction : 1.47277
hit initial : 61.5411 | hit correction : 1.46905
hit initial : 71.0882 | hit correction : 1.46823
hit initial : 74.0553 | hit correction : 1.46725
hit initial : 199.178 | hit correction : 1.47186
hit initial : 271.654 | hit correction : 1.4716
hit initial : 263.967 | hit correction : 1.4712
hit initial : 83.0316 | hit correction : 1.47104
hit initial : 159.426 | hit correction : 1.47026
hit initial : 296.613 | hit correction : 1.46989
hit initial : 238.967 | hit correction : 1.46952
hit initial : 376.436 | hit correction : 1.46837
hit initial : 184.488 | hit correction : 1.46808
hit initial : 106.485 | hit correction : 1.46722
 *** Total Charge : 3844.67
 Looking at view: 0 | Number of hits in view: 20
hit initial : 40.0966 | hit correction : 1.46219
hit initial : 64.5853 | hit correction : 1.46218
hit initial : 66.8269 | hit correction : 1.46714
hit initial : 52.9366 | hit correction : 1.46902
hit initial : 20.7198 | hit correction : 1.46901
hit initial : 29.567 | hit correction : 1.47282
hit initial : 35.076 | hit correction : 1.47275
hit initial : 94.9551 | hit correction : 1.47192
hit initial : 160.701 | hit correction : 1.47189
hit initial : 164.499 | hit correction : 1.47175
hit initial : 172.612 | hit correction : 1.4714
hit initial : 188.992 | hit correction : 1.47111
hit initial : 170.32 | hit correction : 1.47072
hit initial : 189.732 | hit correction : 1.47016
hit initial : 222.386 | hit correction : 1.4698
hit initial : 195.491 | hit correction : 1.4695
hit initial : 177.236 | hit correction : 1.46902
hit initial : 247.844 | hit correction : 1.46838
hit initial : 273.933 | hit correction : 1.4679
hit initial : 187.054 | hit correction : 1.46734
 *** Total Charge : 4049.36
 Looking at view: 1 | Number of hits in view: 20
hit initial : 164.335 | hit correction : 1.46724
hit initial : 134.653 | hit correction : 1.47111
hit initial : 39.8126 | hit correction : 1.47301
hit initial : 57.0722 | hit correction : 1.47276
hit initial : 130.912 | hit correction : 1.4719
hit initial : 305.16 | hit correction : 1.47183
hit initial : 327.032 | hit correction : 1.47122
hit initial : 301.723 | hit correction : 1.47015
hit initial : 409.752 | hit correction : 1.46953
hit initial : 332.743 | hit correction : 1.46885
hit initial : 31.7788 | hit correction : 1.46819
hit initial : 402.598 | hit correction : 1.46793
 *** Total Charge : 3876.99
 Looking at view: 2 | Number of hits in view: 12
12-Dec-2025 02:34:53 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.106199      0.130263      0.158361      0.132282      0.0149246       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000439566   0.000771775   0.00166564    0.000622142   0.000385392      10     
end_path:ana:AnalyzeEvents         0.105597      0.129315      0.157372      0.131486      0.014931        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475 MB
  Peak resident set size usage (VmHWM): 1535.11 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:20:01 UTC       justIN version: 01.06.00