justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261360.0@dunegpschedd02.fnal.gov

Jobsub ID261360.0@dunegpschedd02.fnal.gov
Workflow ID11094
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 23:48:43
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 01:35:50
From worker nodeHostnamedunegli-8033250-0-fnpc23041.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 23:49:21
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T165218Z_gen_000676_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time1h (6375s)
CPU time1h (6323s = 99%)
Max RSS bytes3031171072 (2890 MiB)
Outputting started2025-12-12 01:35:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11094/1/001/analysisLowE_20251211T234921Z.root
Finished2025-12-12 01:35:50
Saved logsjustin-logs:261360.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ut 1: 0.135194, 0.133421, 0.164264, 0.567121, 
Output 2: 0.037673, 0.188239, 0.754968, 0.0191197, 
Output 3: 0.961537, 0.0274881, 0.00369098, 0.0072839, 
Output 4: 0.534533, 0.384819, 0.0696222, 0.0110258, 
Output 5: 0.335144, 0.459718, 0.168919, 0.0362187, 
Output 6: 0.0519732, 0.0979417, 0.0999044, 0.750181, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 6760 at 12-Dec-2025 01:24:31 UTC
Boundary wire vector sizes: 6923, 6900, 6779
minwire 0: 26
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.113895, 
Output 1: 0.137333, 0.0593259, 0.240651, 0.56269, 
Output 2: 0.0694815, 0.103832, 0.803554, 0.0231323, 
Output 3: 0.961699, 0.0286935, 0.00331118, 0.00629674, 
Output 4: 0.497837, 0.45839, 0.0374521, 0.00632014, 
Output 5: 0.325508, 0.472874, 0.15209, 0.0495285, 
Output 6: 0.0828457, 0.158861, 0.108414, 0.649879, 

12-Dec-2025 01:35:07 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 01:35:07 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/be/74/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T165218Z_gen_000676_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              617.204       628.624       638.543       628.073       6.83529        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00139238    0.00724336     0.022746     0.00426249     0.006995        10     
reco:pandora:StandardPandora                            616.175       627.442       637.55        626.523       6.80242        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000983499    0.0142788     0.0501325     0.010615      0.0145082       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00204993    0.00387511    0.00982591    0.00300215    0.00221672       10     
reco:pandoracalo:Calorimetry                          0.000135606   0.00218992     0.0175539    0.000283015   0.00514647       10     
reco:pandorapid:Chi2ParticleID                        4.0145e-05    0.000130003   0.000762342   6.50775e-05   0.000211056      10     
reco:cvnmap:CVNMapper                                  0.0147843     0.0174351     0.0251317     0.0170044    0.00280386       10     
reco:cvneva:CVNEvaluator                               0.687004      0.808503       1.67822      0.705621      0.290809        10     
reco:energyrecnumu:EnergyReco                         0.00282095     0.0422862     0.0863912     0.0530272     0.0323193       10     
reco:energyrecnue:EnergyReco                          0.000758835   0.00131116    0.00472088    0.000906885   0.00115804       10     
reco:energyrecnc:EnergyReco                           0.00447093     0.0746953     0.555623     0.00490301     0.161839        10     
[art]:TriggerResults:TriggerResultInserter             7.474e-06    1.26058e-05   4.5797e-05    9.1525e-06    1.10905e-05      10     
end_path:out1:RootOutput                               2.084e-06     4.184e-06    1.6251e-05    2.3995e-06    4.14409e-06      10     
end_path:out1:RootOutput(write)                        0.200022       0.20994      0.229888      0.207995     0.00781475       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21773.1 MB
  Peak resident set size usage (VmHWM): 3031.17 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 Looking at view: 1 | Number of hits in view: 19
hit initial : 111.125 | hit correction : 1.27281
hit initial : 342.465 | hit correction : 1.27355
hit initial : 253.002 | hit correction : 1.27441
hit initial : 44.3259 | hit correction : 1.27451
hit initial : 65.5024 | hit correction : 1.27013
hit initial : 224.389 | hit correction : 1.26992
hit initial : 147.747 | hit correction : 1.26933
hit initial : 182.049 | hit correction : 1.26959
hit initial : 219.355 | hit correction : 1.26944
hit initial : 354.293 | hit correction : 1.27001
hit initial : 102.59 | hit correction : 1.27055
hit initial : 350.462 | hit correction : 1.2707
hit initial : 242.594 | hit correction : 1.27087
hit initial : 126.786 | hit correction : 1.27082
hit initial : 137.581 | hit correction : 1.27065
hit initial : 115.229 | hit correction : 1.27061
hit initial : 108.643 | hit correction : 1.27057
hit initial : 273.173 | hit correction : 1.27222
hit initial : 207.286 | hit correction : 1.27189
hit initial : 197.42 | hit correction : 1.27161
hit initial : 165.319 | hit correction : 1.2712
 *** Total Charge : 5048.49
 Looking at view: 2 | Number of hits in view: 21
Begin processing the 10th record. run: 5026 subRun: 0 event: 6760 at 12-Dec-2025 01:35:34 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  44
Added hit list length: 44 | Max was set to: -3.40282e+38
True Neutron Energy: 939.572
True Electron Energy: 42.0067
Completed MCParticle Loop
True Neutrino Energy: 57.507
 Size of all hits: 44
hit initial : 125.761 | hit correction : 1.34658
hit initial : 314.823 | hit correction : 1.34659
hit initial : 180.869 | hit correction : 1.3466
hit initial : 110.061 | hit correction : 1.34848
hit initial : 275.184 | hit correction : 1.34841
hit initial : 367.276 | hit correction : 1.34825
hit initial : 411.993 | hit correction : 1.34797
hit initial : 320.389 | hit correction : 1.34744
hit initial : 365.017 | hit correction : 1.34768
hit initial : 272.987 | hit correction : 1.34724
hit initial : 233.804 | hit correction : 1.34722
hit initial : 188.009 | hit correction : 1.34746
hit initial : 199.102 | hit correction : 1.34782
hit initial : 194.852 | hit correction : 1.34814
hit initial : 264.761 | hit correction : 1.34825
hit initial : 285.456 | hit correction : 1.3482
hit initial : 119.392 | hit correction : 1.34815
 *** Total Charge : 5700.4
 Looking at view: 0 | Number of hits in view: 17
hit initial : 53.6954 | hit correction : 1.35034
hit initial : 74.0135 | hit correction : 1.35034
hit initial : 40.081 | hit correction : 1.3478
hit initial : 222.586 | hit correction : 1.34839
hit initial : 352.362 | hit correction : 1.34818
hit initial : 264.468 | hit correction : 1.34797
hit initial : 198.927 | hit correction : 1.34772
hit initial : 118.659 | hit correction : 1.3472
hit initial : 159.519 | hit correction : 1.3474
hit initial : 92.4174 | hit correction : 1.34714
hit initial : 116.88 | hit correction : 1.34714
hit initial : 124.63 | hit correction : 1.34721
hit initial : 110.821 | hit correction : 1.34734
hit initial : 128.639 | hit correction : 1.34744
hit initial : 106.936 | hit correction : 1.34752
hit initial : 101.243 | hit correction : 1.34761
hit initial : 123.349 | hit correction : 1.34766
hit initial : 157.932 | hit correction : 1.34773
hit initial : 113.804 | hit correction : 1.34789
hit initial : 104.887 | hit correction : 1.34801
hit initial : 142.193 | hit correction : 1.3481
hit initial : 130.155 | hit correction : 1.34818
hit initial : 99.6461 | hit correction : 1.34831
hit initial : 126.278 | hit correction : 1.34838
hit initial : 166.292 | hit correction : 1.34844
hit initial : 131.597 | hit correction : 1.34848
hit initial : 70.3925 | hit correction : 1.3485
 *** Total Charge : 4896.35
 Looking at view: 2 | Number of hits in view: 27
12-Dec-2025 01:35:36 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0525143     0.0629286     0.0858346     0.0607471    0.00849852       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000283777   0.000421447   0.000879342   0.000358057   0.000173573      10     
end_path:ana:AnalyzeEvents         0.0520192     0.062367      0.0844185     0.0603537    0.00825195       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19472.8 MB
  Peak resident set size usage (VmHWM): 1536.34 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:56 UTC       justIN version: 01.06.00