justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267143.1@dunegpschedd01.fnal.gov

Jobsub ID267143.1@dunegpschedd01.fnal.gov
Workflow ID11109
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-12 00:30:45
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 20:41:46
From worker nodeHostnamedunegli-7890411-0-fnpc23116.fnal.gov
cpuinfoAMD EPYC 9354 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-12 17:49:01
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T191512Z_gen_002031_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time2h (10329s)
CPU time2h (10207s = 98%)
Max RSS bytes3044999168 (2903 MiB)
Outputting started2025-12-12 20:41:11
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11109/1/001/analysisLowE_20251212T174902Z.root
Finished2025-12-12 20:41:46
Saved logsjustin-logs:267143.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

297651, 0.610098, 0.0286378, 
Output 3: 0.924437, 0.0617885, 0.00745736, 0.00631717, 
Output 4: 0.422224, 0.50525, 0.0669167, 0.00560858, 
Output 5: 0.571009, 0.378037, 0.0444838, 0.00646942, 
Output 6: 0.0269278, 0.0799833, 0.0896732, 0.803416, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 20310 at 12-Dec-2025 20:23:53 UTC
Boundary wire vector sizes: 6643, 6590, 6703
minwire 0: 13
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1982, 2481
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0803372, 
Output 1: 0.0524929, 0.0797181, 0.174446, 0.693343, 
Output 2: 0.111443, 0.225325, 0.630866, 0.032366, 
Output 3: 0.952337, 0.0386061, 0.00349442, 0.0055625, 
Output 4: 0.341883, 0.609778, 0.0449355, 0.0034033, 
Output 5: 0.784186, 0.198892, 0.0137554, 0.00316681, 
Output 6: 0.0152396, 0.052881, 0.0614796, 0.8704, 

12-Dec-2025 20:40:23 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 20:40:23 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/45/8c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T191512Z_gen_002031_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              987.012       1018.64       1060.21       1017.24       19.5043        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00725068     0.013199      0.0226862     0.0132679    0.00444415       10     
reco:pandora:StandardPandora                            985.831       1017.25       1058.97       1016.03       19.5874        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00159034     0.0375205     0.162182      0.0115341     0.0488837       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00163319    0.00531409     0.0143382    0.00486961    0.00337351       10     
reco:pandoracalo:Calorimetry                          0.000209589    0.0126961     0.0594923    0.00158421     0.0203224       10     
reco:pandorapid:Chi2ParticleID                        5.9471e-05    0.000255757   0.000760477    0.0001248    0.000243783      10     
reco:cvnmap:CVNMapper                                  0.0222133     0.0284151     0.0387066     0.0280049    0.00522668       10     
reco:cvneva:CVNEvaluator                               0.707885      0.891254       2.32183      0.730778      0.477206        10     
reco:energyrecnumu:EnergyReco                         0.00643209     0.0408871     0.120527       0.03517      0.0346896       10     
reco:energyrecnue:EnergyReco                          0.00107993    0.00462896    0.00830204    0.00467481    0.00316363       10     
reco:energyrecnc:EnergyReco                           0.00722414     0.0332343     0.0625778     0.0313615     0.025658        10     
[art]:TriggerResults:TriggerResultInserter            1.5043e-05    3.31264e-05   0.000103818   2.52935e-05   2.53074e-05      10     
end_path:out1:RootOutput                               8.082e-06    1.40544e-05   3.5274e-05    1.01905e-05   8.27369e-06      10     
end_path:out1:RootOutput(write)                        0.246408      0.324409      0.406452      0.320434      0.0465764       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21787.2 MB
  Peak resident set size usage (VmHWM): 3045 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 1062.52 | hit correction : 1.09651
hit initial : 559.477 | hit correction : 1.09651
hit initial : 43.788 | hit correction : 1.09659
hit initial : 48.3009 | hit correction : 1.09552
hit initial : 513.269 | hit correction : 1.09691
 *** Total Charge : 3942.91
 Looking at view: 2 | Number of hits in view: 11
Begin processing the 9th record. run: 5026 subRun: 0 event: 20309 at 12-Dec-2025 20:41:04 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  52
Added hit list length: 52 | Max was set to: -3.40282e+38
True Electron Energy: 33.7632
Completed MCParticle Loop
True Neutrino Energy: 50.9969
 Size of all hits: 52
hit initial : 30.4882 | hit correction : 1.40862
hit initial : 114.17 | hit correction : 1.41005
hit initial : 52.8923 | hit correction : 1.40861
hit initial : 114.084 | hit correction : 1.41002
hit initial : 30.7924 | hit correction : 1.40853
hit initial : 33.341 | hit correction : 1.41
hit initial : 92.9676 | hit correction : 1.40569
hit initial : 123.935 | hit correction : 1.40829
hit initial : 201.581 | hit correction : 1.40829
hit initial : 164.475 | hit correction : 1.40827
hit initial : 63.5724 | hit correction : 1.40747
hit initial : 268.031 | hit correction : 1.40591
hit initial : 379.379 | hit correction : 1.40621
hit initial : 313.144 | hit correction : 1.40656
hit initial : 162.129 | hit correction : 1.40681
hit initial : 284.59 | hit correction : 1.40726
 *** Total Charge : 3419.24
 Looking at view: 0 | Number of hits in view: 16
hit initial : 61.8626 | hit correction : 1.41004
hit initial : 43.7142 | hit correction : 1.40864
hit initial : 128.8 | hit correction : 1.41003
hit initial : 71.772 | hit correction : 1.40998
hit initial : 35.3586 | hit correction : 1.40842
hit initial : 82.0048 | hit correction : 1.40897
hit initial : 107.188 | hit correction : 1.40902
hit initial : 30.4844 | hit correction : 1.40553
hit initial : 123.663 | hit correction : 1.40572
hit initial : 233.402 | hit correction : 1.40595
hit initial : 246.952 | hit correction : 1.40614
hit initial : 192.645 | hit correction : 1.4064
hit initial : 174.755 | hit correction : 1.40657
hit initial : 164.059 | hit correction : 1.4067
hit initial : 170.158 | hit correction : 1.40684
hit initial : 194.127 | hit correction : 1.40704
hit initial : 206.893 | hit correction : 1.40736
hit initial : 218.602 | hit correction : 1.40781
hit initial : 219.722 | hit correction : 1.40812
hit initial : 209.458 | hit correction : 1.40832
hit initial : 158.428 | hit correction : 1.40841
 *** Total Charge : 4326.55
 Looking at view: 1 | Number of hits in view: 21
hit initial : 22.9794 | hit correction : 1.40851
hit initial : 96.8035 | hit correction : 1.40573
hit initial : 430.556 | hit correction : 1.40595
hit initial : 281.072 | hit correction : 1.40628
hit initial : 207.191 | hit correction : 1.40656
hit initial : 187.106 | hit correction : 1.40673
hit initial : 179.147 | hit correction : 1.40688
hit initial : 193.028 | hit correction : 1.40712
hit initial : 139.057 | hit correction : 1.40741
hit initial : 123.274 | hit correction : 1.40766
hit initial : 102.132 | hit correction : 1.40789
hit initial : 111.821 | hit correction : 1.40819
hit initial : 100.535 | hit correction : 1.40809
hit initial : 204.525 | hit correction : 1.40832
hit initial : 196.027 | hit correction : 1.40843
 *** Total Charge : 3623.52
 Looking at view: 2 | Number of hits in view: 15
Begin processing the 10th record. run: 5026 subRun: 0 event: 20310 at 12-Dec-2025 20:41:07 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.569
True Electron Energy: 30.3294
Completed MCParticle Loop
True Neutrino Energy: 45.8694
 Size of all hits: 0
12-Dec-2025 20:41:10 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0720662     0.0902426      0.11493      0.0869077     0.0141502       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000462904   0.00055932    0.00117653    0.00049296    0.000206793      10     
end_path:ana:AnalyzeEvents         0.0714182     0.0894627     0.113049      0.0862489     0.0139306       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.7 MB
  Peak resident set size usage (VmHWM): 1535.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:58:10 UTC       justIN version: 01.06.00