justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267111.0@dunegpschedd01.fnal.gov

Jobsub ID267111.0@dunegpschedd01.fnal.gov
Workflow ID11117
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 23:30:43
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 03:54:18
From worker nodeHostnamedunegli-7875973-0-fnpc19114.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 23:32:21
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T013212Z_gen_003123_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (15702s)
CPU time4h (15570s = 99%)
Max RSS bytes2912735232 (2777 MiB)
Outputting started2025-12-12 03:54:04
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11117/1/001/analysisLowE_20251211T233221Z.root
Finished2025-12-12 03:54:18
Saved logsjustin-logs:267111.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

, 499
Classifier summary: 
Output 0: 0.156073, 
Output 1: 0.108593, 0.117968, 0.220155, 0.553285, 
Output 2: 0.0279732, 0.126569, 0.827174, 0.0182833, 
Output 3: 0.974513, 0.0195885, 0.00238014, 0.00351809, 
Output 4: 0.424379, 0.502907, 0.0654965, 0.00721772, 
Output 5: 0.247656, 0.372159, 0.289234, 0.090951, 
Output 6: 0.0594061, 0.141878, 0.116456, 0.68226, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 31230 at 12-Dec-2025 03:22:11 UTC
Boundary wire vector sizes: 6442, 6464, 6548
minwire 0: 15
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.108434, 
Output 1: 0.0597389, 0.0935229, 0.0759229, 0.770815, 
Output 2: 0.0654282, 0.285891, 0.620828, 0.0278525, 
Output 3: 0.981423, 0.0111848, 0.00109369, 0.00629824, 
Output 4: 0.336047, 0.616821, 0.0443651, 0.00276671, 
Output 5: 0.588777, 0.337718, 0.0584751, 0.0150306, 
Output 6: 0.0163594, 0.0553926, 0.0775422, 0.850706, 

12-Dec-2025 03:53:08 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:53:08 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/74/ea/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T013212Z_gen_003123_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1381.96       1555.58       1851.82       1480.65       166.943        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00116539    0.00563403     0.0159793     0.0035791     0.0048736       10     
reco:pandora:StandardPandora                            1380.71       1553.88       1849.91       1478.5        166.792        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00204091     0.0173372     0.0659209    0.00907331     0.018902        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00184029    0.00537981     0.0204556    0.00415182    0.00517811       10     
reco:pandoracalo:Calorimetry                          0.000289183   0.00460916     0.0264786    0.00113095    0.00762385       10     
reco:pandorapid:Chi2ParticleID                         5.648e-05    0.000254081   0.00122818    9.44855e-05   0.000358212      10     
reco:cvnmap:CVNMapper                                  0.0217688     0.0300545     0.0396072     0.030597     0.00604813       10     
reco:cvneva:CVNEvaluator                                0.82704       1.17865       2.27139       1.06724      0.428968        10     
reco:energyrecnumu:EnergyReco                         0.00922209     0.0630983     0.119958      0.077136      0.0423592       10     
reco:energyrecnue:EnergyReco                          0.000915328   0.00414914     0.011092      0.0017622    0.00352701       10     
reco:energyrecnc:EnergyReco                           0.00701256     0.0382918     0.0918291     0.0111381     0.0367744       10     
[art]:TriggerResults:TriggerResultInserter            1.4801e-05    2.52313e-05   8.1041e-05    1.8965e-05    1.88699e-05      10     
end_path:out1:RootOutput                               3.34e-06     8.0211e-06    2.5551e-05     6.49e-06     6.09758e-06      10     
end_path:out1:RootOutput(write)                        0.295058      0.350036      0.452574      0.315979      0.0593933       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21679.5 MB
  Peak resident set size usage (VmHWM): 2912.74 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 399.277 | hit correction : 1.20263
hit initial : 382.784 | hit correction : 1.20288
 *** Total Charge : 2919.31
 Looking at view: 0 | Number of hits in view: 12
hit initial : 236.433 | hit correction : 1.20363
hit initial : 474.238 | hit correction : 1.20357
hit initial : 385.812 | hit correction : 1.20338
hit initial : 64.1911 | hit correction : 1.20223
hit initial : 228.56 | hit correction : 1.20242
hit initial : 399.345 | hit correction : 1.20267
hit initial : 395.432 | hit correction : 1.2029
 *** Total Charge : 2627.58
 Looking at view: 1 | Number of hits in view: 7
hit initial : 353.32 | hit correction : 1.20351
hit initial : 207.017 | hit correction : 1.20367
hit initial : 145.279 | hit correction : 1.20365
hit initial : 139.245 | hit correction : 1.20358
hit initial : 122.885 | hit correction : 1.20344
hit initial : 160.558 | hit correction : 1.20322
hit initial : 125.228 | hit correction : 1.20303
hit initial : 149.467 | hit correction : 1.20241
hit initial : 129.55 | hit correction : 1.20221
hit initial : 31.018 | hit correction : 1.2021
hit initial : 144.051 | hit correction : 1.20256
hit initial : 116.503 | hit correction : 1.20267
hit initial : 169.293 | hit correction : 1.20279
hit initial : 206.907 | hit correction : 1.20285
 *** Total Charge : 2647.19
 Looking at view: 2 | Number of hits in view: 14
Begin processing the 10th record. run: 5027 subRun: 0 event: 31230 at 12-Dec-2025 03:53:59 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  37
Added hit list length: 37 | Max was set to: -3.40282e+38
True Neutron Energy: 939.566
True Electron Energy: 14.7791
Completed MCParticle Loop
True Neutrino Energy: 36.7417
 Size of all hits: 37
hit initial : 138.628 | hit correction : 1.27362
hit initial : 210.052 | hit correction : 1.27106
hit initial : 165.439 | hit correction : 1.27375
hit initial : 159.506 | hit correction : 1.27129
hit initial : 76.375 | hit correction : 1.27389
hit initial : 91.8171 | hit correction : 1.27006
hit initial : 396.735 | hit correction : 1.26986
hit initial : 612.432 | hit correction : 1.26973
hit initial : 129.898 | hit correction : 1.26942
 *** Total Charge : 2517.28
 Looking at view: 0 | Number of hits in view: 9
hit initial : 45.1001 | hit correction : 1.26929
hit initial : 156.435 | hit correction : 1.26933
hit initial : 271.664 | hit correction : 1.26946
hit initial : 43.5902 | hit correction : 1.27395
hit initial : 152.689 | hit correction : 1.27384
hit initial : 189.216 | hit correction : 1.27369
hit initial : 85.5762 | hit correction : 1.27123
hit initial : 226.224 | hit correction : 1.27035
hit initial : 72.2903 | hit correction : 1.27356
hit initial : 343.36 | hit correction : 1.27104
hit initial : 119.712 | hit correction : 1.27118
hit initial : 237.477 | hit correction : 1.26997
hit initial : 271.215 | hit correction : 1.26974
 *** Total Charge : 2814.51
 Looking at view: 1 | Number of hits in view: 13
hit initial : 160.558 | hit correction : 1.26931
hit initial : 205.795 | hit correction : 1.26936
hit initial : 167.581 | hit correction : 1.27026
hit initial : 76.1664 | hit correction : 1.27381
hit initial : 164.616 | hit correction : 1.27056
hit initial : 311.927 | hit correction : 1.27372
hit initial : 129.566 | hit correction : 1.27088
hit initial : 34.8083 | hit correction : 1.27397
hit initial : 19.6349 | hit correction : 1.27337
hit initial : 176.906 | hit correction : 1.27122
hit initial : 153.82 | hit correction : 1.27135
hit initial : 168.193 | hit correction : 1.26999
hit initial : 153.151 | hit correction : 1.26984
hit initial : 117.758 | hit correction : 1.26974
hit initial : 125.415 | hit correction : 1.2696
 *** Total Charge : 2752.66
 Looking at view: 2 | Number of hits in view: 15
12-Dec-2025 03:54:03 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.102502      0.122264      0.144141      0.121723      0.0126485       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000432654   0.000771263   0.00177055    0.000545715   0.00041936       10     
end_path:ana:AnalyzeEvents         0.101931      0.121285      0.143462      0.120671      0.0125515       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19472 MB
  Peak resident set size usage (VmHWM): 1531.71 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:57:48 UTC       justIN version: 01.06.00