justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267021.0@dunegpschedd01.fnal.gov

Jobsub ID267021.0@dunegpschedd01.fnal.gov
Workflow ID11112
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 21:20:36
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 01:25:32
From worker nodeHostnamedunegli-7877384-0-fnpc9054.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 21:21:42
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T002936Z_gen_000964_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (14616s)
CPU time4h (14466s = 98%)
Max RSS bytes2913472512 (2778 MiB)
Outputting started2025-12-12 01:25:19
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11112/1/001/analysisLowE_20251211T212144Z.root
Finished2025-12-12 01:25:32
Saved logsjustin-logs:267021.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0688167, 0.0757016, 0.826025, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 9640 at 12-Dec-2025 00:59:51 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 01:23:56 UTC run: 5027 subRun: 0 event: 9640
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6802, 6765, 6742
minwire 0: 47
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 726, 1225
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.121768, 
Output 1: 0.0431784, 0.385491, 0.149179, 0.422151, 
Output 2: 0.0406207, 0.247179, 0.689106, 0.0230936, 
Output 3: 0.965523, 0.0260472, 0.00290277, 0.00552709, 
Output 4: 0.390051, 0.554441, 0.0520918, 0.00341604, 
Output 5: 0.508736, 0.365707, 0.100448, 0.0251085, 
Output 6: 0.0345797, 0.0885645, 0.0943638, 0.782492, 

12-Dec-2025 01:24:02 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 01:24:02 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/62/93/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T002936Z_gen_000964_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1413.52       1438.91       1475.33       1435.35       18.0381        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0011418    0.00931303     0.0400073    0.00474997     0.0113252       10     
reco:pandora:StandardPandora                            1411.87       1436.93       1471.3        1433.3        17.5753        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00149936     0.0279269     0.110909      0.0244928     0.0312249       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00355962     0.0307128     0.216305     0.00423962     0.0624949       10     
reco:pandoracalo:Calorimetry                          0.000279074   0.00537151     0.0260727    0.000954622   0.00905112       10     
reco:pandorapid:Chi2ParticleID                        6.5525e-05    0.000279125   0.00082514    9.1156e-05    0.000303775      10     
reco:cvnmap:CVNMapper                                  0.0361237     0.0704401     0.232464      0.0535459     0.0555624       10     
reco:cvneva:CVNEvaluator                                1.04013       1.26826       3.23988       1.04681      0.657261        10     
reco:energyrecnumu:EnergyReco                         0.00501081     0.0337001     0.0898651     0.0113816     0.0354712       10     
reco:energyrecnue:EnergyReco                          0.00101074    0.00320973    0.00834156    0.00112291    0.00322793       10     
reco:energyrecnc:EnergyReco                           0.00789669     0.0648848     0.154914      0.078115      0.0435028       10     
[art]:TriggerResults:TriggerResultInserter            1.5553e-05    2.40609e-05   6.9491e-05    1.90505e-05   1.53007e-05      10     
end_path:out1:RootOutput                               4.108e-06    8.2336e-06    2.0483e-05    6.9495e-06    4.59992e-06      10     
end_path:out1:RootOutput(write)                        0.346817      0.463705       1.06176      0.385126      0.202059        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12015.2 MB
  Peak resident set size usage (VmHWM): 2913.47 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 74.1639 | hit correction : 1.34657
hit initial : 209.529 | hit correction : 1.34661
hit initial : 204.423 | hit correction : 1.34985
hit initial : 175.233 | hit correction : 1.35013
hit initial : 256.938 | hit correction : 1.35034
hit initial : 249.034 | hit correction : 1.35059
hit initial : 273.527 | hit correction : 1.35074
hit initial : 221.359 | hit correction : 1.35076
 *** Total Charge : 3021.53
 Looking at view: 0 | Number of hits in view: 12
hit initial : 85.2499 | hit correction : 1.35075
hit initial : 250.864 | hit correction : 1.35074
hit initial : 405.256 | hit correction : 1.34984
hit initial : 77.0358 | hit correction : 1.34982
hit initial : 211.67 | hit correction : 1.34897
hit initial : 133.298 | hit correction : 1.34893
hit initial : 94.0745 | hit correction : 1.34657
hit initial : 206.23 | hit correction : 1.34661
hit initial : 100.719 | hit correction : 1.34664
hit initial : 447.184 | hit correction : 1.35031
hit initial : 382.435 | hit correction : 1.35065
 *** Total Charge : 3230.76
 Looking at view: 1 | Number of hits in view: 11
hit initial : 52.3717 | hit correction : 1.35066
hit initial : 111.977 | hit correction : 1.35071
hit initial : 103.104 | hit correction : 1.35078
hit initial : 95.5941 | hit correction : 1.35082
hit initial : 147.231 | hit correction : 1.34977
hit initial : 170.775 | hit correction : 1.34933
hit initial : 160.253 | hit correction : 1.349
hit initial : 178.319 | hit correction : 1.34888
hit initial : 33.2663 | hit correction : 1.34885
hit initial : 108.637 | hit correction : 1.35
hit initial : 113.45 | hit correction : 1.3501
hit initial : 129.111 | hit correction : 1.35017
hit initial : 107.084 | hit correction : 1.35033
hit initial : 105.024 | hit correction : 1.35045
hit initial : 90.9206 | hit correction : 1.35055
hit initial : 108.237 | hit correction : 1.35065
hit initial : 105.788 | hit correction : 1.35073
hit initial : 101.549 | hit correction : 1.3508
 *** Total Charge : 2730.76
 Looking at view: 2 | Number of hits in view: 18
Begin processing the 10th record. run: 5027 subRun: 0 event: 9640 at 12-Dec-2025 01:25:13 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  23
Added hit list length: 23 | Max was set to: -3.40282e+38
True Neutron Energy: 939.57
True Electron Energy: 14.0531
Completed MCParticle Loop
True Neutrino Energy: 17.7777
 Size of all hits: 23
hit initial : 90.6543 | hit correction : 1.01426
hit initial : 17.2985 | hit correction : 1.01138
hit initial : 361.026 | hit correction : 1.0142
hit initial : 35.8408 | hit correction : 1.01136
hit initial : 590.538 | hit correction : 1.01411
hit initial : 175.766 | hit correction : 1.01409
hit initial : 209.126 | hit correction : 1.01335
hit initial : 296.884 | hit correction : 1.01349
 *** Total Charge : 1801.76
 Looking at view: 0 | Number of hits in view: 8
hit initial : 66.928 | hit correction : 1.0142
hit initial : 372.185 | hit correction : 1.01418
hit initial : 467.508 | hit correction : 1.01416
hit initial : 218.077 | hit correction : 1.01406
hit initial : 157.225 | hit correction : 1.01338
hit initial : 301.579 | hit correction : 1.01342
hit initial : 188.986 | hit correction : 1.01361
 *** Total Charge : 1797.12
 Looking at view: 1 | Number of hits in view: 7
hit initial : 214.049 | hit correction : 1.01428
hit initial : 637.963 | hit correction : 1.01417
hit initial : 157.771 | hit correction : 1.01402
hit initial : 177.793 | hit correction : 1.01387
hit initial : 153.169 | hit correction : 1.01368
hit initial : 136.294 | hit correction : 1.01335
hit initial : 149.94 | hit correction : 1.01322
hit initial : 182.457 | hit correction : 1.01347
 *** Total Charge : 1834.57
 Looking at view: 2 | Number of hits in view: 8
12-Dec-2025 01:25:17 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0803733      0.15695      0.302861      0.127053      0.0677752       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000348721    0.0169561     0.122995     0.000606917    0.0361247       10     
end_path:ana:AnalyzeEvents         0.071974      0.139827      0.302278      0.122843      0.0646632       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9811.32 MB
  Peak resident set size usage (VmHWM): 1534.82 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 15:00:04 UTC       justIN version: 01.06.00