justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266399.0@dunegpschedd01.fnal.gov

Jobsub ID266399.0@dunegpschedd01.fnal.gov
Workflow ID11089
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 23:27:28
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 20:23:18
From worker nodeHostnamedunegli-7872209-0-fnpc19112.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 09:08:29
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T135920Z_gen_000713_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (40474s)
CPU time10h (36363s = 89%)
Max RSS bytes3017256960 (2877 MiB)
Outputting started2025-12-11 20:23:04
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11089/1/001/analysisLowE_20251211T090830Z.root
Finished2025-12-11 20:23:18
Saved logsjustin-logs:266399.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.417269, 0.2336, 0.129174, 
Output 6: 0.250065, 0.336873, 0.135024, 0.278038, 

Begin processing the 10th record. run: 4696 subRun: 0 event: 7130 at 11-Dec-2025 19:59:12 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 20:22:25 UTC run: 4696 subRun: 0 event: 7130
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6673, 6698, 6509
minwire 0: 16
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0872137, 
Output 1: 0.240896, 0.0885167, 0.237659, 0.432928, 
Output 2: 0.0306143, 0.0928493, 0.863567, 0.012969, 
Output 3: 0.949504, 0.0416151, 0.00401253, 0.00486797, 
Output 4: 0.710876, 0.26191, 0.0227968, 0.00441727, 
Output 5: 0.302943, 0.415027, 0.212044, 0.0699858, 
Output 6: 0.0754704, 0.158357, 0.106088, 0.660084, 

11-Dec-2025 20:22:27 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 20:22:27 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/e7/04/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T135920Z_gen_000713_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1390.69       4020.54       5333.58       4545.94       1405.42        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00434262     0.0135226     0.0319165     0.0121581    0.00838103       10     
reco:pandora:StandardPandora                            1389.5         4018         5331.12       4540.69       1404.94        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000452174    0.0742022     0.288146      0.0205334     0.0961772       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00118377    0.00799548     0.0325536    0.00467039    0.00915429       10     
reco:pandoracalo:Calorimetry                          0.000233372    0.0251757     0.154021     0.000763902    0.0496673       10     
reco:pandorapid:Chi2ParticleID                        6.7951e-05    0.000431028   0.00293284    0.000164992   0.000835623      10     
reco:cvnmap:CVNMapper                                  0.0250795     0.0858183     0.160817      0.0832666     0.0472469       10     
reco:cvneva:CVNEvaluator                               0.775009       1.82788       6.68568       1.44378       1.65442        10     
reco:energyrecnumu:EnergyReco                         0.00224245     0.0509148     0.115748      0.0436915     0.0434359       10     
reco:energyrecnue:EnergyReco                          0.000837207   0.00327527    0.00952495     0.0015553    0.00316169       10     
reco:energyrecnc:EnergyReco                           0.00713412     0.071981      0.174054      0.083938      0.0566061       10     
[art]:TriggerResults:TriggerResultInserter             1.349e-05    4.81144e-05   0.000174882    3.525e-05    4.45789e-05      10     
end_path:out1:RootOutput                               8.39e-06     2.46845e-05   7.1841e-05    1.95755e-05   1.75256e-05      10     
end_path:out1:RootOutput(write)                        0.283195      0.370952      0.647645      0.355971      0.0989299       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21786.7 MB
  Peak resident set size usage (VmHWM): 3017.26 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 288.787 | hit correction : 1.03656
hit initial : 207.473 | hit correction : 1.03617
hit initial : 150.047 | hit correction : 1.03596
hit initial : 152.368 | hit correction : 1.0359
hit initial : 162.247 | hit correction : 1.03586
hit initial : 191.915 | hit correction : 1.03576
hit initial : 177.838 | hit correction : 1.03566
hit initial : 269.861 | hit correction : 1.03559
hit initial : 303.452 | hit correction : 1.03556
hit initial : 228.324 | hit correction : 1.03549
hit initial : 225.999 | hit correction : 1.03539
hit initial : 458.556 | hit correction : 1.0353
hit initial : 272.018 | hit correction : 1.03527
hit initial : 249.749 | hit correction : 1.0352
hit initial : 218.132 | hit correction : 1.03512
 *** Total Charge : 5533.05
 Looking at view: 2 | Number of hits in view: 27
Begin processing the 10th record. run: 4696 subRun: 0 event: 7130 at 11-Dec-2025 20:23:01 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  49
Added hit list length: 49 | Max was set to: -3.40282e+38
True Neutron Energy: 939.568
True Electron Energy: 29.1005
Completed MCParticle Loop
True Neutrino Energy: 44.5845
 Size of all hits: 49
hit initial : 57.0469 | hit correction : 1.35359
hit initial : 97.9529 | hit correction : 1.35465
hit initial : 187.632 | hit correction : 1.35361
hit initial : 275.682 | hit correction : 1.35509
hit initial : 72.154 | hit correction : 1.35369
hit initial : 21.0124 | hit correction : 1.35677
hit initial : 981.178 | hit correction : 1.3551
hit initial : 97.8579 | hit correction : 1.35405
hit initial : 200.962 | hit correction : 1.35506
hit initial : 817.886 | hit correction : 1.35508
 *** Total Charge : 3806.36
 Looking at view: 0 | Number of hits in view: 10
hit initial : 25.7617 | hit correction : 1.35567
hit initial : 60.6501 | hit correction : 1.35491
hit initial : 78.4539 | hit correction : 1.35367
hit initial : 104.34 | hit correction : 1.35514
hit initial : 134.165 | hit correction : 1.35362
hit initial : 182.479 | hit correction : 1.35518
hit initial : 115.244 | hit correction : 1.35363
hit initial : 243.165 | hit correction : 1.35512
hit initial : 21.2317 | hit correction : 1.35363
hit initial : 355.595 | hit correction : 1.355
hit initial : 422.415 | hit correction : 1.35502
hit initial : 164.985 | hit correction : 1.35514
hit initial : 68.0745 | hit correction : 1.3552
hit initial : 48.4354 | hit correction : 1.35852
hit initial : 111.825 | hit correction : 1.35851
hit initial : 323.867 | hit correction : 1.35508
hit initial : 196.147 | hit correction : 1.35509
hit initial : 199.024 | hit correction : 1.35509
 *** Total Charge : 3869.97
 Looking at view: 1 | Number of hits in view: 18
hit initial : 136.225 | hit correction : 1.35358
hit initial : 221.785 | hit correction : 1.35366
hit initial : 148.392 | hit correction : 1.35472
hit initial : 128.122 | hit correction : 1.35381
hit initial : 140.032 | hit correction : 1.3551
hit initial : 108.953 | hit correction : 1.35525
hit initial : 117.263 | hit correction : 1.35524
hit initial : 141.463 | hit correction : 1.35851
hit initial : 124.644 | hit correction : 1.35517
hit initial : 53.2917 | hit correction : 1.3585
hit initial : 101.765 | hit correction : 1.35514
hit initial : 136.12 | hit correction : 1.35504
hit initial : 319.995 | hit correction : 1.35492
hit initial : 233.198 | hit correction : 1.35496
hit initial : 292.479 | hit correction : 1.35512
hit initial : 38.0485 | hit correction : 1.3567
hit initial : 241.099 | hit correction : 1.35512
hit initial : 151.549 | hit correction : 1.35517
hit initial : 30.0393 | hit correction : 1.35522
hit initial : 162.136 | hit correction : 1.35509
hit initial : 203.08 | hit correction : 1.35509
 *** Total Charge : 4376.49
 Looking at view: 2 | Number of hits in view: 21
11-Dec-2025 20:23:03 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0646459     0.0769115     0.0890294     0.0766964    0.00591302       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000349693   0.00056688     0.0012307    0.000402644   0.000311351      10     
end_path:ana:AnalyzeEvents         0.0639542     0.0761664     0.0879964     0.076176     0.00583802       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19476.3 MB
  Peak resident set size usage (VmHWM): 1537.15 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:56 UTC       justIN version: 01.06.00