justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263739.70@dunegpschedd01.fnal.gov

Jobsub ID263739.70@dunegpschedd01.fnal.gov
Workflow ID11028
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 10:49:43
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2025-12-06 07:28:11
From worker nodeHostnamedunegli-48727-0-cmswn5027.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 17:23:50
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T165427Z_gen_000709_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time14h (50650s)
CPU time13h (50290s = 99%)
Max RSS bytes2906566656 (2771 MiB)
Outputting started2025-12-06 07:28:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11028/1/001/analysisLowE_20251205T172352Z.root
Finished2025-12-06 07:28:11
Saved logsjustin-logs:263739.70-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

NOT_INITIALIZED
    in function: RunAlgorithm
    in file:     /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0005, LArDLVertexing, STATUS_CODE_NOT_INITIALIZED
Boundary wire vector sizes: 6836, 6742, 6738
minwire 0: 39
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 295, 794
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0361719, 
Output 1: 0.0339239, 0.0262056, 0.048358, 0.891513, 
Output 2: 0.0527067, 0.206884, 0.7236, 0.016809, 
Output 3: 0.922042, 0.0658488, 0.00586845, 0.00624055, 
Output 4: 0.746868, 0.180781, 0.0555228, 0.0168283, 
Output 5: 0.836264, 0.143404, 0.0167203, 0.00361148, 
Output 6: 0.0104348, 0.0430902, 0.0572029, 0.889272, 

06-Dec-2025 07:27:26 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 07:27:26 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/4a/69/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T165427Z_gen_000709_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1809.06       5036.5        6491.76       5579.64       1438.75        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00686034     0.0196323     0.0254077     0.0207124    0.00551735       10     
reco:pandora:StandardPandora                            1807.84       5032.9        6489.1        5571.34       1437.5         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000708152    0.0966821     0.522938     0.00496877     0.157034        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000483607    0.0112655     0.0665617    0.00288595     0.0191489       10     
reco:pandoracalo:Calorimetry                          0.000291363   0.00758323     0.0524613    0.000661013    0.0157644       10     
reco:pandorapid:Chi2ParticleID                        7.7668e-05    0.000769912   0.00597263    0.00016611    0.00173792       10     
reco:cvnmap:CVNMapper                                  0.0358776     0.119222       0.2221       0.128513      0.0495015       10     
reco:cvneva:CVNEvaluator                               0.828832       2.64176       11.7666       1.8139        3.07658        10     
reco:energyrecnumu:EnergyReco                         0.00854408     0.0772588     0.204045      0.0416678     0.075282        10     
reco:energyrecnue:EnergyReco                          0.00110748    0.00583344     0.0209256     0.0041831    0.00519617       10     
reco:energyrecnc:EnergyReco                           0.00514577     0.107639      0.232762       0.11639      0.0901115       10     
[art]:TriggerResults:TriggerResultInserter             2.124e-05    0.000126841   0.000556023   0.000100345   0.000148733      10     
end_path:out1:RootOutput                               9.337e-06    4.24073e-05   0.000179791   3.31325e-05   4.68454e-05      10     
end_path:out1:RootOutput(write)                        0.212568      0.514061       1.13822       0.50727      0.245731        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21783.9 MB
  Peak resident set size usage (VmHWM): 2906.57 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 120.02 | hit correction : 1.30752
hit initial : 169.846 | hit correction : 1.30768
hit initial : 175.648 | hit correction : 1.30778
hit initial : 128.831 | hit correction : 1.30804
hit initial : 127.834 | hit correction : 1.30837
hit initial : 139.34 | hit correction : 1.30857
hit initial : 172.058 | hit correction : 1.30872
hit initial : 163.577 | hit correction : 1.30894
hit initial : 117.257 | hit correction : 1.30917
hit initial : 136.318 | hit correction : 1.30936
hit initial : 119.408 | hit correction : 1.30965
hit initial : 152.936 | hit correction : 1.30984
hit initial : 198.716 | hit correction : 1.30987
hit initial : 25.1335 | hit correction : 1.30987
 *** Total Charge : 4108.92
 Looking at view: 2 | Number of hits in view: 24
Begin processing the 9th record. run: 5026 subRun: 0 event: 7089 at 06-Dec-2025 07:27:56 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  43
Added hit list length: 43 | Max was set to: -3.40282e+38
True Electron Energy: 24.7771
Completed MCParticle Loop
True Neutrino Energy: 28.5334
 Size of all hits: 43
hit initial : 106.225 | hit correction : 1.08642
hit initial : 542.017 | hit correction : 1.08641
hit initial : 81.818 | hit correction : 1.08594
hit initial : 479.759 | hit correction : 1.08598
hit initial : 961.445 | hit correction : 1.08608
hit initial : 973.819 | hit correction : 1.0863
 *** Total Charge : 3416.19
 Looking at view: 0 | Number of hits in view: 6
hit initial : 79.1502 | hit correction : 1.08649
hit initial : 63.1859 | hit correction : 1.08655
hit initial : 262.055 | hit correction : 1.08619
hit initial : 156.164 | hit correction : 1.08653
hit initial : 60.7164 | hit correction : 1.08594
hit initial : 235.477 | hit correction : 1.08592
hit initial : 262.116 | hit correction : 1.08592
hit initial : 262.578 | hit correction : 1.08604
hit initial : 333.483 | hit correction : 1.08602
hit initial : 349.857 | hit correction : 1.08613
hit initial : 301.817 | hit correction : 1.08628
hit initial : 260.741 | hit correction : 1.08638
hit initial : 233.054 | hit correction : 1.08644
hit initial : 188.675 | hit correction : 1.08648
 *** Total Charge : 3311.89
 Looking at view: 1 | Number of hits in view: 14
hit initial : 22.1751 | hit correction : 1.08305
hit initial : 152.532 | hit correction : 1.08654
hit initial : 32.2713 | hit correction : 1.08804
hit initial : 39.5093 | hit correction : 1.08788
hit initial : 81.216 | hit correction : 1.08611
hit initial : 42.5521 | hit correction : 1.08573
hit initial : 179.326 | hit correction : 1.08595
hit initial : 534.147 | hit correction : 1.08625
hit initial : 130.165 | hit correction : 1.08589
hit initial : 145.46 | hit correction : 1.08588
hit initial : 145.467 | hit correction : 1.08591
hit initial : 130.534 | hit correction : 1.08598
hit initial : 155.276 | hit correction : 1.08611
hit initial : 123.271 | hit correction : 1.08604
hit initial : 149.515 | hit correction : 1.08618
hit initial : 112.601 | hit correction : 1.08609
hit initial : 117.728 | hit correction : 1.08627
hit initial : 122.092 | hit correction : 1.08633
hit initial : 177.435 | hit correction : 1.08638
hit initial : 142.946 | hit correction : 1.08642
hit initial : 153.624 | hit correction : 1.08644
hit initial : 171.196 | hit correction : 1.08648
hit initial : 128.127 | hit correction : 1.08649
 *** Total Charge : 3464.14
 Looking at view: 2 | Number of hits in view: 23
Begin processing the 10th record. run: 5026 subRun: 0 event: 7090 at 06-Dec-2025 07:27:58 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.712
True Electron Energy: 3.24575
Completed MCParticle Loop
True Neutrino Energy: 9.43053
 Size of all hits: 0
06-Dec-2025 07:28:00 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0495872     0.065836      0.101463      0.0638521     0.0138504       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000483175   0.000647678    0.0009921    0.000601966   0.000138048      10     
end_path:ana:AnalyzeEvents         0.0487679     0.064917      0.0996446     0.0630228     0.0135947       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.4 MB
  Peak resident set size usage (VmHWM): 1529.71 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:11:01 UTC       justIN version: 01.06.00