justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260271.4@dunegpschedd02.fnal.gov

Jobsub ID260271.4@dunegpschedd02.fnal.gov
Workflow ID11090
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 14:07:00
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 09:13:55
From worker nodeHostnamedunegli-7872553-0-fnpc22023.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 05:46:02
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T025756Z_gen_004472_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (12436s)
CPU time3h (12091s = 97%)
Max RSS bytes3026784256 (2886 MiB)
Outputting started2025-12-11 09:13:19
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11090/1/001/analysisLowE_20251211T054603Z.root
Finished2025-12-11 09:13:55
Saved logsjustin-logs:260271.4-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Vertexing, STATUS_CODE_NOT_INITIALIZED
PandoraContentApi::GetList(*this, m_inputVertexListName, pVertexList) throw STATUS_CODE_NOT_INITIALIZED
    in function: GetHitRegion
    in file:     /exp/dune/app/users/osbiston/18_10_24_Official_LowE_Build/srcs/larpandoracontent/larpandoradlcontent/LArVertex/DlVertexingAlgorithm.cc line#: 624
Failure in algorithm Alg0005, LArDLVertexing, STATUS_CODE_NOT_INITIALIZED
Boundary wire vector sizes: 6750, 6709, 6800
minwire 0: 56
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 626, 1125
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0762079, 
Output 1: 0.0441659, 0.0519999, 0.147153, 0.756681, 
Output 2: 0.090901, 0.240659, 0.63742, 0.0310204, 
Output 3: 0.944203, 0.0466303, 0.00426709, 0.00489922, 
Output 4: 0.211566, 0.707718, 0.07615, 0.00456625, 
Output 5: 0.86085, 0.126991, 0.00976531, 0.00239399, 
Output 6: 0.0145167, 0.0559155, 0.0663806, 0.863187, 

11-Dec-2025 09:12:40 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 09:12:40 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/1d/f0/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T025756Z_gen_004472_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              942.103       1230.55       1559.41       1230.96       155.745        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00571369     0.0112131     0.0284157    0.00919656    0.00601681       10     
reco:pandora:StandardPandora                            940.864       1228.85       1558.26       1229.72       155.49         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000782398    0.0441747      0.25609     0.00844149     0.0736507       10     
reco:pandoraShower:LArPandoraModularShowerCreation     0.0013274     0.0127041     0.0576541    0.00716218     0.0161963       10     
reco:pandoracalo:Calorimetry                          0.000207462    0.0172193     0.0604599    0.00141398     0.024904        10     
reco:pandorapid:Chi2ParticleID                        6.9091e-05    0.000309932   0.00172966    0.000111115   0.00048719       10     
reco:cvnmap:CVNMapper                                  0.0298256     0.0641286     0.182504      0.0484224      0.04314        10     
reco:cvneva:CVNEvaluator                               0.735423       1.13612       4.23003      0.805822       1.03179        10     
reco:energyrecnumu:EnergyReco                         0.00275311     0.0461322      0.12049      0.0567923     0.035883        10     
reco:energyrecnue:EnergyReco                          0.000856617   0.00431916     0.014101     0.00278394    0.00399239       10     
reco:energyrecnc:EnergyReco                           0.00464649     0.0330136     0.0899198    0.00593032     0.0350895       10     
[art]:TriggerResults:TriggerResultInserter            1.3956e-05    3.01319e-05   0.000119405   1.9492e-05    3.0114e-05       10     
end_path:out1:RootOutput                               7.394e-06    1.4932e-05    3.8502e-05    1.2659e-05    8.75235e-06      10     
end_path:out1:RootOutput(write)                        0.249535       0.32195      0.581895      0.262983      0.105741        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21781.6 MB
  Peak resident set size usage (VmHWM): 3026.78 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 163.312 | hit correction : 1.45321
hit initial : 33.3641 | hit correction : 1.45405
hit initial : 189.093 | hit correction : 1.45414
hit initial : 71.1367 | hit correction : 1.45529
 *** Total Charge : 3821.26
 Looking at view: 1 | Number of hits in view: 20
hit initial : 81.5781 | hit correction : 1.44822
hit initial : 108.368 | hit correction : 1.44916
hit initial : 119.436 | hit correction : 1.44824
hit initial : 38.8209 | hit correction : 1.45036
hit initial : 12.069 | hit correction : 1.4484
hit initial : 79.4339 | hit correction : 1.44937
hit initial : 452.302 | hit correction : 1.44961
hit initial : 386.379 | hit correction : 1.44986
hit initial : 351.616 | hit correction : 1.45045
hit initial : 230.845 | hit correction : 1.45179
hit initial : 231.138 | hit correction : 1.45243
hit initial : 191.056 | hit correction : 1.45321
hit initial : 175.397 | hit correction : 1.45397
hit initial : 56.8282 | hit correction : 1.45406
hit initial : 259.152 | hit correction : 1.45446
hit initial : 233.253 | hit correction : 1.45519
hit initial : 100.096 | hit correction : 1.45546
 *** Total Charge : 4511.12
 Looking at view: 2 | Number of hits in view: 17
Begin processing the 8th record. run: 5027 subRun: 0 event: 44718 at 11-Dec-2025 09:13:11 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  25
Added hit list length: 25 | Max was set to: -3.40282e+38
True Electron Energy: 13.8452
Completed MCParticle Loop
True Neutrino Energy: 19.2243
 Size of all hits: 25
hit initial : 133.455 | hit correction : 1.16214
hit initial : 342.104 | hit correction : 1.16195
hit initial : 268.261 | hit correction : 1.16159
hit initial : 132.083 | hit correction : 1.16091
hit initial : 28.1636 | hit correction : 1.16092
hit initial : 195.529 | hit correction : 1.16131
hit initial : 199.302 | hit correction : 1.16114
hit initial : 198.578 | hit correction : 1.16099
hit initial : 200.754 | hit correction : 1.16093
 *** Total Charge : 1972.34
 Looking at view: 0 | Number of hits in view: 9
hit initial : 289.786 | hit correction : 1.16184
hit initial : 224.215 | hit correction : 1.16213
hit initial : 60.7444 | hit correction : 1.1622
hit initial : 312.96 | hit correction : 1.16142
hit initial : 402.791 | hit correction : 1.16112
hit initial : 348.493 | hit correction : 1.16097
hit initial : 104.983 | hit correction : 1.16093
 *** Total Charge : 2025.48
 Looking at view: 1 | Number of hits in view: 7
hit initial : 115.179 | hit correction : 1.16226
hit initial : 319.041 | hit correction : 1.16186
hit initial : 112.295 | hit correction : 1.16212
hit initial : 147.845 | hit correction : 1.16157
hit initial : 310.905 | hit correction : 1.16131
hit initial : 224.362 | hit correction : 1.16109
hit initial : 182.599 | hit correction : 1.16094
hit initial : 197.46 | hit correction : 1.16091
hit initial : 99.1121 | hit correction : 1.16092
 *** Total Charge : 1984.62
 Looking at view: 2 | Number of hits in view: 9
Begin processing the 9th record. run: 5027 subRun: 0 event: 44719 at 11-Dec-2025 09:13:14 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Electron Energy: 22.7391
Completed MCParticle Loop
True Neutrino Energy: 42.1939
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 44720 at 11-Dec-2025 09:13:16 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.566
True Neutron Energy: 945.182
True Neutron Energy: 940.083
True Electron Energy: 33.5344
Completed MCParticle Loop
True Neutrino Energy: 53.0051
 Size of all hits: 0
11-Dec-2025 09:13:18 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0512945     0.0659533     0.100894      0.0643088     0.0143239       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000498291   0.000678416   0.000983598   0.000590615   0.000182127      10     
end_path:ana:AnalyzeEvents         0.0505308     0.0650403     0.0992635     0.0633639     0.0141491       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474 MB
  Peak resident set size usage (VmHWM): 1539.83 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:28:47 UTC       justIN version: 01.06.00