Jobsub ID 303700.29@dunegpschedd01.fnal.gov
Jobscript log (last 10,000 characters)
_reco_tpc_tree entry 19
[94m[DEBUG][00m [0m [94m<IOManager::save_entry>[00m IOManager.cxx::L416 Saving sparse3d_reco_hit_charge0_tree entry 19
[94m[DEBUG][00m [0m [94m<IOManager::save_entry>[00m IOManager.cxx::L416 Saving sparse3d_reco_hit_charge1_tree entry 19
[94m[DEBUG][00m [0m [94m<IOManager::save_entry>[00m IOManager.cxx::L416 Saving sparse3d_reco_hit_charge2_tree entry 19
[94m[DEBUG][00m [0m [94m<IOManager::save_entry>[00m IOManager.cxx::L416 Saving sparse3d_reco_hit_key0_tree entry 19
[94m[DEBUG][00m [0m [94m<IOManager::save_entry>[00m IOManager.cxx::L416 Saving sparse3d_reco_hit_key1_tree entry 19
[94m[DEBUG][00m [0m [94m<IOManager::save_entry>[00m IOManager.cxx::L416 Saving sparse3d_reco_hit_key2_tree entry 19
[94m[DEBUG][00m [0m [94m<IOManager::clear_entry>[00m IOManager.cxx::L460 Set _last_event_id to externally set values: run = 42421 subrun = 1 event = 2577
Begin processing the 21st record. run: 42421 subRun: 1 event: 2583 at 04-Feb-2026 02:03:03 UTC
PandoraContentApi::GetList(*this, m_inputHitListName, pCaloHitList) return STATUS_CODE_NOT_INITIALIZED
in function: GetVolumeIdToHitListMap
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/ALMA9/build/larpandoracontent/v04_18_01-buildFW/src/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 271
this->GetVolumeIdToHitListMap(volumeIdToHitListMap) return STATUS_CODE_NOT_INITIALIZED
in function: Run
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/ALMA9/build/larpandoracontent/v04_18_01-buildFW/src/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 165
iter->second->Run() throw STATUS_CODE_NOT_INITIALIZED
in function: RunAlgorithm
in file: /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/ALMA9/build/pandora/v04_17_05/src/pandora-v04-17-05/PandoraSDK-v04-01-00/src/Api/PandoraContentApiImpl.cc line#: 263
Failure in algorithm Alg0003, LArMaster, STATUS_CODE_NOT_INITIALIZED
[94m[DEBUG][00m [0m [94m<ProcessDriver::process_ptr>[00m ProcessDriver.cxx::L84 Called
[94m[DEBUG][00m [0m [94m<ProcessDriver::process_ptr>[00m ProcessDriver.cxx::L84 Called
Attempted to load data: cluster3d
[92m[INFO][00m [0m [94m<IOManager::set_id::L569>[00m Request to set event id: 0042421_00001_002583
[94m[DEBUG][00m [0m [94m<ProcessDriver::process_entry>[00m ProcessDriver.cxx::L314 Called
[92m[INFO][00m [0m [94m<SuperaBBoxInteraction::process::L173>[00m 3D Meta:X range: -514.08 => 514.08 ... 1344 bins
Y range: -342.72 => 342.72 ... 896 bins
Z range: -21.71 => 321.01 ... 448 bins
[94m[DEBUG][00m [0m [94m<IOManager::get_data>[00m IOManager.cxx::L499 start
[94m[DEBUG][00m [0m [94m<IOManager::producer_id>[00m IOManager.cxx::L479 start
[94m[DEBUG][00m [0m [94m<IOManager::get_data>[00m IOManager.cxx::L519 start
[94m[DEBUG][00m [0m [94m<IOManager::get_data>[00m IOManager.cxx::L499 start
[94m[DEBUG][00m [0m [94m<IOManager::producer_id>[00m IOManager.cxx::L479 start
[94m[DEBUG][00m [0m [94m<IOManager::get_data>[00m IOManager.cxx::L519 start
[92m[INFO][00m [0m [94m<SuperaSpacePoint::process::L83>[00m Voxel3DMeta: X range: -514.08 => 514.08 ... 1344 bins
Y range: -342.72 => 342.72 ... 896 bins
Z range: -21.71 => 321.01 ... 448 bins
[94m[DEBUG][00m [0m [94m<ProcessDriver::finalize>[00m ProcessDriver.cxx::L424 called
[92m[INFO][00m [0m [94m<ProcessDriver::finalize::L427>[00m Finalizing: SuperaBBoxInteraction
[92m[INFO][00m [0m [94m<ProcessDriver::finalize::L427>[00m Finalizing: SuperaSpacePoint
[92m[INFO][00m [0m [94m<ProcessDriver::finalize::L434>[00m Compiling time profile...
[92m[INFO][00m [0m [94m<ProcessDriver::finalize::L457>[00m Finalizing IO...
[94m[DEBUG][00m [0m [94m<IOManager::finalize>[00m IOManager.cxx::L611 start
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Writing sparse3d_reco_tree with 20 entries
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Writing sparse3d_reco_chi2_tree with 20 entries
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Writing sparse3d_reco_cryo_tree with 20 entries
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Writing sparse3d_reco_tpc_tree with 20 entries
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Writing sparse3d_reco_hit_charge0_tree with 20 entries
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Writing sparse3d_reco_hit_charge1_tree with 20 entries
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Writing sparse3d_reco_hit_charge2_tree with 20 entries
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Writing sparse3d_reco_hit_key0_tree with 20 entries
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Writing sparse3d_reco_hit_key1_tree with 20 entries
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Writing sparse3d_reco_hit_key2_tree with 20 entries
[95m[NORMAL][00m [0m [94m<IOManager::finalize>[00m Closing output file
[92m[INFO][00m [0m [94m<IOManager::finalize::L639>[00m Deleting data pointers
[94m[DEBUG][00m [0m [94m<IOManager::reset>[00m IOManager.cxx::L647 start
[92m[INFO][00m [0m [94m<ProcessDriver::finalize::L459>[00m Resetting...
[94m[DEBUG][00m [0m [94m<ProcessDriver::reset>[00m ProcessDriver.cxx::L25 Called
[94m[DEBUG][00m [0m [94m<IOManager::reset>[00m IOManager.cxx::L647 start
04-Feb-2026 02:03:03 UTC Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/c4/97/np02vd_raw_run042421_0015_df-s03-d1_dw_0_20260203T133906_reco_stage0_20260204T003050_offline.root"
===========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===========================================================================================================================================
Full event 0.0126033 43.0245 87.0209 41.8018 20.0513 21
-------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000423147 0.00195922 0.0145411 0.000598422 0.00379584 21
produce:opflash:OpFlashFinderVerticalDrift 0.00788508 0.011936 0.0304396 0.0100885 0.00565054 21
produce:pandora:StandardPandora 0.000600466 40.5787 83.523 40.0756 19.3838 21
produce:pandoraWriter:StandardPandora 8.9752e-05 0.0849538 0.125577 0.0877762 0.0244266 21
produce:pandoraTrack:LArPandoraTrackCreation 0.000107635 0.969084 1.93502 0.977624 0.429404 21
produce:pandoraShower:LArPandoraModularShowerCreation 0.000123996 0.176992 0.262234 0.190994 0.0595794 21
produce:pandoraGnocalo:GnocchiCalorimetry 8.1756e-05 0.0247633 0.037144 0.0248059 0.0089164 21
produce:pandorapid:Chi2ParticleID 3.0158e-05 0.00181023 0.00302393 0.00189363 0.0005788 21
[art]:TriggerResults:TriggerResultInserter 1.1502e-05 1.86319e-05 4.4054e-05 1.4919e-05 8.97328e-06 21
end_path:out1:RootOutput 3.206e-06 7.65167e-06 2.2072e-05 7.183e-06 3.95567e-06 21
end_path:supera:LArSoftSuperaDriver 0.331381 1.02755 1.99961 0.981958 0.383593 20
end_path:out1:RootOutput(write) 0.102127 0.183707 0.253265 0.188773 0.0425276 20
===========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 2376.93 MB
Peak resident set size usage (VmHWM): 1267.18 MB
Details saved in: 'mem.db'
====================================================================================================
%MSG-s ArtException: PostEndJob 04-Feb-2026 02:03:03 UTC ModuleEndJob
---- EventProcessorFailure BEGIN
EventProcessor: an exception occurred during current event processing
---- EventProcessorFailure BEGIN
EndPathExecutor: an exception occurred during current event processing
---- ScheduleExecutionFailure BEGIN
Path: ProcessingStopped.
---- ProductNotFound BEGIN
Found zero products matching all selection criteria
C++ type: std::vector<recob::SpacePoint>
Module label: 'cluster3d'
Product instance name: ''
Process name: (empty)
The above exception was thrown while processing module LArSoftSuperaDriver/supera run: 42421 subRun: 1 event: 2583
---- ProductNotFound END
Exception going through path end_path
---- ScheduleExecutionFailure END
---- EventProcessorFailure END
---- EventProcessorFailure END
---- FatalRootError BEGIN
Fatal Root Error: TTree::SetEntries
Tree branches have different numbers of entries, eg EventAuxiliary has 20 entries while recob::SpacePoints_cluster3d_Vertex_pdvdofflinestage0. has 28 entries.
ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
Error in reco1 