Jobsub ID 288615.4@dunegpschedd02.fnal.gov

Jobsub ID	288615.4@dunegpschedd02.fnal.gov
Workflow ID	12080
Stage ID	4
User name	usher@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	28800 (8 hours)
Submitted time	2026-01-20 14:58:46
Site	NL_SURFsara
Entry	DUNE_SurfSARA_arc03
Last heartbeat	2026-01-20 15:00:47
From worker node	Hostname	wn-lb-13.gina.surf.nl
	cpuinfo	AMD EPYC 9754 128-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	129600 (36 hours)
	GPU
	Inner Apptainer?	True
Job state	jobscript_error
Started	2026-01-20 14:59:31
Input files	usertests:mpvmpr_monte-carlo-012080-003579_gen_g4_detsim.root
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
	Max RSS bytes	0 (0 MiB)
Outputting started
Output files
Finished	2026-01-20 15:00:47
Saved logs	justin-logs:288615.4-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

cv::SparseTensor3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel3D.h
   requested to autoload type larcv::ClusterVoxel3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel3D.h
   requested to autoload type larcv::EventClusterVoxel3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel3D.h
   requested to autoload type larcv::EventSparseTensor3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventNeutrino.h
   requested to autoload type larcv::EventNeutrino
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventCRTHit.h
   requested to autoload type larcv::EventCRTHit
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ClusterTensorUtils.h
   requested to autoload type larcv::FlatTensorContents
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventChStatus.h
   requested to autoload type larcv::EventChStatus
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventTrigger.h
   requested to autoload type larcv::EventTrigger
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventImage2D.h
   requested to autoload type larcv::EventImage2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ParentParticleSeg.h
   requested to autoload type larcv::ParentParticleSeg
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for PyImageMaker.h
   requested to autoload type larcv::PyImageMaker
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for load_pyutil.h
   requested to autoload type larcv::load_pyutil
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessBase.h
   requested to autoload type larcv::ProcessBase
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessFactory.h
   requested to autoload type larcv::ProcessFactory
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessDriver.h
   requested to autoload type larcv::ProcessDriver
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for CSVReader.h
   requested to autoload type larcv::CSVData
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/dune10kt_v6_refactored_1x2x6.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Error: Unsupported GDML Tag Used :gdml_simple_extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :extension. Please Check Geometry/Schema.
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1149
Info in <TGeoManager::CloseGeometry>: 67545 nodes/ 5439 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
GeoApaChannelGroupService::ctor: Group 0 (apa00) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 1 (apa01) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 2 (apa02) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 3 (apa03) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 4 (apa04) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 5 (apa05) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 6 (apa06) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 7 (apa07) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 8 (apa08) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 9 (apa09) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 10 (apa10) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 11 (apa11) has 2560 channels from 4/4 readout planes.
DuneToolManager::fclFilename: Taking fcl name from command line: lar -c standard_mythical_supera_dune10kt_1x2x6.fcl -s root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/38/cf/mpvmpr_monte-carlo-012080-003579_gen_g4_detsim.root -o mpvmpr_monte-carlo-012080-003579_gen_g4_detsim_reco.root -n -1
AcdDigitReader::ctor:     LogLevel: 1
DuneToolManager::getPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0x8439000
StandardRawDigitPrepService::ctor:   Extract service: @0x84cd620
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0x3427a90
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x172bb30
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x1729f60
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Deconvolution::BuildExtraFilter sigma is 4.60087
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=0 Type: SuperaMCTruth w/ Name: MultiPartVrtx
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=1 Type: SuperaBBoxInteraction w/ Name: SuperaBBoxInteraction
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=2 Type: SuperaMCParticleCluster w/ Name: SuperaMCParticleCluster
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=3 Type: SuperaSimEnergyDeposit w/ Name: SuperaSimEnergyDeposit
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=4 Type: SuperaSpacePoint w/ Name: SuperaSpacePoint
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=5 Type: Tensor3DFromCluster3D w/ Name: Tensor3DFromCluster3D
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=6 Type: CombineTensor3D w/ Name: CombineTensor3DGhost
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=7 Type: ThresholdTensor3D w/ Name: ThresholdTensor3D
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=8 Type: CombineTensor3D w/ Name: CombineTensor3D
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=9 Type: ParticleCorrector w/ Name: ParticleCorrector
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=10 Type: EmptyTensorFilter w/ Name: EmptyTensorFilter
    [95m[NORMAL][00m [0m [94m<ProcessDriver::configure>[00m Instantiating Process ID=11 Type: RescaleChargeTensor3D w/ Name: RescaleChargeTensor3D
20-Jan-2026 16:00:15 CET  Initiating request to open input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/38/cf/mpvmpr_monte-carlo-012080-003579_gen_g4_detsim.root"
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  20-Jan-2026 16:00:17 CET ModuleConstruction
cet::exception caught in art
---- FileOpenError BEGIN
  RootInputFileSequence::initFile(): Input file root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/usertests/38/cf/mpvmpr_monte-carlo-012080-003579_gen_g4_detsim.root was not found or could not be opened.
---- FileOpenError END
%MSG
Art has completed and will exit with status 20.
mv: cannot stat 'larcv.root': No such file or directory
ERROR: Output file mpvmpr_monte-carlo-012080-003579_gen_g4_detsim_reco.root not produced!