justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266808.18@dunegpschedd02.fnal.gov

Jobsub ID266808.18@dunegpschedd02.fnal.gov
Workflow ID11595
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-08 08:04:45
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-08 10:58:26
From worker nodeHostnamedunegli-8114856-0-fnpc22009.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-08 08:06:22
Input filesmonte-carlo-011595-000015
JobscriptExit code0
Real time2h (9776s)
CPU time2h (9654s = 98%)
Max RSS bytes20504539136 (19554 MiB)
Outputting started2026-01-08 10:49:40
Output filesusertests:prod_muon_400MeV_protodunevd_1_266808_18_1767859589_gen_g4_stage1_detsim_reco.root
usertests:prod_muon_400MeV_protodunevd_1_266808_18_1767859589_gen_g4_stage1_detsim_reco.log
usertests:prod_muon_400MeV_protodunevd_1_266808_18_1767859589_gen_g4_stage1_detsim_reco.err
usertests:prod_muon_400MeV_protodunevd_1_266808_18_1767859589_gen_g4_stage1_detsim_reco.root.json
usertests:larcvpdsp_mc_20260108_101249_504497.root
Finished2026-01-08 10:58:26
Saved logsjustin-logs:266808.18-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

gVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel.h
   requested to autoload type larcv::Voxel
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Flash.h
   requested to autoload type larcv::Flash
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Image2D.h
   requested to autoload type larcv::Image2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ChStatus.h
   requested to autoload type larcv::ChStatus
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ImageMeta.h
   requested to autoload type larcv::ImageMeta
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventBase.h
   requested to autoload type larcv::EventBase
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Point.h
   requested to autoload type larcv::Point2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Point.h
   requested to autoload type larcv::Point3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Vertex.h
   requested to autoload type larcv::Vertex
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel3DMeta.h
   requested to autoload type larcv::Voxel3DMeta
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Particle.h
   requested to autoload type larcv::ParticleSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for DataProductFactory.h
   requested to autoload type larcv::DataProductFactory
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventParticle.h
   requested to autoload type larcv::EventParticle
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for IOManager.h
   requested to autoload type larcv::IOManager
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Meta.h
   requested to autoload type larcv::Meta
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for CRTHit.h
   requested to autoload type larcv::CRTHitSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventBBox.h
   requested to autoload type larcv::EventBBox2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventBBox.h
   requested to autoload type larcv::EventBBox3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Trigger.h
   requested to autoload type larcv::Trigger
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventMeta.h
   requested to autoload type larcv::EventMeta
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Neutrino.h
   requested to autoload type larcv::NeutrinoSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel.h
   requested to autoload type larcv::VoxelSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel.h
   requested to autoload type larcv::VoxelSetArray
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel2D.h
   requested to autoload type larcv::SparseTensor2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel2D.h
   requested to autoload type larcv::ClusterPixel2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel2D.h
   requested to autoload type larcv::EventClusterPixel2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel2D.h
   requested to autoload type larcv::EventSparseTensor2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Flash.h
   requested to autoload type larcv::FlashSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventFlash.h
   requested to autoload type larcv::EventFlash
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel3D.h
   requested to autoload type larcv::SparseTensor3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel3D.h
   requested to autoload type larcv::ClusterVoxel3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel3D.h
   requested to autoload type larcv::EventClusterVoxel3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel3D.h
   requested to autoload type larcv::EventSparseTensor3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventNeutrino.h
   requested to autoload type larcv::EventNeutrino
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventCRTHit.h
   requested to autoload type larcv::EventCRTHit
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ClusterTensorUtils.h
   requested to autoload type larcv::FlatTensorContents
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventChStatus.h
   requested to autoload type larcv::EventChStatus
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventTrigger.h
   requested to autoload type larcv::EventTrigger
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventImage2D.h
   requested to autoload type larcv::EventImage2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ParentParticleSeg.h
   requested to autoload type larcv::ParentParticleSeg
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for PyImageMaker.h
   requested to autoload type larcv::PyImageMaker
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for load_pyutil.h
   requested to autoload type larcv::load_pyutil
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessBase.h
   requested to autoload type larcv::ProcessBase
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessFactory.h
   requested to autoload type larcv::ProcessFactory
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessDriver.h
   requested to autoload type larcv::ProcessDriver
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for CSVReader.h
   requested to autoload type larcv::CSVData
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_15_00d00/gdml/protodune_v7.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 36176 nodes/ 5435 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).

{'art_out': 'prod_muon_400MeV_protodunevd_1_266808_18_1767859589_gen_g4_stage1_detsim_reco_supera.root', 'start_time': 1767867162.7947512, 'end_time': 1767869355.4541497}
ls: cannot access *_g4_stage2.root: No such file or directory
Forming g4 metadata
Forming reco metadata
  subrun: 18 -> reco file: prod_muon_400MeV_protodunevd_1_266808_18_1767859589_gen_g4_stage1_detsim_reco.root
    KEY: reco
    FCL:  supera_reco_pdsp_doublets.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_muon_400MeV_protodunevd_1_266808_18_1767859589_gen_g4_stage1_detsim_reco.root
  Ran successfully
{
  "name": "prod_muon_400MeV_protodunevd_1_266808_18_1767859589_gen_g4_stage1_detsim_reco.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_15_00d00",
    "core.data_tier": "full-reconstructed",
    "core.runs": "[1]",
    "core.runs_subruns": "[18]",
    "dune.config_file": "supera_reco_pdsp_doublets.fcl",
    "dune.campaign": "pdvd-muon-nopds-test",
    "core.start_time": 1767859588.0,
    "core.end_time": 1767869355.0,
    "core.subruns": "[1]",
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10,
      11,
      12,
      13,
      14,
      15,
      16,
      17,
      18,
      19,
      20,
      21,
      22,
      23,
      24,
      25,
      26,
      27,
      28,
      29,
      30,
      31,
      32,
      33,
      34,
      35,
      36,
      37,
      38,
      39,
      40,
      41,
      42,
      43,
      44,
      45,
      46,
      47,
      48,
      49,
      50
    ],
    "core.event_count": 50,
    "core.first_event_number": 1,
    "core.last_event_number": 50
  }
}
justIN time: 2026-02-06 15:47:16 UTC       justIN version: 01.06.00