justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267309.1@dunegpschedd02.fnal.gov

Jobsub ID267309.1@dunegpschedd02.fnal.gov
Workflow ID11585
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-09 17:54:32
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2026-01-09 21:55:49
From worker nodeHostnamewn1205090.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-09 17:56:30
Input filesmonte-carlo-011585-000007
JobscriptExit code0
Real time3h (13640s)
CPU time3h (13441s = 98%)
Max RSS bytes2991239168 (2852 MiB)
Outputting started2026-01-09 21:43:51
Output filesusertests:prod_muon_400MeV_protodunevd_1_267309_1_1767981400_gen_g4_stage1_detsim_reco.err
usertests:prod_muon_400MeV_protodunevd_1_267309_1_1767981400_gen_g4_stage1_detsim_reco.root
usertests:prod_muon_400MeV_protodunevd_1_267309_1_1767981400_gen_g4_stage1_detsim_reco.log
usertests:prod_muon_400MeV_protodunevd_1_267309_1_1767981400_gen_g4_stage1_detsim_reco.root.json
usertests:larcvpdhd_test3_mc_20260109_211011_368088.root
Finished2026-01-09 21:55:49
Saved logsjustin-logs:267309.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

:ImageMeta
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventBase.h
   requested to autoload type larcv::EventBase
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Point.h
   requested to autoload type larcv::Point2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Point.h
   requested to autoload type larcv::Point3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Vertex.h
   requested to autoload type larcv::Vertex
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel3DMeta.h
   requested to autoload type larcv::Voxel3DMeta
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Particle.h
   requested to autoload type larcv::ParticleSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for DataProductFactory.h
   requested to autoload type larcv::DataProductFactory
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventParticle.h
   requested to autoload type larcv::EventParticle
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for IOManager.h
   requested to autoload type larcv::IOManager
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Meta.h
   requested to autoload type larcv::Meta
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for CRTHit.h
   requested to autoload type larcv::CRTHitSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventBBox.h
   requested to autoload type larcv::EventBBox2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventBBox.h
   requested to autoload type larcv::EventBBox3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Trigger.h
   requested to autoload type larcv::Trigger
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventMeta.h
   requested to autoload type larcv::EventMeta
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Neutrino.h
   requested to autoload type larcv::NeutrinoSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel.h
   requested to autoload type larcv::VoxelSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel.h
   requested to autoload type larcv::VoxelSetArray
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel2D.h
   requested to autoload type larcv::SparseTensor2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel2D.h
   requested to autoload type larcv::ClusterPixel2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel2D.h
   requested to autoload type larcv::EventClusterPixel2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel2D.h
   requested to autoload type larcv::EventSparseTensor2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Flash.h
   requested to autoload type larcv::FlashSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventFlash.h
   requested to autoload type larcv::EventFlash
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel3D.h
   requested to autoload type larcv::SparseTensor3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel3D.h
   requested to autoload type larcv::ClusterVoxel3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel3D.h
   requested to autoload type larcv::EventClusterVoxel3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel3D.h
   requested to autoload type larcv::EventSparseTensor3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventNeutrino.h
   requested to autoload type larcv::EventNeutrino
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventCRTHit.h
   requested to autoload type larcv::EventCRTHit
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ClusterTensorUtils.h
   requested to autoload type larcv::FlatTensorContents
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventChStatus.h
   requested to autoload type larcv::EventChStatus
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventTrigger.h
   requested to autoload type larcv::EventTrigger
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventImage2D.h
   requested to autoload type larcv::EventImage2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ParentParticleSeg.h
   requested to autoload type larcv::ParentParticleSeg
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for PyImageMaker.h
   requested to autoload type larcv::PyImageMaker
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for load_pyutil.h
   requested to autoload type larcv::load_pyutil
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessBase.h
   requested to autoload type larcv::ProcessBase
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessFactory.h
   requested to autoload type larcv::ProcessFactory
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessDriver.h
   requested to autoload type larcv::ProcessDriver
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for CSVReader.h
   requested to autoload type larcv::CSVData
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_15_00d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
registering to  primaryGeneratorActionsMap_
registering to   eventActionsMap_
registering to   trackingActionsMap_
registering to  steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).

{'art_out': 'prod_muon_400MeV_protodunevd_1_267309_1_1767981400_gen_g4_stage1_detsim_reco_supera.root', 'start_time': 1767993003.7935522, 'end_time': 1767995024.7555256}
ls: cannot access *_g4_stage2.root: No such file or directory
Forming g4 metadata
Forming reco metadata
  subrun: 1 -> reco file: prod_muon_400MeV_protodunevd_1_267309_1_1767981400_gen_g4_stage1_detsim_reco.root
    KEY: reco
    FCL:  standard_reco_protodunehd_cluster3d.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_muon_400MeV_protodunevd_1_267309_1_1767981400_gen_g4_stage1_detsim_reco.root
  Ran successfully
{
  "name": "prod_muon_400MeV_protodunevd_1_267309_1_1767981400_gen_g4_stage1_detsim_reco.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_15_00d00",
    "core.data_tier": "full-reconstructed",
    "core.runs": "[1]",
    "core.runs_subruns": "[1]",
    "dune.config_file": "standard_reco_protodunehd_cluster3d.fcl",
    "dune.campaign": "pdvd-muon-nopds-test",
    "core.start_time": 1767981399.0,
    "core.end_time": 1767995024.0,
    "core.subruns": "[1]",
    "core.events": [
      1,
      2,
      3,
      4,
      5,
      6,
      7,
      8,
      9,
      10,
      11,
      12,
      13,
      14,
      15,
      16,
      17,
      18,
      19,
      20,
      21,
      22,
      23,
      24,
      25,
      26,
      27,
      28,
      29,
      30,
      31,
      32,
      33,
      34,
      35,
      36,
      37,
      38,
      39,
      40,
      41,
      42,
      43,
      44,
      45,
      46,
      47,
      48,
      49,
      50,
      51,
      52,
      53,
      54,
      55,
      56,
      57,
      58,
      59,
      60,
      61,
      62,
      63,
      64,
      65,
      66,
      67,
      68,
      69,
      70,
      71,
      72,
      73,
      74,
      75,
      76,
      77,
      78,
      79,
      80,
      81,
      82,
      83,
      84,
      85,
      86,
      87,
      88,
      89,
      90,
      91,
      92,
      93,
      94,
      95,
      96,
      97,
      98,
      99,
      100
    ],
    "core.event_count": 100,
    "core.first_event_number": 1,
    "core.last_event_number": 100
  }
}
justIN time: 2026-02-06 15:46:19 UTC       justIN version: 01.06.00