justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303175.47@dunegpschedd01.fnal.gov

Jobsub ID303175.47@dunegpschedd01.fnal.gov
Workflow ID12660
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-02-02 22:14:14
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2026-02-03 00:53:40
From worker nodeHostnamemh-7662-20.t2.ucsd.edu
cpuinfoAMD EPYC 7662 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 22:14:59
Input filesmonte-carlo-012660-000057
JobscriptExit code0
Real time2h (9489s)
CPU time2h (8753s = 92%)
Max RSS bytes6813192192 (6497 MiB)
Outputting started2026-02-03 00:53:10
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/nivedpm/fnal/12660/1/001/larcvpdvd_cosmics_doublets_mc_20260202_235902_749031.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/nivedpm/fnal/12660/1/001/larcvpdvd_cosmics_doublets_mc_20260202_235902_749031.root.json
Finished2026-02-03 00:53:40
Saved logsjustin-logs:303175.47-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

toload type larcv::DataProductFactory
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventParticle.h
   requested to autoload type larcv::EventParticle
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for IOManager.h
   requested to autoload type larcv::IOManager
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Meta.h
   requested to autoload type larcv::Meta
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for CRTHit.h
   requested to autoload type larcv::CRTHitSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventBBox.h
   requested to autoload type larcv::EventBBox2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventBBox.h
   requested to autoload type larcv::EventBBox3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Trigger.h
   requested to autoload type larcv::Trigger
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventMeta.h
   requested to autoload type larcv::EventMeta
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Neutrino.h
   requested to autoload type larcv::NeutrinoSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel.h
   requested to autoload type larcv::VoxelSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel.h
   requested to autoload type larcv::VoxelSetArray
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel2D.h
   requested to autoload type larcv::SparseTensor2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel2D.h
   requested to autoload type larcv::ClusterPixel2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel2D.h
   requested to autoload type larcv::EventClusterPixel2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel2D.h
   requested to autoload type larcv::EventSparseTensor2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Flash.h
   requested to autoload type larcv::FlashSet
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventFlash.h
   requested to autoload type larcv::EventFlash
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel3D.h
   requested to autoload type larcv::SparseTensor3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for Voxel3D.h
   requested to autoload type larcv::ClusterVoxel3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel3D.h
   requested to autoload type larcv::EventClusterVoxel3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventVoxel3D.h
   requested to autoload type larcv::EventSparseTensor3D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventNeutrino.h
   requested to autoload type larcv::EventNeutrino
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventCRTHit.h
   requested to autoload type larcv::EventCRTHit
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ClusterTensorUtils.h
   requested to autoload type larcv::FlatTensorContents
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventChStatus.h
   requested to autoload type larcv::EventChStatus
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventTrigger.h
   requested to autoload type larcv::EventTrigger
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for EventImage2D.h
   requested to autoload type larcv::EventImage2D
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ParentParticleSeg.h
   requested to autoload type larcv::ParentParticleSeg
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for PyImageMaker.h
   requested to autoload type larcv::PyImageMaker
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for load_pyutil.h
   requested to autoload type larcv::load_pyutil
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessBase.h
   requested to autoload type larcv::ProcessBase
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessFactory.h
   requested to autoload type larcv::ProcessFactory
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for ProcessDriver.h
   requested to autoload type larcv::ProcessDriver
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
   Missing FileEntry for CSVReader.h
   requested to autoload type larcv::CSVData
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/protodunevd_v5_ggd.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16484 nodes/ 2469 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2
Attempted to load data: generator
Failed to get MCTruth from generator
Failed to get MCTruth from rain
Failed to get MCTruth from rain2

{'art_out': 'prod_muon_400MeV_protodunevd_1_303175_47_1770070638_gen_g4_stage1_g4_stage2_detsim_reco_supera.root', 'start_time': 1770076731.6674125, 'end_time': 1770079982.9824166}
Output files:
 larcv files: larcvpdvd_cosmics_doublets_mc_20260202_235902_749031.root
formed
{
  "name": "larcvpdvd_cosmics_doublets_mc_20260202_235902_749031.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_16_00d00",
    "core.data_tier": "root-tuple-virtual",
    "core.runs": null,
    "core.runs_subruns": null,
    "dune.config_file": "run_supera_pdunevd_mpvmpr_doublets.fcl",
    "dune.campaign": "vd-protodune-spine-reco",
    "core.start_time": 1770070624.0,
    "core.end_time": 1770079983.0
  }
}
justIN time: 2026-02-04 04:49:09 UTC       justIN version: 01.06.00