justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258546.6@dunegpschedd02.fnal.gov

Jobsub ID258546.6@dunegpschedd02.fnal.gov
Workflow ID11065
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 15:04:06
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat2025-12-06 15:11:23
From worker nodeHostnameheplnc169.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 15:04:49
Input filespdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_114_20210414T022116Z.root
pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_15_20210414T012051Z.root
pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_19_20210414T012053Z.root
JobscriptExit code0
Real time6m (367s)
CPU time4m (274s = 74%)
Max RSS bytes3151450112 (3005 MiB)
Outputting started2025-12-06 15:10:57
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdsp_cafana_test/fnal/11065/1/001/pdspana_258546_6_1_11065_20251206T150457Z.root
Finished2025-12-06 15:11:23
Saved logsjustin-logs:258546.6-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

egrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/include
HUB_DIR=/cvmfs/larsoft.opensciencegrid.org/products/hub/v2_14_2
GEANT4REWEIGHT_DIR=/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_13
DUNERECO_VERSION=v10_12_01d00
LARPANDORA_LIB=/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_01_02/slf7.x86_64.e26.prof/lib
IFDH_ART_INC=/cvmfs/larsoft.opensciencegrid.org/products/ifdh_art/v2_17_08/slf7.x86_64.e26.prof/inc
MARLEY_LIB=/cvmfs/larsoft.opensciencegrid.org/products/marley/v1_2_1d/Linux64bit+3.10-2.17-e26-prof/lib
SETUP_LAREVT=larevt v10_00_15 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
HDF5_INC=/cvmfs/larsoft.opensciencegrid.org/products/hdf5/v1_12_2a/Linux64bit+3.10-2.17-e26-prof/include
SETUP_CANVAS=canvas v3_16_04 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
DUNEDETDATAFORMATS_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedetdataformats/v4_4_5/include
SETUP_TBB=tbb v2021_9_0 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26
PYTHIA_INC=/cvmfs/larsoft.opensciencegrid.org/products/pythia/v6_4_28x/Linux64bit+3.10-2.17-e26-prof/include
SETUP_DUNESW=dunesw v10_12_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PERL_MM_OPT=INSTALL_BASE=/cvmfs/larsoft.opensciencegrid.org/products/mrb/v6_09_11/slf7.x86_64/CPAN
GIT_EXEC_PATH=/cvmfs/larsoft.opensciencegrid.org/products/git/v2_45_1/Linux64bit+3.10-2.17/libexec/git-core
PROTODUNEANA_INC=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/35b10bf0cb984b6d5a422badbf8571fdbac6981b/protoduneana/v10_12_01d00/include
DUNEDATAPREP_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_12_01d00/slf7.x86_64.e26.prof/lib
DUNERECO_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_12_01d00
WIRECELL_LIB=/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_30_6/Linux64bit+3.10-2.17-e26-prof/lib
TRITON_INC=/cvmfs/larsoft.opensciencegrid.org/products/triton/v2_25_0d/Linux64bit+3.10-2.17-e26/include
LIBJPEG_TURBO_INC=/cvmfs/larsoft.opensciencegrid.org/products/libjpeg_turbo/v2_1_0/Linux64bit+3.10-2.17/include
LAREVENTDISPLAY_LIB=/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_28/slf7.x86_64.e26.prof/lib
PPFX_VERSION=v02_20_06
NUG4_VERSION=v1_16_10
SETUP_LARDATAALG=lardataalg v10_01_04 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
LARCOREALG_INC=/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_03/include
G4PARTICLEHPDATA=/cvmfs/larsoft.opensciencegrid.org/products/g4tendl/v1_3_2/G4TENDL1.3.2
SETUP_LARANA=larana v10_01_01 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_LARSOFT=larsoft v10_12_00 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_CETLIB=cetlib v3_18_02 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_FHICLCPP=fhiclcpp v4_18_04 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
OPENBLAS_INC=/cvmfs/larsoft.opensciencegrid.org/products/openblas/v0_3_23/Linux64bit+3.10-2.17-e26/include
PYTHON_INCLUDE=/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/include/python3.9
DUNE_VERSION=v10_12_01d00
_=/usr/bin/env
Justin specific env vars
JUSTIN_SCOPE=usertests
JUSTIN_WALL_SECONDS=80000
JUSTIN_ALLOCATOR=https://justin-allocator-fnal.dune.hep.ac.uk/api/allocator/
JUSTIN_SITE_NAME=UK_RAL-PPD
JUSTIN_SAM_WEB_URI=https://justin.dune.hep.ac.uk/api/samweb/258546.6@dunegpschedd02.fnal.gov/SI_b0pYXgS2YtXZXtWVtVciddLbV2a1vH-YUoHe5sxBvoh--29k1btILkIdGdhhngQ1QXl9GeqcOPOjr_Y2ffg
JUSTIN_PROCESSORS=1
JUSTIN_MQL=files from pdsp_mc_reco:PDSPProd4a_MC_1GeV_reco1_sce_datadriven_v1_00 limit 10
JUSTIN_JOBSCRIPT_SECRET=SI_b0pYXgS2YtXZXtWVtVciddLbV2a1vH-YUoHe5sxBvoh--29k1btILkIdGdhhngQ1QXl9GeqcOPOjr_Y2ffg
JUSTIN_PATH=/home
JUSTIN_TIMESTAMP=1765033489
JUSTIN_JOBSUB_ID=258546.6@dunegpschedd02.fnal.gov
JUSTIN_WORKFLOW_ID=11065
JUSTIN_STAGE_ID=1
JUSTIN_RSS_MIB=2000
Will use justin-get-file
Return code 0
Stdout b'pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_114_20210414T022116Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/45/ca/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_114_20210414T022116Z.root DUNE_UK_MANCHESTER_CEPH'
Stderr b''
Return code 0
Stdout b'pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_15_20210414T012051Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/74/13/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_15_20210414T012051Z.root DUNE_UK_MANCHESTER_CEPH'
Stderr b''
Return code 0
Stdout b'pdsp_mc_reco:PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_19_20210414T012053Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/e7/2f/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_19_20210414T012053Z.root DUNE_UK_MANCHESTER_CEPH'
Stderr b''
Return code 1
Stdout b''
Stderr b'No files available from this stage\n'
root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/45/ca/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_114_20210414T022116Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/74/13/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_15_20210414T012051Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/e7/2f/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_19_20210414T012053Z.root
Files retrieved: 3
PFN list:
root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/45/ca/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_114_20210414T022116Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/74/13/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_15_20210414T012051Z.root root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/pdsp_mc_reco/e7/2f/PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_19_20210414T012053Z.root
Running pdspana
Ran successfully
Forming metadata
Error in <TProtoClass::FindDataMember>: data member with index 0 is not found in class caf::SRCaloPID
Error in <CreateRealData>: Cannot find data member # 0 of class caf::SRCaloPID for parent caf::SRGArTrack!
Error in <TProtoClass::FindDataMember>: data member with index 1 is not found in class caf::SRCaloPID
Error in <CreateRealData>: Cannot find data member # 1 of class caf::SRCaloPID for parent caf::SRGArTrack!
Error in <TProtoClass::FindDataMember>: data member with index 2 is not found in class caf::SRCaloPID
Error in <CreateRealData>: Cannot find data member # 2 of class caf::SRCaloPID for parent caf::SRGArTrack!
Error in <TProtoClass::FindDataMember>: data member with index 3 is not found in class caf::SRCaloPID
Error in <CreateRealData>: Cannot find data member # 3 of class caf::SRCaloPID for parent caf::SRGArTrack!
Error in <TProtoClass::FindDataMember>: data member with index 4 is not found in class caf::SRCaloPID
Error in <CreateRealData>: Cannot find data member # 4 of class caf::SRCaloPID for parent caf::SRGArTrack!
Error in <TProtoClass::FindDataMember>: data member with index 0 is not found in class caf::SRCaloPID
Error in <CreateRealData>: Cannot find data member # 0 of class caf::SRCaloPID for parent caf::SRNDTrackAssn!
Error in <TProtoClass::FindDataMember>: data member with index 1 is not found in class caf::SRCaloPID
Error in <CreateRealData>: Cannot find data member # 1 of class caf::SRCaloPID for parent caf::SRNDTrackAssn!
Error in <TProtoClass::FindDataMember>: data member with index 2 is not found in class caf::SRCaloPID
Error in <CreateRealData>: Cannot find data member # 2 of class caf::SRCaloPID for parent caf::SRNDTrackAssn!
Error in <TProtoClass::FindDataMember>: data member with index 3 is not found in class caf::SRCaloPID
Error in <CreateRealData>: Cannot find data member # 3 of class caf::SRCaloPID for parent caf::SRNDTrackAssn!
Error in <TProtoClass::FindDataMember>: data member with index 4 is not found in class caf::SRCaloPID
Error in <CreateRealData>: Cannot find data member # 4 of class caf::SRCaloPID for parent caf::SRNDTrackAssn!
formed
{
  "parents": [
    {
      "namespace": "pdsp_mc_reco",
      "name": "PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_114_20210414T022116Z.root"
    },
    {
      "namespace": "pdsp_mc_reco",
      "name": "PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_15_20210414T012051Z.root"
    },
    {
      "namespace": "pdsp_mc_reco",
      "name": "PDSPProd4a_protoDUNE_sp_reco_stage1_p1GeV_35ms_sce_datadriven_18800650_19_20210414T012053Z.root"
    }
  ],
  "metadata": {
    "core.application": "protoduneana.pdspana",
    "core.application.family": "protoduneana",
    "core.application.name": "pdspana",
    "core.application.version": "v10_12_01d00",
    "core.data_tier": "root-tuple-virtual",
    "core.file_format": "root",
    "dune.fcl_version_tag": "v10_12_01d00",
    "dune.fcl_name": "pdsp_cafana_MC_nosce_noreco.fcl",
    "core.runs": [
      18800650
    ],
    "core.runs_subruns": [
      1880065000006
    ],
    "beam.polarity": 1,
    "core.group": "dune",
    "dune_mc.detector_type": "protoDUNE SP",
    "dune_mc.electron_lifetime": "35ms",
    "dune_mc.generators": "beam_cosmics",
    "dune_mc.liquid_flow": "no",
    "dune_mc.space_charge": "yes",
    "dune_mc.with_cosmics": 1,
    "core.run_type": "protodune-sp",
    "core.file_type": "mc",
    "core.data_stream": "out1",
    "core.event_count": 18
  }
}
justIN time: 2026-02-07 17:41:17 UTC       justIN version: 01.06.00