justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 37518.6@dunegpschedd02.fnal.gov

Jobsub ID37518.6@dunegpschedd02.fnal.gov
Workflow ID2426
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-10 11:00:18
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2025-09-10 11:02:22
From worker nodeHostnamedunegli-45691-0-cmswn5006.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-09-10 11:02:02
Input filesehn1-beam-np04:H4_v34b_1GeV_-27.7_002862_412718_0_20250614T003229.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-09-10 11:02:22
Saved logsjustin-logs:37518.6-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

befcfb801ef7734/protoduneana/v10_10_02d00
DUNEDATAPREP_INC=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunedataprep/v10_10_02d00/include
DUNESW_FQ_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunesw/v10_10_02d00/slf7.x86_64.e26.prof
SETUP_DUNEUTIL=duneutil v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734 -q e26:prof
DUNESW_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunesw/v10_10_02d00
DUNE_PARDATA_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00
DUNETRIGGER_VERSION=v10_10_02d00
DUNESIM_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunesim/v10_10_02d00
DUNEOPDET_VERSION=v10_10_02d00
SETUP_DUNE_PARDATA=dune_pardata v01_84_00 -f NULL -z /cvmfs/dune.opensciencegrid.org/products/dune
DUNERECO_FQ_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunereco/v10_10_02d00/slf7.x86_64.e26.prof
DUNEEXAMPLES_VERSION=v10_10_02d00
DUNERECO_INC=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunereco/v10_10_02d00/include
DUNEUTIL_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneutil/v10_10_02d00
DUNEPDLEGACY_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04
DUNECORE_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunecore/v10_10_02d00
DUNECALIB_FQ_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunecalib/v10_10_02d00/slf7.x86_64.e26.prof
DUNEANA_VERSION=v10_10_02d00
DUNETRIGGER_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_10_02d00
DUNEPROTOTYPES_VERSION=v10_10_02d00
DUNEOPDET_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneopdet/v10_10_02d00
DUNEPROTOTYPES_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneprototypes/v10_10_02d00
SETUP_DUNEDATAPREP=dunedataprep v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734 -q e26:prof
DUNETRIGGER_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_10_02d00/slf7.x86_64.e26.prof
DUNEOPDET_FQ_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneopdet/v10_10_02d00/slf7.x86_64.e26.prof
PROTODUNEANA_VERSION=v10_10_02d00
SETUP_DUNEPROTOTYPES=duneprototypes v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734 -q e26:prof
DUNEEXAMPLES_FQ_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneexamples/v10_10_02d00/slf7.x86_64.e26.prof
DUNEDATAPREP_VERSION=v10_10_02d00
DUNECORE_INC=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunecore/v10_10_02d00/include
DUNEPDLEGACY_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/include
SETUP_DUNEANA=duneana v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734 -q e26:prof
DUNEPROTOTYPES_LIB=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneprototypes/v10_10_02d00/slf7.x86_64.e26.prof/lib
DUNEDETDATAFORMATS_VERSION=v4_4_5
DUNEUTIL_VERSION=v10_10_02d00
DUNESW_LIB=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunesw/v10_10_02d00/slf7.x86_64.e26.prof/lib
SETUP_PROTODUNEANA=protoduneana v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734 -q e26:prof
SETUP_DUNESIM=dunesim v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734 -q e26:prof
PROTODUNEANA_FQ_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/protoduneana/v10_10_02d00/slf7.x86_64.e26.prof
DUNESIM_LIB=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunesim/v10_10_02d00/slf7.x86_64.e26.prof/lib
SETUP_DUNEOPDET=duneopdet v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734 -q e26:prof
DUNESIM_FQ_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunesim/v10_10_02d00/slf7.x86_64.e26.prof
SETUP_DUNEPDLEGACY=dunepdlegacy v1_01_04 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNECALIB_VERSION=v10_10_02d00
SETUP_DUNEDAQDATAFORMATS=dunedaqdataformats v4_4_5 -f NULL -z /cvmfs/dune.opensciencegrid.org/products/dune
DUNEEXAMPLES_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneexamples/v10_10_02d00
DUNECORE_LIB=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunecore/v10_10_02d00/slf7.x86_64.e26.prof/lib
DUNEPDLEGACY_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/slf7.x86_64.e26.prof/lib
SETUP_DUNETRIGGER=dunetrigger v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEANA_LIB=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneana/v10_10_02d00/slf7.x86_64.e26.prof/lib
SETUP_DUNECORE=dunecore v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734 -q e26:prof
SETUP_DUNEANAOBJ=duneanaobj v03_10_00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNETRIGGER_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_10_02d00/slf7.x86_64.e26.prof/lib
DUNESIM_VERSION=v10_10_02d00
DUNECALIB_INC=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunecalib/v10_10_02d00/include
DUNEOPDET_LIB=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneopdet/v10_10_02d00/slf7.x86_64.e26.prof/lib
DUNEUTIL_FQ_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneutil/v10_10_02d00/slf7.x86_64.e26.prof
DUNEANAOBJ_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneanaobj/v03_10_00/slf7.x86_64.e26.prof/lib
DUNEPROTOTYPES_FQ_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneprototypes/v10_10_02d00/slf7.x86_64.e26.prof
PROTODUNEANA_LIB=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/protoduneana/v10_10_02d00/slf7.x86_64.e26.prof/lib
DUNEPROTOTYPES_INC=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneprototypes/v10_10_02d00/include
DUNEEXAMPLES_LIB=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/duneexamples/v10_10_02d00/slf7.x86_64.e26.prof/lib
DUNESW_TAR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734
SETUP_DUNECALIB=dunecalib v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734 -q e26:prof
DUNERECO_VERSION=v10_10_02d00
DUNEDETDATAFORMATS_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedetdataformats/v4_4_5/include
SETUP_DUNESW=dunesw v10_10_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734 -q e26:prof
PROTODUNEANA_INC=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/protoduneana/v10_10_02d00/include
DUNEDATAPREP_LIB=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunedataprep/v10_10_02d00/slf7.x86_64.e26.prof/lib
DUNERECO_DIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/4642f00512a9b30c4a272098fbefcfb801ef7734/dunereco/v10_10_02d00
Installing yaml
Collecting pyyaml
  Downloading PyYAML-6.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (737 kB)
Installing collected packages: pyyaml
Successfully installed pyyaml-6.0.2
WARNING: You are using pip version 21.2.4; however, version 25.2 is available.
You should consider upgrading via the '/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python3 -m pip install --upgrade pip' command.
Done
Will use justin-get-file
input file: H4_v34b_1GeV_-27.7_002862_412718_0_20250614T003229.root
jobsub_id: 37518.6@dunegpschedd02.fnal.gov
Getting run subrun from ehn1-beam-np04:H4_v34b_1GeV_-27.7_002862_412718_0_20250614T003229.root
412718 41271800000
nevents: 1
input flag: -i root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/fd/3f/H4_v34b_1GeV_-27.7_002862_412718_0_20250614T003229.root --parent ehn1-beam-np04:H4_v34b_1GeV_-27.7_002862_412718_0_20250614T003229.root
Traceback (most recent call last):
  File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e88a71d9bf0b5de29d5cdce308aecba877d7f6bf/beam_job_utils.py", line 392, in <module>
    routines[args.routine](args)
  File "/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e88a71d9bf0b5de29d5cdce308aecba877d7f6bf/beam_job_utils.py", line 270, in run_job
    with open(args.yaml) as fin:
FileNotFoundError: [Errno 2] No such file or directory: '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e88a71d9bf0b5de29d5cdce308aecba877d7f6bf/pdhd_beam_gen_1GeV_stage1.yaml'
Error running. Exiting with 1
justIN time: 2025-09-19 07:11:08 UTC       justIN version: 01.05.00