justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297964.0@dunegpschedd01.fnal.gov

Jobsub ID297964.0@dunegpschedd01.fnal.gov
Workflow ID12154
Stage ID1
User nametwalton@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-21 04:42:27
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-21 04:44:29
From worker nodeHostnamedunegli-8386026-0-fnpc23019.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2026-01-21 04:43:55
Input filesmonte-carlo-012154-000001
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2026-01-21 04:44:29
Saved logsjustin-logs:297964.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009968.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009969.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009970.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009971.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009972.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009973.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009974.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009975.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009976.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009977.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009978.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009979.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009980.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009981.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009982.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009983.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009984.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009985.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009986.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009987.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009988.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009989.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009990.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009991.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009992.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009993.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009994.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009995.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009996.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009997.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009998.GTRAC.root",
    "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009999.GTRAC.root"
  ],
  "outputs": [
    {
      "name": "MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.gtrac_merged_0000000.0009000_l009999_20260121T043447.tar",
      "metadata": {
        "core.file_format": "tar"
      }
    }
  ],
  "settings": {
    "streaming": true,
    "method": "tar",
    "script": "merge_tar.py"
  }
}Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
Traceback (most recent call last):
  File "/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/b7ca860fbd1650b517a9d58b3ffc869f9b641bff/do_merge.py", line 13, in <module>
    import h5py
  File "/cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/lib/ROOT/_facade.py", line 154, in _importhook
    return _orig_ihook(name, *args, **kwds)
ModuleNotFoundError: No module named 'h5py'
failed to merge pass1_US_FNAL-FermiGrid_000001.json 1
justIN time: 2026-02-05 14:10:16 UTC       justIN version: 01.06.00