justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 298737.0@dunegpschedd01.fnal.gov

Jobsub ID298737.0@dunegpschedd01.fnal.gov
Workflow ID12199
Stage ID1
User nametwalton@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-21 20:36:09
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-21 21:05:17
From worker nodeHostnamedunegli-8233135-0-fnpc23018.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-21 20:59:26
Input filesmonte-carlo-012199-000001
JobscriptExit code0
Real time5m (333s)
CPU time0m (43s = 12%)
Max RSS bytes537837568 (512 MiB)
Outputting started2026-01-21 21:04:59
Output files
Finished2026-01-21 21:05:17
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009967.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009968.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009969.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009970.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009971.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009972.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009973.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009974.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009975.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009976.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009977.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009978.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009979.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009980.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009981.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009982.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009983.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009984.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009985.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009986.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009987.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009988.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009989.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009990.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009991.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009992.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009993.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009994.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009995.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009996.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009997.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009998.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009999.GTRAC.root
Processing output files (dir: /home/workspace):
Processing MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.gtrac_merged_0000000.0009000_l009999_20260121T200517.tar
All output files processed successfully


The contents in the /home/workspace directory.
-rw-r--r-- 1 dunegli fnalgrid 384M Jan 21 21:04 MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.gtrac_merged_0000000.0009000_l009999_20260121T200517.tar
-rw-r--r-- 1 dunegli fnalgrid 1.8M Jan 21 21:04 MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.gtrac_merged_0000000.0009000_l009999_20260121T200517.tar.json
-rw-r--r-- 1 dunegli fnalgrid   26 Jan 21 20:59 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7.2M Jan 21 21:04 jobscript.log
merged pass1_US_FNAL-FermiGrid_000001.json
justIN time: 2026-02-05 12:52:20 UTC       justIN version: 01.06.00