justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 298700.0@dunegpschedd01.fnal.gov

Jobsub ID298700.0@dunegpschedd01.fnal.gov
Workflow ID12189
Stage ID1
User nametwalton@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-21 18:59:11
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-21 19:05:27
From worker nodeHostnamedunegli-8230159-0-fnpc19133.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-21 18:59:27
Input filesmonte-carlo-012189-000001
JobscriptExit code0
Real time5m (319s)
CPU time0m (58s = 18%)
Max RSS bytes535875584 (511 MiB)
Outputting started2026-01-21 19:04:47
Output files
Finished2026-01-21 19:05:27
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009967.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009968.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009969.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009970.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009971.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009972.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009973.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009974.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009975.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009976.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009977.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009978.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009979.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009980.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009981.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009982.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009983.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009984.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009985.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009986.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009987.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009988.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009989.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009990.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009991.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009992.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009993.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009994.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009995.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009996.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009997.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009998.GTRAC.root  root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/physicsgroups/dunendproto/dunendsim/MiniProdN5-Small-Files/run-genie-small-files/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift/GTRAC/0009000/MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.0009999.GTRAC.root
Processing output files (dir: /home/workspace):
Processing MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.gtrac_merged_0000000.0009000_l009999_20260121T174009.tar
All output files processed successfully


The contents in the /home/workspace directory:
-rw-r--r-- 1 dunegli fnalgrid 384M Jan 21 19:04 MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.gtrac_merged_0000000.0009000_l009999_20260121T174009.tar
-rw-r--r-- 1 dunegli fnalgrid 1.8M Jan 21 19:04 MiniProdN5p1_NDComplex_FHC.genie.ndlarfid.sanddrift.gtrac_merged_0000000.0009000_l009999_20260121T174009.tar.json
-rw-r--r-- 1 dunegli fnalgrid   26 Jan 21 18:59 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7.2M Jan 21 19:04 jobscript.log
merged pass1_US_FNAL-FermiGrid_000001.json
justIN time: 2026-02-05 14:12:01 UTC       justIN version: 01.06.00