justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 12544.14@dunegpschedd02.fnal.gov

Jobsub ID12544.14@dunegpschedd02.fnal.gov
Workflow ID131
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-29 22:29:43
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-07-29 22:42:09
From worker nodeHostnamedunegli-6391743-0-fnpc22023.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-07-29 22:30:57
Input filesusertests:fdvd_lowBg_reco2_2025-05-12T_124648Z.root
JobscriptExit code0
Real time0m (6s)
CPU time0m (5s = 83%)
Max RSS bytes41381888 (39 MiB)
Outputting started2025-07-29 22:31:04
Output files
Finished2025-07-29 22:42:09
Saved logsjustin-logs:12544.14-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/d3/41/fdvd_lowBg_reco2_2025-05-12T_124648Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
Setting up larsoft
/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v10_08_01
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01
MRB_SOURCE=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/srcs
MRB_BUILDDIR=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/localProducts_larsoft_v10_08_01_e26_prof

PRODUCTS=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/localProducts_larsoft_v10_08_01_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/localProducts_larsoft_v10_08_01_e26_prof

mkdir: cannot create directory '/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/build_slf7.x86_64': Read-only file system
FATAL ERROR: unable to make specified locks directory /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/build_slf7.x86_64/.locks

The working build directory is /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/build_slf7.x86_64
The source code directory is /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/srcs
----------- check this block for errors -----------------------
FATAL_ERROR: 
FATAL_ERROR: couldn't open /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/build_slf7.x86_64/larsoft-v10_08_01 for write
FATAL_ERROR: 
ERROR: setup of required products has failed
local product directory is /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/localProducts_larsoft_v10_08_01_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
local product directory is /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/47e27f2cbd2242dda4ec87963b08c478974c51e9/larsoft_v10_08_01/localProducts_larsoft_v10_08_01_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Failed to parse the configuration file 'solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_optimistic.fcl' with exception
---- search_path BEGIN
  Can't find file "solar_ana_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_optimisitc.fcl"
---- search_path END

Art has completed and will exit with status 90.
=== End last 100 lines of lar log file ===
Output file: fdhd_ana_2025-07-29T_223103Z.root
Output hist file: fdhd_ana_2025-07-29T_223103Z_hist.root
lar exit code 0
justIN time: 2025-08-04 17:41:11 UTC       justIN version: 01.04.00