justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 253294.96@dunegpschedd01.fnal.gov

Jobsub ID253294.96@dunegpschedd01.fnal.gov
Workflow ID8688
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-11-17 13:42:23
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug
Last heartbeat2025-11-17 13:49:15
From worker nodeHostnamewn-snel-005.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-11-17 13:49:10
Input files
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-11-17 13:49:15
Saved logsjustin-logs:253294.96-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS /cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
FHICL_FILE_PATH: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/f455318977de049be7806e5133a1b1292a2e6305:.:./job:/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_10_05d00/job:/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_11/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_10_05d00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nusystematics/v1_05_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/systematicstools/v01_04_04/fcl:.:./job:/cvmfs/larsoft.opensciencegrid.org/products/larwirecell/v10_01_20/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larsimdnn/v10_00_21/job:/cvmfs/larsoft.opensciencegrid.org/products/larrecodnn/v10_01_20/job:/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_00_30/job:/cvmfs/larsoft.opensciencegrid.org/products/larexamples/v10_00_21/job:/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_25/job:/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_10/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_00_26/job:/cvmfs/larsoft.opensciencegrid.org/products/larreco/v10_02_05/job:/cvmfs/larsoft.opensciencegrid.org/products/larsim/v10_07_03/job:/cvmfs/larsoft.opensciencegrid.org/products/nugen/v1_21_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larg4/v10_00_14/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nurandom/v1_11_05/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nug4/v1_16_08/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larevt/v10_00_13/job:/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_11/job:/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_01_02/job:/cvmfs/larsoft.opensciencegrid.org/products/larcore/v10_00_03/job:/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_03/job:/cvmfs/larsoft.opensciencegrid.org/products/artg4tk/v12_00_03/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/fcl
stat: cannot stat '/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ff18e11900bfcc2b467fc81eba35d7e7de647a80': No such file or directory
failed to stat metadata dir
metadata dir contents:
ls: cannot access /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ff18e11900bfcc2b467fc81eba35d7e7de647a80: No such file or directory
FCL1 dump: standard_reco_stage1_protodunevd_keepup_all.fcl
terminate called after throwing an instance of 'cet::exception'
  what():  ---- search_path BEGIN
  Can't find file "standard_reco_stage1_protodunevd_keepup_all.fcl"
---- search_path END

../justin-jobscript: line 95:  1118 Aborted                 fhicl-dump ${FCL1}
fhicl-dump standard_reco_stage1_protodunevd_keepup_all.fcl failed
justIN time: 2025-12-20 12:56:24 UTC       justIN version: 01.05.03