justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 253295.48@dunegpschedd01.fnal.gov

Jobsub ID253295.48@dunegpschedd01.fnal.gov
Workflow ID9034
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-11-17 13:42:24
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce2
Last heartbeat2025-11-17 13:51:55
From worker nodeHostnamewn036.hep
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-11-17 13:51:49
Input files
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-11-17 13:51:55
Saved logsjustin-logs:253295.48-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS /cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
FHICL_FILE_PATH: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/9b65f791769d954f813dc37c8b95105a865c1e7b:.:./job:/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_10_05d00/job:/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_11/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_10_05d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_10_05d00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nusystematics/v1_05_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/systematicstools/v01_04_04/fcl:.:./job:/cvmfs/larsoft.opensciencegrid.org/products/larwirecell/v10_01_20/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larsimdnn/v10_00_21/job:/cvmfs/larsoft.opensciencegrid.org/products/larrecodnn/v10_01_20/job:/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_00_30/job:/cvmfs/larsoft.opensciencegrid.org/products/larexamples/v10_00_21/job:/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_25/job:/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_10/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_00_26/job:/cvmfs/larsoft.opensciencegrid.org/products/larreco/v10_02_05/job:/cvmfs/larsoft.opensciencegrid.org/products/larsim/v10_07_03/job:/cvmfs/larsoft.opensciencegrid.org/products/nugen/v1_21_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larg4/v10_00_14/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nurandom/v1_11_05/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nug4/v1_16_08/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larevt/v10_00_13/job:/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_11/job:/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_01_02/job:/cvmfs/larsoft.opensciencegrid.org/products/larcore/v10_00_03/job:/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_03/job:/cvmfs/larsoft.opensciencegrid.org/products/artg4tk/v12_00_03/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/fcl
stat: cannot stat '/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ff18e11900bfcc2b467fc81eba35d7e7de647a80': No such file or directory
failed to stat metadata dir
metadata dir contents:
ls: cannot access /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ff18e11900bfcc2b467fc81eba35d7e7de647a80: No such file or directory
FCL1 dump: standard_reco_stage1_protodunevd_keepup_all.fcl
terminate called after throwing an instance of 'cet::exception'
  what():  ---- search_path BEGIN
  Can't find file "standard_reco_stage1_protodunevd_keepup_all.fcl"
---- search_path END

../justin-jobscript: line 95:  1118 Aborted                 (core dumped) fhicl-dump ${FCL1}
fhicl-dump standard_reco_stage1_protodunevd_keepup_all.fcl failed
justIN time: 2025-12-19 05:18:16 UTC       justIN version: 01.05.03