justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 253457.1@dunegpschedd01.fnal.gov

Jobsub ID253457.1@dunegpschedd01.fnal.gov
Workflow ID9538
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors2
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-11-17 21:24:58
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce2
Last heartbeat2025-11-17 21:25:41
From worker nodeHostnamewn036.hep
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors2
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-11-17 21:25:16
Input files
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-11-17 21:25:41
Saved logsjustin-logs:253457.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS /cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
FHICL_FILE_PATH: /cvmfs/fifeuser4.opensciencegrid.org/sw/dune/0183247c92433907df7c1f561070e5f865254efc:.:./job:/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_11_00d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_11_00d00/job:/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_11/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_11_00d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_11_00d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_11_00d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_11_00d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_11_00d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_11_00d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_11_00d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_11_00d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_11_00d00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nusystematics/v1_05_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/systematicstools/v01_04_04/fcl:.:./job:/cvmfs/larsoft.opensciencegrid.org/products/larwirecell/v10_01_22/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larsimdnn/v10_01_01/job:/cvmfs/larsoft.opensciencegrid.org/products/larrecodnn/v10_01_22/job:/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_01_00/job:/cvmfs/larsoft.opensciencegrid.org/products/larexamples/v10_00_23/job:/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_27/job:/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_10/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_01_00/job:/cvmfs/larsoft.opensciencegrid.org/products/larreco/v10_02_07/job:/cvmfs/larsoft.opensciencegrid.org/products/larsim/v10_07_05/job:/cvmfs/larsoft.opensciencegrid.org/products/nugen/v1_21_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larg4/v10_01_00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nurandom/v1_11_05/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nug4/v1_16_08/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larevt/v10_00_14/job:/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_12/job:/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_01_03/job:/cvmfs/larsoft.opensciencegrid.org/products/larcore/v10_00_03/job:/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_03/job:/cvmfs/larsoft.opensciencegrid.org/products/artg4tk/v12_00_03/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/fcl
  File: '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/ff18e11900bfcc2b467fc81eba35d7e7de647a80'
  Size: 4096      	Blocks: 9          IO Block: 4096   directory
Device: 4ah/74d	Inode: 1398        Links: 2
Access: (0755/drwxr-xr-x)  Uid: (65534/ UNKNOWN)   Gid: (65534/ UNKNOWN)
Context: system_u:object_r:fusefs_t:s0
Access: 2025-10-27 14:22:24.000000000 +0000
Modify: 2025-10-27 14:22:24.000000000 +0000
Change: 2025-10-27 14:22:24.000000000 +0000
 Birth: -
metadata dir contents:
PDVD_PDS_Mapping_v05092025.json
add_origins.py
get_events_for_md.py
inherit_metadata.py
meta_maker.py
place_metadata.py
FCL1 dump: standard_reco_stage1_protodunevd_keepup_all.fcl
terminate called after throwing an instance of 'cet::exception'
  what():  ---- search_path BEGIN
  Can't find file "standard_reco_stage1_protodunevd_keepup_all.fcl"
---- search_path END

../justin-jobscript: line 95:  1118 Aborted                 (core dumped) fhicl-dump ${FCL1}
fhicl-dump standard_reco_stage1_protodunevd_keepup_all.fcl failed
justIN time: 2025-12-19 05:13:37 UTC       justIN version: 01.05.03