justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 20099.1@dunegpschedd01.fnal.gov

Jobsub ID20099.1@dunegpschedd01.fnal.gov
Workflow ID187
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit36000 (10 hours)
Submitted time2025-08-01 06:43:43
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp
Last heartbeat2025-08-01 06:49:27
From worker nodeHostnamewn-lot-029.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-08-01 06:44:25
Input filesvd-protodune:np02vd_raw_run038131_0002_df-s04-d0_dw_0_20250725T100103.hdf5
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-08-01 06:49:27
Saved logsjustin-logs:20099.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/vd-protodune/69/e6/np02vd_raw_run038131_0002_df-s04-d0_dw_0_20250725T100103.hdf5
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
DUNESW_DIR: /cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_08_01d00
../justin-jobscript: line 67: DUNERECO_DIR=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/dunereco/v10_08_01d00: No such file or directory
../justin-jobscript: line 68: DUNERECO_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/include: No such file or directory
../justin-jobscript: line 69: DUNERECO_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/slf7.x86_64.e26.prof: No such file or directory
../justin-jobscript: line 70: DUNERECO_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/slf7.x86_64.e26.prof/lib: No such file or directory
../justin-jobscript: line 72: WIRECELL_PATH=/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData: No such file or directory
../justin-jobscript: line 73: WIRECELL_PATH=/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_30_3/Linux64bit+3.10-2.17-e26-prof/share/wirecell:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/wire-cell-cfg:/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_30_3/Linux64bit+3.10-2.17-e26-prof/share/wirecell:/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData: No such file or directory
../justin-jobscript: line 74: WIRECELL_PATH=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/wire-cell-cfg:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/wire-cell-cfg:/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_30_3/Linux64bit+3.10-2.17-e26-prof/share/wirecell:/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData: No such file or directory
../justin-jobscript: line 83: FHICL_FILE_PATH=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/duneprototypes/v10_08_01d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/dunesw/v10_08_01d00/fcl:.:./job:/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_08_01d00/job:/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_11/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_08_01d00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nusystematics/v1_05_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/systematicstools/v01_04_04/fcl:.:./job:/cvmfs/larsoft.opensciencegrid.org/products/larwirecell/v10_01_13/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larsimdnn/v10_00_14/job:/cvmfs/larsoft.opensciencegrid.org/products/larrecodnn/v10_01_13/job:/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_00_22/job:/cvmfs/larsoft.opensciencegrid.org/products/larexamples/v10_00_15/job:/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_18/job:/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_10/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_00_19/job:/cvmfs/larsoft.opensciencegrid.org/products/larreco/v10_01_15/job:/cvmfs/larsoft.opensciencegrid.org/products/larsim/v10_06_01/job:/cvmfs/larsoft.opensciencegrid.org/products/nugen/v1_21_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larg4/v10_00_11/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nurandom/v1_11_05/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nug4/v1_16_08/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larevt/v10_00_10/job:/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_09/job:/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_01_00/job:/cvmfs/larsoft.opensciencegrid.org/products/larcore/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/artg4tk/v12_00_03/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/fcl: No such file or directory
FHICL_FILE_PATH: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/f74d2cb0f3847d6487a45a87df055df678960ad1:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/duneprototypes/v10_08_01d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/dunesw/v10_08_01d00/fcl:.:./job:/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_08_01d00/job:/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_11/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_08_01d00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nusystematics/v1_05_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/systematicstools/v01_04_04/fcl:.:./job:/cvmfs/larsoft.opensciencegrid.org/products/larwirecell/v10_01_13/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larsimdnn/v10_00_14/job:/cvmfs/larsoft.opensciencegrid.org/products/larrecodnn/v10_01_13/job:/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_00_22/job:/cvmfs/larsoft.opensciencegrid.org/products/larexamples/v10_00_15/job:/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_18/job:/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_10/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_00_19/job:/cvmfs/larsoft.opensciencegrid.org/products/larreco/v10_01_15/job:/cvmfs/larsoft.opensciencegrid.org/products/larsim/v10_06_01/job:/cvmfs/larsoft.opensciencegrid.org/products/nugen/v1_21_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larg4/v10_00_11/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nurandom/v1_11_05/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nug4/v1_16_08/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larevt/v10_00_10/job:/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_09/job:/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_01_00/job:/cvmfs/larsoft.opensciencegrid.org/products/larcore/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/artg4tk/v12_00_03/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/fcl
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 1
.:
total 220
-rw-r--r--. 1 dune012 dune 75317 Aug  1 08:49 RootOutput-a0f2-87c8-55a9-e82f.root
-rw-r--r--. 1 dune012 dune 48776 Aug  1 08:49 np02vd_raw_run038131_0002_df-s04-d0_dw_0_20250725T100103_tde_bde_stage1_dev_2025-08-01T_064430Z.log
-rw-r--r--. 1 dune012 dune 45056 Aug  1 08:49 mem.db
-rw-r--r--. 1 dune012 dune 16384 Aug  1 08:49 time.db
-rw-r--r--. 1 dune012 dune  8886 Aug  1 08:49 np02vd_raw_run038131_0002_df-s04-d0_dw_0_20250725T100103_tde_bde_stage1_dev_2025-08-01T_064430Z_hist.root
-rw-r--r--. 1 dune012 dune  8174 Aug  1 08:49 jobscript.log
-rw-r--r--. 1 dune012 dune   155 Aug  1 08:49 justin-processed-pfns.txt
-rw-r--r--. 1 dune012 dune   150 Aug  1 08:44 all-input-dids.txt
-rw-r--r--. 1 dune012 dune     0 Aug  1 08:44 debugprod.log
justIN time: 2025-08-04 14:12:20 UTC       justIN version: 01.04.00