justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 20079.9@dunegpschedd01.fnal.gov

Jobsub ID20079.9@dunegpschedd01.fnal.gov
Workflow ID187
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit36000 (10 hours)
Submitted time2025-08-01 03:51:34
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel
Last heartbeat2025-08-01 04:36:31
From worker nodeHostnamewn-sate-053.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-08-01 03:52:49
Input filesvd-protodune:np02vd_raw_run038131_0001_df-s04-d0_dw_0_20250725T100043.hdf5
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-08-01 04:36:31
Saved logsjustin-logs:20079.9-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/vd-protodune/57/3d/np02vd_raw_run038131_0001_df-s04-d0_dw_0_20250725T100043.hdf5
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
DUNESW_DIR: /cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_08_01d00
../justin-jobscript: line 67: DUNERECO_DIR=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/dunereco/v10_08_01d00: No such file or directory
../justin-jobscript: line 68: DUNERECO_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/include: No such file or directory
../justin-jobscript: line 69: DUNERECO_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/slf7.x86_64.e26.prof: No such file or directory
../justin-jobscript: line 70: DUNERECO_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/slf7.x86_64.e26.prof/lib: No such file or directory
../justin-jobscript: line 72: WIRECELL_PATH=/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData: No such file or directory
../justin-jobscript: line 73: WIRECELL_PATH=/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_30_3/Linux64bit+3.10-2.17-e26-prof/share/wirecell:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/wire-cell-cfg:/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_30_3/Linux64bit+3.10-2.17-e26-prof/share/wirecell:/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData: No such file or directory
../justin-jobscript: line 74: WIRECELL_PATH=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/wire-cell-cfg:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/wire-cell-cfg:/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_30_3/Linux64bit+3.10-2.17-e26-prof/share/wirecell:/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData: No such file or directory
../justin-jobscript: line 83: FHICL_FILE_PATH=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/duneprototypes/v10_08_01d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/dunesw/v10_08_01d00/fcl:.:./job:/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_08_01d00/job:/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_11/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_08_01d00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nusystematics/v1_05_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/systematicstools/v01_04_04/fcl:.:./job:/cvmfs/larsoft.opensciencegrid.org/products/larwirecell/v10_01_13/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larsimdnn/v10_00_14/job:/cvmfs/larsoft.opensciencegrid.org/products/larrecodnn/v10_01_13/job:/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_00_22/job:/cvmfs/larsoft.opensciencegrid.org/products/larexamples/v10_00_15/job:/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_18/job:/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_10/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_00_19/job:/cvmfs/larsoft.opensciencegrid.org/products/larreco/v10_01_15/job:/cvmfs/larsoft.opensciencegrid.org/products/larsim/v10_06_01/job:/cvmfs/larsoft.opensciencegrid.org/products/nugen/v1_21_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larg4/v10_00_11/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nurandom/v1_11_05/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nug4/v1_16_08/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larevt/v10_00_10/job:/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_09/job:/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_01_00/job:/cvmfs/larsoft.opensciencegrid.org/products/larcore/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/artg4tk/v12_00_03/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/fcl: No such file or directory
FHICL_FILE_PATH: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/f74d2cb0f3847d6487a45a87df055df678960ad1:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/duneprototypes/v10_08_01d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/dunesw/v10_08_01d00/fcl:.:./job:/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_08_01d00/job:/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_11/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_08_01d00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nusystematics/v1_05_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/systematicstools/v01_04_04/fcl:.:./job:/cvmfs/larsoft.opensciencegrid.org/products/larwirecell/v10_01_13/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larsimdnn/v10_00_14/job:/cvmfs/larsoft.opensciencegrid.org/products/larrecodnn/v10_01_13/job:/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_00_22/job:/cvmfs/larsoft.opensciencegrid.org/products/larexamples/v10_00_15/job:/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_18/job:/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_10/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_00_19/job:/cvmfs/larsoft.opensciencegrid.org/products/larreco/v10_01_15/job:/cvmfs/larsoft.opensciencegrid.org/products/larsim/v10_06_01/job:/cvmfs/larsoft.opensciencegrid.org/products/nugen/v1_21_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larg4/v10_00_11/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nurandom/v1_11_05/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nug4/v1_16_08/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larevt/v10_00_10/job:/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_09/job:/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_01_00/job:/cvmfs/larsoft.opensciencegrid.org/products/larcore/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/artg4tk/v12_00_03/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/fcl
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 1
.:
total 1159920
-rw-r--r--. 1 dune012 dune 1187047157 Aug  1 06:36 RootOutput-e5da-e1d2-f6a2-25bc.root
-rw-r--r--. 1 dune012 dune     464744 Aug  1 06:36 np02vd_raw_run038131_0001_df-s04-d0_dw_0_20250725T100043_tde_bde_stage1_dev_2025-08-01T_035255Z.log
-rw-r--r--. 1 dune012 dune     159744 Aug  1 06:36 mem.db
-rw-r--r--. 1 dune012 dune      36864 Aug  1 06:36 time.db
-rw-r--r--. 1 dune012 dune      13560 Aug  1 06:36 np02vd_raw_run038131_0001_df-s04-d0_dw_0_20250725T100043_tde_bde_stage1_dev_2025-08-01T_035255Z_hist.root
-rw-r--r--. 1 dune012 dune       8174 Aug  1 06:36 jobscript.log
-rw-r--r--. 1 dune012 dune        155 Aug  1 06:36 justin-processed-pfns.txt
-rw-r--r--. 1 dune012 dune        150 Aug  1 05:52 all-input-dids.txt
-rw-r--r--. 1 dune012 dune          0 Aug  1 05:53 debugprod.log
justIN time: 2025-08-04 14:18:47 UTC       justIN version: 01.04.00