justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 20079.22@dunegpschedd01.fnal.gov

Jobsub ID20079.22@dunegpschedd01.fnal.gov
Workflow ID187
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit36000 (10 hours)
Submitted time2025-08-01 03:51:34
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2025-08-01 05:28:51
From worker nodeHostnametds426.pic.es
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-08-01 03:53:21
Input filesvd-protodune:np02vd_raw_run038131_0040_df-s04-d0_dw_0_20250725T101313.hdf5
JobscriptExit code0
Real time1h (5114s)
CPU time31m (1871s = 36%)
Max RSS bytes1989992448 (1897 MiB)
Outputting started2025-08-01 05:18:37
Output filesusertests:np02vd_raw_run038131_0040_df-s04-d0_dw_0_20250725T101313_tde_bde_stage1_dev_2025-08-01T_035351Z.root
usertests:np02vd_raw_run038131_0040_df-s04-d0_dw_0_20250725T101313_tde_bde_stage1_dev_2025-08-01T_035351Z_hist.root
usertests:np02vd_raw_run038131_0040_df-s04-d0_dw_0_20250725T101313_tde_bde_stage1_dev_2025-08-01T_035351Z.log
Finished2025-08-01 05:28:51
Saved logsjustin-logs:20079.22-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/vd-protodune/c2/a2/np02vd_raw_run038131_0040_df-s04-d0_dw_0_20250725T101313.hdf5
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
DUNESW_DIR: /cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_08_01d00
../justin-jobscript: line 67: DUNERECO_DIR=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/dunereco/v10_08_01d00: No such file or directory
../justin-jobscript: line 68: DUNERECO_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/include: No such file or directory
../justin-jobscript: line 69: DUNERECO_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/slf7.x86_64.e26.prof: No such file or directory
../justin-jobscript: line 70: DUNERECO_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/slf7.x86_64.e26.prof/lib: No such file or directory
../justin-jobscript: line 72: WIRECELL_PATH=/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData: No such file or directory
../justin-jobscript: line 73: WIRECELL_PATH=/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_30_3/Linux64bit+3.10-2.17-e26-prof/share/wirecell:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/wire-cell-cfg:/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_30_3/Linux64bit+3.10-2.17-e26-prof/share/wirecell:/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData: No such file or directory
../justin-jobscript: line 74: WIRECELL_PATH=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/wire-cell-cfg:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/wire-cell-cfg:/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_30_3/Linux64bit+3.10-2.17-e26-prof/share/wirecell:/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData: No such file or directory
../justin-jobscript: line 83: FHICL_FILE_PATH=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/duneprototypes/v10_08_01d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/dunesw/v10_08_01d00/fcl:.:./job:/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_08_01d00/job:/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_11/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_08_01d00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nusystematics/v1_05_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/systematicstools/v01_04_04/fcl:.:./job:/cvmfs/larsoft.opensciencegrid.org/products/larwirecell/v10_01_13/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larsimdnn/v10_00_14/job:/cvmfs/larsoft.opensciencegrid.org/products/larrecodnn/v10_01_13/job:/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_00_22/job:/cvmfs/larsoft.opensciencegrid.org/products/larexamples/v10_00_15/job:/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_18/job:/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_10/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_00_19/job:/cvmfs/larsoft.opensciencegrid.org/products/larreco/v10_01_15/job:/cvmfs/larsoft.opensciencegrid.org/products/larsim/v10_06_01/job:/cvmfs/larsoft.opensciencegrid.org/products/nugen/v1_21_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larg4/v10_00_11/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nurandom/v1_11_05/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nug4/v1_16_08/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larevt/v10_00_10/job:/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_09/job:/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_01_00/job:/cvmfs/larsoft.opensciencegrid.org/products/larcore/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/artg4tk/v12_00_03/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/fcl: No such file or directory
FHICL_FILE_PATH: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/f74d2cb0f3847d6487a45a87df055df678960ad1:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/duneprototypes/v10_08_01d00/fcl:/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/d672b14eb7839876bbd543a30533c5f2278d8a12/dunesw/v10_08_01d00/fcl:.:./job:/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_08_01d00/job:/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_11/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_08_01d00/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_08_01d00/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nusystematics/v1_05_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/systematicstools/v01_04_04/fcl:.:./job:/cvmfs/larsoft.opensciencegrid.org/products/larwirecell/v10_01_13/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larsimdnn/v10_00_14/job:/cvmfs/larsoft.opensciencegrid.org/products/larrecodnn/v10_01_13/job:/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_00_22/job:/cvmfs/larsoft.opensciencegrid.org/products/larexamples/v10_00_15/job:/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_18/job:/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_10/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_00_19/job:/cvmfs/larsoft.opensciencegrid.org/products/larreco/v10_01_15/job:/cvmfs/larsoft.opensciencegrid.org/products/larsim/v10_06_01/job:/cvmfs/larsoft.opensciencegrid.org/products/nugen/v1_21_07/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larg4/v10_00_11/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nurandom/v1_11_05/fcl:/cvmfs/larsoft.opensciencegrid.org/products/nug4/v1_16_08/fcl:/cvmfs/larsoft.opensciencegrid.org/products/larevt/v10_00_10/job:/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_09/job:/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_01_00/job:/cvmfs/larsoft.opensciencegrid.org/products/larcore/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_02/job:/cvmfs/larsoft.opensciencegrid.org/products/artg4tk/v12_00_03/fcl:/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/fcl
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
.:
total 1136028
-rw-r--r-- 1 dune001 dune 1162592262 Aug  1 07:18 np02vd_raw_run038131_0040_df-s04-d0_dw_0_20250725T101313_tde_bde_stage1_dev_2025-08-01T_035351Z.root
-rw-r--r-- 1 dune001 dune     452275 Aug  1 07:18 np02vd_raw_run038131_0040_df-s04-d0_dw_0_20250725T101313_tde_bde_stage1_dev_2025-08-01T_035351Z.log
-rw-r--r-- 1 dune001 dune     159744 Aug  1 07:18 mem.db
-rw-r--r-- 1 dune001 dune      36864 Aug  1 07:18 time.db
-rw-r--r-- 1 dune001 dune      13307 Aug  1 07:18 np02vd_raw_run038131_0040_df-s04-d0_dw_0_20250725T101313_tde_bde_stage1_dev_2025-08-01T_035351Z_hist.root
-rw-r--r-- 1 dune001 dune       8174 Aug  1 07:18 jobscript.log
-rw-r--r-- 1 dune001 dune        155 Aug  1 07:18 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune        150 Aug  1 05:53 all-input-dids.txt
-rw-r--r-- 1 dune001 dune          0 Aug  1 05:54 debugprod.log
justIN time: 2025-08-04 14:19:41 UTC       justIN version: 01.04.00