justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 254790.14@dunegpschedd01.fnal.gov

Jobsub ID254790.14@dunegpschedd01.fnal.gov
Workflow ID10446
Stage ID1
User namechasnip@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-21 09:44:14
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce508
Last heartbeat2025-11-21 10:17:38
From worker nodeHostnameb9p06p6630.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-11-21 10:16:44
Input fileshd-protodune:np04hd_raw_run029917_0146_dataflow0_datawriter_0_20241011T181415.hdf5
JobscriptExit code90
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-11-21 10:17:38
Saved logsjustin-logs:254790.14-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_12_02d00/include
DUNECALIB_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_12_02d00
DUNEOPDET_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_12_02d00/include
DUNEANA_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_12_02d00/slf7.x86_64.e26.prof
DUNEANA_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_12_02d00
SETUP_DUNEEXAMPLES=duneexamples v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEANA_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_12_02d00/include
DUNECORE_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_12_02d00/slf7.x86_64.e26.prof
DUNEPDLEGACY_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/slf7.x86_64.e26.prof
DUNEEXAMPLES_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_12_02d00/include
DUNEANAOBJ_VERSION=v03_11_00
DUNE_PARDATA_VERSION=v0_02_00
DUNEANAOBJ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneanaobj/v03_11_00
DUNEDAQDATAFORMATS_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunedaqdataformats/v4_4_5
SETUP_DUNERECO=dunereco v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PROTODUNEANA_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_12_02d00
DUNEDATAPREP_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_12_02d00/include
DUNESW_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_12_02d00/slf7.x86_64.e26.prof
SETUP_DUNEUTIL=duneutil v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNESW_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_12_02d00
DUNE_PARDATA_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00
DUNETRIGGER_VERSION=v10_12_02d00
DUNESIM_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_12_02d00
DUNEOPDET_VERSION=v10_12_02d00
SETUP_DUNE_PARDATA=dune_pardata v01_84_00 -f NULL -z /cvmfs/dune.opensciencegrid.org/products/dune
DUNERECO_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_12_02d00/slf7.x86_64.e26.prof
DUNEEXAMPLES_VERSION=v10_12_02d00
DUNERECO_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_12_02d00/include
DUNEUTIL_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_12_02d00
DUNEPDLEGACY_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04
DUNECORE_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_12_02d00
DUNECALIB_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_12_02d00/slf7.x86_64.e26.prof
DUNEANA_VERSION=v10_12_02d00
DUNETRIGGER_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_12_02d00
DUNEPROTOTYPES_VERSION=v10_12_02d00
DUNEOPDET_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_12_02d00
DUNEPROTOTYPES_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_12_02d00
SETUP_DUNEDATAPREP=dunedataprep v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNETRIGGER_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_12_02d00/slf7.x86_64.e26.prof
DUNEOPDET_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_12_02d00/slf7.x86_64.e26.prof
PROTODUNEANA_VERSION=v10_12_02d00
SETUP_DUNEPROTOTYPES=duneprototypes v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEEXAMPLES_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_12_02d00/slf7.x86_64.e26.prof
DUNEDATAPREP_VERSION=v10_12_02d00
DUNECORE_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_12_02d00/include
DUNEPDLEGACY_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/include
SETUP_DUNEANA=duneana v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEPROTOTYPES_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_12_02d00/slf7.x86_64.e26.prof/lib
DUNEDETDATAFORMATS_VERSION=v4_4_5
DUNEUTIL_VERSION=v10_12_02d00
DUNESW_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_12_02d00/slf7.x86_64.e26.prof/lib
SETUP_PROTODUNEANA=protoduneana v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
SETUP_DUNESIM=dunesim v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PROTODUNEANA_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_12_02d00/slf7.x86_64.e26.prof
DUNESIM_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_12_02d00/slf7.x86_64.e26.prof/lib
SETUP_DUNEOPDET=duneopdet v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNESIM_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_12_02d00/slf7.x86_64.e26.prof
SETUP_DUNEPDLEGACY=dunepdlegacy v1_01_04 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNECALIB_VERSION=v10_12_02d00
SETUP_DUNEDAQDATAFORMATS=dunedaqdataformats v4_4_5 -f NULL -z /cvmfs/dune.opensciencegrid.org/products/dune
DUNEEXAMPLES_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_12_02d00
DUNECORE_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_12_02d00/slf7.x86_64.e26.prof/lib
DUNEPDLEGACY_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/slf7.x86_64.e26.prof/lib
SETUP_DUNETRIGGER=dunetrigger v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEANA_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_12_02d00/slf7.x86_64.e26.prof/lib
SETUP_DUNECORE=dunecore v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
SETUP_DUNEANAOBJ=duneanaobj v03_11_00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNETRIGGER_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_12_02d00/slf7.x86_64.e26.prof/lib
DUNESIM_VERSION=v10_12_02d00
DUNECALIB_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_12_02d00/include
DUNEOPDET_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_12_02d00/slf7.x86_64.e26.prof/lib
DUNEUTIL_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_12_02d00/slf7.x86_64.e26.prof
DUNEANAOBJ_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneanaobj/v03_11_00/slf7.x86_64.e26.prof/lib
DUNEPROTOTYPES_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_12_02d00/slf7.x86_64.e26.prof
PROTODUNEANA_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_12_02d00/slf7.x86_64.e26.prof/lib
DUNEPROTOTYPES_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_12_02d00/include
DUNEEXAMPLES_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_12_02d00/slf7.x86_64.e26.prof/lib
SETUP_DUNECALIB=dunecalib v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNERECO_VERSION=v10_12_02d00
DUNEDETDATAFORMATS_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedetdataformats/v4_4_5/include
SETUP_DUNESW=dunesw v10_12_02d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PROTODUNEANA_INC=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_12_02d00/include
DUNEDATAPREP_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_12_02d00/slf7.x86_64.e26.prof/lib
DUNERECO_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_12_02d00
Installing yaml
Collecting pyyaml
  Downloading pyyaml-6.0.3-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (750 kB)
Installing collected packages: pyyaml
Successfully installed pyyaml-6.0.3
WARNING: You are using pip version 21.2.4; however, version 25.3 is available.
You should consider upgrading via the '/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python3 -m pip install --upgrade pip' command.
Done
Will use justin-get-file
input file: np04hd_raw_run029917_0146_dataflow0_datawriter_0_20241011T181415.hdf5
jobsub_id: 254790.14@dunegpschedd01.fnal.gov
Getting run subrun from hd-protodune:np04hd_raw_run029917_0146_dataflow0_datawriter_0_20241011T181415.hdf5
29917 2991700001
Found sps data for run 29917: /cvmfs/fifeuser4.opensciencegrid.org/sw/dune/ccc5409bb070f9b09bd1608e43275bf806e6198c/spillrun029917.csv
nevents: -1
input flag: -i root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/hd-protodune/64/15/np04hd_raw_run029917_0146_dataflow0_datawriter_0_20241011T181415.hdf5 --parent hd-protodune:np04hd_raw_run029917_0146_dataflow0_datawriter_0_20241011T181415.hdf5
reco
Running reco
['lar', '-c', 'run_np04data_processor_run29917.fcl', 'root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/hd-protodune/64/15/np04hd_raw_run029917_0146_dataflow0_datawriter_0_20241011T181415.hdf5', '-n', '-1', '--nskip', '0', '-o', 'proc_bsmtrigger_protodunehd_1_254790_14_1763720219_reco.root']
Stdout:
Art has completed and will exit with status 90.

Stderr:
Failed to parse the configuration file 'run_np04data_processor_run29917.fcl' with exception
---- Parse error BEGIN
  detected at or near line 32, character 3, of file "/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/ccc5409bb070f9b09bd1608e43275bf806e6198c/run_np04data_processor_run29917.fcl"
  
    pandora, 
    ^
---- Parse error END


Error in processing reco
Failed to parse the configuration file 'run_np04data_processor_run29917.fcl' with exception
---- Parse error BEGIN
  detected at or near line 32, character 3, of file "/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/ccc5409bb070f9b09bd1608e43275bf806e6198c/run_np04data_processor_run29917.fcl"
  
    pandora, 
    ^
---- Parse error END


Error running. Exiting with 90
justIN time: 2026-02-09 01:59:42 UTC       justIN version: 01.06.00