justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 296496.0@dunegpschedd02.fnal.gov

Jobsub ID	296496.0@dunegpschedd02.fnal.gov
Workflow ID	12523
Stage ID	1
User name	skar@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-29 14:00:00
Site	US_FNAL-T1
Entry	CMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat	2026-01-29 14:01:21
From worker node	Hostname	dunegli-50723-0-cmswn4058.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-29 14:01:04
Input files	hd-protodune-det-reco:np04hd_raw_run032672_0679_dataflow1_datawriter_0_20241106T043927_reco_stage1_reco_stage2_20241106T071024_keepup.root
Jobscript	Exit code	0
	Real time	0m (10s)
	CPU time	0m (5s = 49%)
	Max RSS bytes	39256064 (37 MiB)
Outputting started	2026-01-29 14:01:14
Output files
Finished	2026-01-29 14:01:21
Saved logs	justin-logs:296496.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ry
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts_larsoft_v09_91_02_e26_prof/' is not a directory

ERROR: MRB_INSTALL is not defined - please source localProducts_XXX/setup

Current working directory:
/home/workspace
List files in working directory:
total 40
-rw-r--r-- 1 dunegli fnalgrid   278 Jan 29 14:01 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 35117 Jan 29 14:01 jobscript.log
Output file will be: np04hd_raw_run032672_0679_dataflow1_datawriter_0_20241106T043927_reco_stage1_reco_stage2_20241106T071024_keepup_reco2_2026-01-29T_140113Z.root
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
Failed to parse the configuration file '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/srcs/protoduneana/protoduneana/work/run_analyseEvents.fcl' with exception
---- search_path BEGIN
  Can't find file "analysisConfig.fcl"
---- search_path END

Art has completed and will exit with status 90.
=== Start last 100 lines of lar log file ===
tail: cannot open 'np04hd_raw_run032672_0679_dataflow1_datawriter_0_20241106T043927_reco_stage1_reco_stage2_20241106T071024_keepup_ana_2026-01-29T_140113Z.log' for reading: No such file or directory
=== End last 100 lines of lar log file ===
lar exit code 0

justIN time: 2026-02-04 15:16:30 UTC       justIN version: 01.06.00