justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 302155.0@dunegpschedd01.fnal.gov

Jobsub ID	302155.0@dunegpschedd01.fnal.gov
Workflow ID	12536
Stage ID	1
User name	skar@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-29 17:30:12
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2026-01-29 17:42:57
From worker node	Hostname	dunegli-8478024-0-fnpc23019.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-29 17:42:43
Input files	hd-protodune-det-reco:np04hd_raw_run032672_0679_dataflow1_datawriter_0_20241106T043927_reco_stage1_reco_stage2_20241106T071024_keepup.root
Jobscript	Exit code	0
	Real time	0m (6s)
	CPU time	0m (5s = 83%)
	Max RSS bytes	39243776 (37 MiB)
Outputting started	2026-01-29 17:42:50
Output files
Finished	2026-01-29 17:42:57
Saved logs	justin-logs:302155.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory
WARNING:  '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/localProducts*/' is not a directory

ERROR: MRB_INSTALL is not defined - please source localProducts_XXX/setup

Current working directory:
/home/workspace
List files in working directory:
total 36
-rw-r--r-- 1 dunegli fnalgrid   278 Jan 29 17:42 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 29943 Jan 29 17:42 jobscript.log
Output file will be: np04hd_raw_run032672_0679_dataflow1_datawriter_0_20241106T043927_reco_stage1_reco_stage2_20241106T071024_keepup_reco2_2026-01-29T_174250Z.root
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
tail: cannot open 'np04hd_raw_run032672_0679_dataflow1_datawriter_0_20241106T043927_reco_stage1_reco_stage2_20241106T071024_keepup_ana_2026-01-29T_174250Z.log' for reading: No such file or directory
=== End last 100 lines of lar log file ===
lar exit code 0

justIN time: 2026-02-04 14:04:28 UTC       justIN version: 01.06.00