Jobsub ID 23162.18@dunegpschedd01.fnal.gov
| Jobsub ID | 23162.18@dunegpschedd01.fnal.gov |
| Workflow ID | 774 |
| Stage ID | 1 |
| User name | twalton@fnal.gov |
| HTCondor Group | group_dune.prod.mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-08-11 07:50:20 |
| Site | US_SU-ITS |
| Entry | Glow_US_Syracuse_condor-ce2 |
| Last heartbeat | 2025-08-11 07:54:28 |
| From worker node | Hostname | CRUSH-OSG-C7-10-5-198-203 |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2698 v3 @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | False |
| Job state | outputting_failed |
| Started | 2025-08-11 07:53:30 |
| Input files | neardet-2x2-minerva:TS1_00001798_0008_numib_v09_2406242051_RawData.dat
|
| Jobscript | Exit code | 0 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Max RSS bytes | 0 (0 MiB) |
| Outputting started | 2025-08-11 07:53:53 |
| Output files | |
| Finished | 2025-08-11 07:54:28 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
The software is Mx2 v102r2p1
The script path is [/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/setup]
================================================================
* *
* Welcome to the MINERVA Software Framework *
* for ProtoDUNE-ND *
* *
================================================================
==============================================================
Configuration Summary
--------------------------------------------------------------
* Release : v102r2p1
* Install area : /cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1
* Platform : sl7
* cmt config : x86_64-slc7-gcc49-opt
* ROOT version : 5.34.36
* Python version : 2.7.11
* Debug mode : Off
--- projects will be searched in $CMTPROJECTPATH set by the user
/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/minerva:/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/lhcb:/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/lcg/external
==============================================================
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
Complete the compiler setup
/cvmfs/larsoft.opensciencegrid.org/products/gcc/v4_9_3/Linux64bit+3.10-2.17/bin/gcc
Mon Aug 11 07:53:33 UTC 2025
The Minervascripts is /cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/minerva/MinervaScripts
--------------------------------------------------------------------
--- Minerva environment is set for version v102r2p1
--- packages will be searched for in CMTPROJECTPATH:
/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/minerva:/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/lhcb:/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/lcg/external
--------------------------------------------------------------------
------------------------------------------
Configuring environment for project Minerva_v102r2p1 (from /srv/home/cmtuser)
CMT version v1r20p20090520.
------------------------------------------
Installing the cmt directory
Creating a new project file
Setup DUNE and Metacat
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
The node working directory /srv/home/cmtuser
host is CRUSH-OSG-C7-10-5-198-203
justin site is US_SU-ITS
the current directory is /srv/home/cmtuser
Checking if tarfiles exist in the directory [/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/a78df38eee7be7778206759e47d4ec5a55d768a1].
total 15K
drwxr-xr-x 3 991 988 4.0K Aug 11 03:05 .
drwxr-xr-x 1119 991 988 4.0K Aug 11 03:05 ..
-rw-r--r-- 1 991 988 0 Aug 11 03:05 .cvmfscatalog
-rw-r--r-- 1 991 988 37 Aug 11 03:05 .publisher
drwxr-xr-x 5 991 988 4.0K May 16 16:27 Minerva_v102r2p1
../justin-jobscript: line 100: cd: /home/workspace: No such file or directory
Running the cmt setup script.
#CMT---> Warning: package PlotUtils v* Ana not found (requested by RecoStudies)
#CMT---> Warning: package Flux v* Ana not found (requested by SystemTests)
The Systemtests setup is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/a78df38eee7be7778206759e47d4ec5a55d768a1/Minerva_v102r2p1/Tools/SystemTests
../justin-jobscript: line 152: cd: /home/workspace: No such file or directory
Retrieving the file.
/srv/home/justin-get-file: line 41: all-input-dids.txt: Read-only file system
The file data identifier (DID) is [neardet-2x2-minerva:TS1_00001798_0008_numib_v09_2406242051_RawData.dat]
The file physical file name (PFN) is [root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/neardet-2x2-minerva/1f/3a/TS1_00001798_0008_numib_v09_2406242051_RawData.dat]
The file Rucio storage element (RSE) is [DUNE_US_FNAL_DISK_STAGE]
Using rucio to download file [neardet-2x2-minerva:TS1_00001798_0008_numib_v09_2406242051_RawData.dat]
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
[32;1m2025-08-11 07:53:52,548 INFO Processing 1 item(s) for input[0m
[32;1m2025-08-11 07:53:52,985 INFO No preferred protocol impl in rucio.cfg: No section: 'download'[0m
[31;1m2025-08-11 07:53:52,989 ERROR [Errno 30] Read-only file system: '/home/workspace'[0m
[31;1m2025-08-11 07:53:52,990 ERROR
Rucio exited with an unexpected/unknown error.
Please rerun the last command with the "-v" option to gather more information.
If you're sure there is a problem with Rucio itself, please follow up at: https://github.com/rucio/rucio/issues[0m
mv: cannot stat '/home/workspace/neardet-2x2-minerva/*': No such file or directory
The input file [TS1_00001798_0008_numib_v09_2406242051_RawData.dat] does not exist.
