Jobsub ID 15508.0@dunegpschedd02.fnal.gov
| Jobsub ID | 15508.0@dunegpschedd02.fnal.gov |
| Workflow ID | 668 |
| Stage ID | 1 |
| User name | twalton@fnal.gov |
| HTCondor Group | group_dune.prod.mcsim |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-08-08 07:16:40 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2025-08-08 07:18:41 |
| From worker node | Hostname | dune001-7160417.0-lcg2683.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Started | 2025-08-08 07:17:28 |
| Input files | neardet-2x2-minerva:TS1_00050017_0001_numip_v09_2407081843_RawData.dat
|
| Jobscript | Exit code | 2 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Max RSS bytes | 0 (0 MiB) |
| Outputting started | |
| Output files | |
| Finished | 2025-08-08 07:18:41 |
| Saved logs | justin-logs:15508.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
The software is Mx2 v102r2p1
The script path is [/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/setup]
================================================================
* *
* Welcome to the MINERVA Software Framework *
* for ProtoDUNE-ND *
* *
================================================================
==============================================================
Configuration Summary
--------------------------------------------------------------
* Release : v102r2p1
* Install area : /cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1
* Platform : sl7
* cmt config : x86_64-slc7-gcc49-opt
* ROOT version : 5.34.36
* Python version : 2.7.11
* Debug mode : Off
--- projects will be searched in $CMTPROJECTPATH set by the user
/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/minerva:/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/lhcb:/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/lcg/external
==============================================================
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
Complete the compiler setup
/cvmfs/larsoft.opensciencegrid.org/products/gcc/v4_9_3/Linux64bit+3.10-2.17/bin/gcc
Fri Aug 08 07:17:33 UTC 2025
The Minervascripts is /cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/minerva/MinervaScripts
--------------------------------------------------------------------
--- Minerva environment is set for version v102r2p1
--- packages will be searched for in CMTPROJECTPATH:
/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/minerva:/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/lhcb:/cvmfs/minerva.opensciencegrid.org/minerva2x2/products/releases/v102r2p1/lcg/external
--------------------------------------------------------------------
------------------------------------------
Configuring environment for project Minerva_v102r2p1 (from /home/cmtuser)
CMT version v1r20p20090520.
------------------------------------------
Installing the cmt directory
Creating a new project file
Setup DUNE and Metacat
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
The node working directory /home/cmtuser
host is dune001-7160417.0-lcg2683.gridpp.rl.ac.uk
justin site is UK_RAL-Tier1
the current directory is /home/cmtuser
Checking if tarfiles exist in the directory [/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/30882cd3bd464083c90dda109b2f8ccd8641e379].
total 15K
drwxr-xr-x 3 65534 65534 4.0K Aug 7 19:46 .
drwxr-xr-x 1216 65534 65534 4.0K Aug 7 19:46 ..
-rw-r--r-- 1 65534 65534 0 Aug 7 19:46 .cvmfscatalog
-rw-r--r-- 1 65534 65534 37 Aug 7 19:46 .publisher
drwxr-xr-x 5 65534 65534 4.0K May 16 16:27 Minerva_v102r2p1
Running the cmt setup script.
#CMT---> Warning: package PlotUtils v* Ana not found (requested by RecoStudies)
#CMT---> Warning: package Flux v* Ana not found (requested by SystemTests)
The Systemtests setup is /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/30882cd3bd464083c90dda109b2f8ccd8641e379/Minerva_v102r2p1/Tools/SystemTests
Retrieving the file.
The file data identifier (DID) is [neardet-2x2-minerva:TS1_00050017_0001_numip_v09_2407081843_RawData.dat]
The file physical file name (PFN) is [root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/neardet-2x2-minerva/8c/60/TS1_00050017_0001_numip_v09_2407081843_RawData.dat]
The file Rucio storage element (RSE) is [DUNE_US_FNAL_DISK_STAGE]
Using rucio to download file [neardet-2x2-minerva:TS1_00050017_0001_numip_v09_2407081843_RawData.dat]
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
[32;1m2025-08-08 07:17:56,968 INFO Processing 1 item(s) for input[0m
[32;1m2025-08-08 07:17:57,954 INFO No preferred protocol impl in rucio.cfg: No section: 'download'[0m
[32;1m2025-08-08 07:17:57,955 INFO Using main thread to download 1 file(s)[0m
[32;1m2025-08-08 07:17:57,955 INFO Preparing download of neardet-2x2-minerva:TS1_00050017_0001_numip_v09_2407081843_RawData.dat[0m
[32;1m2025-08-08 07:17:58,536 INFO Trying to download with root and timeout of 2509s from DUNE_US_FNAL_DISK_STAGE: neardet-2x2-minerva:TS1_00050017_0001_numip_v09_2407081843_RawData.dat [0m
[32;1m2025-08-08 07:17:59,053 INFO Using PFN: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/neardet-2x2-minerva/8c/60/TS1_00050017_0001_numip_v09_2407081843_RawData.dat[0m
error in request of checking file QoS: is not a valid HTTP or Webdav URL
(process:2959): GLib-WARNING **: 07:17:59.056: GError set over the top of a previous GError or uninitialized memory.
This indicates a bug in someone's code. You must ensure an error is NULL before it's set.
The overwriting error message was: \x01 is not a valid HTTP or Webdav URL
/cvmfs/dune.opensciencegrid.org/products/dune/rucio/v37_1_0_post1/NULL/lib/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'dune-rucio.fnal.gov'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
warnings.warn(
[32;1m2025-08-08 07:18:10,582 INFO File neardet-2x2-minerva:TS1_00050017_0001_numip_v09_2407081843_RawData.dat successfully downloaded. 1.225 GB in 10.12 seconds = 121.01 MBps[0m
----------------------------------
Download summary
----------------------------------------
DID neardet-2x2-minerva:TS1_00050017_0001_numip_v09_2407081843_RawData.dat
Total files (DID): 1
Total files (filtered): 1
Downloaded files: 1
Files already found locally: 0
Files that cannot be downloaded: 0
The input file is TS1_00050017_0001_numip_v09_2407081843_RawData.dat
The output files are placed in the directory [/home/workspace]
Running over 3 options file(s)
[BuildRawDigits_fRawData.opts,OfflinePedSup_fRawDigits.opts,AnalysisReconstruction.opts]
../justin-jobscript: line 732: syntax error near unexpected token `('
../justin-jobscript: line 732: ` echo -e "Marking the input file(s) [${pfn}] as processed.\n" 2>&1 | tee -a $envlog' 