Workflow 8241, Stage 1
| Priority | 50 |
| Processors | 1 |
| Wall seconds | 80000 |
| Image | /cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest |
| RSS bytes | 4194304000 (4000 MiB) |
| Max distance for inputs | 100.0 |
| Enabled input RSEs |
CERN_PDUNE_EOS, DUNE_CA_SFU, DUNE_CERN_EOS, DUNE_ES_PIC, DUNE_FR_CCIN2P3_DISK, DUNE_IN_TIFR, DUNE_IT_INFN_CNAF, DUNE_UK_GLASGOW, DUNE_UK_LANCASTER_CEPH, DUNE_UK_MANCHESTER_CEPH, DUNE_US_BNL_SDCC, DUNE_US_FNAL_DISK_STAGE, FNAL_DCACHE, FNAL_DCACHE_STAGING, FNAL_DCACHE_TEST, MONTECARLO, NIKHEF, PRAGUE, QMUL, RAL-PP, RAL_ECHO, SURFSARA, T3_US_NERSC |
| Enabled output RSEs |
CERN_PDUNE_EOS, DUNE_CA_SFU, DUNE_CERN_EOS, DUNE_ES_PIC, DUNE_FR_CCIN2P3_DISK, DUNE_IN_TIFR, DUNE_IT_INFN_CNAF, DUNE_UK_GLASGOW, DUNE_UK_LANCASTER_CEPH, DUNE_UK_MANCHESTER_CEPH, DUNE_US_BNL_SDCC, DUNE_US_FNAL_DISK_STAGE, FNAL_DCACHE, FNAL_DCACHE_STAGING, FNAL_DCACHE_TEST, NIKHEF, PRAGUE, QMUL, RAL-PP, RAL_ECHO, SURFSARA, T3_US_NERSC |
| Enabled sites |
BR_CBPF, CA_SFU, CERN, CH_UNIBE-LHEP, CZ_FZU, ES_CIEMAT, ES_PIC, FR_CCIN2P3, IT_CNAF, NL_NIKHEF, NL_SURFsara, UK_Bristol, UK_Brunel, UK_Durham, UK_Edinburgh, UK_Glasgow, UK_Lancaster, UK_Liverpool, UK_Manchester, UK_Oxford, UK_QMUL, UK_RAL-PPD, UK_RAL-Tier1, UK_Sheffield, US_Colorado, US_FNAL-FermiGrid, US_FNAL-T1, US_Michigan, US_PuertoRico, US_SU-ITS, US_Swan, US_UChicago, US_UConn-HPC, US_UCSD, US_Wisconsin |
| Scope | usertests |
| Events for this stage |
Output patterns
| | Destination | Pattern | Lifetime | For next stage | RSE expression |
|---|
| 1 | https://fndcadoor.fnal.gov:2880/dune/scratch/users/fandrian/fnal/08241/1 | scint_*.root | | | |
Environment variables
| Name | Value |
|---|
| INPUT_TAR_DIR | /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/55c70e4789a73290129bd224b639b2c1965b8e14 |
| NUM_EVENTS | 100 |
File states
| Total files | Finding | Unallocated | Allocated | Outputting | Processed | Not found | Failed |
|---|
|
| 1000 | 0 | 1000 | 0 | 0 | 0 | 0 | 0 |
Job states
| Total | Submitted | Started | Processing | Outputting | Finished | Notused | Aborted | Stalled | Jobscript error | Outputting failed | None processed |
|---|
| 1836 | 0 | 0 | 0 | 0 | 517 | 0 | 4 | 1315 | 0 | 0 | 0 |
RSEs used
| Name | Inputs | Outputs |
|---|
| MONTECARLO | 1241 | 0 |
Stats of processed input files as CSV or JSON, and of uploaded output files as CSV or JSON (up to 10000 files included)
File reset events, by site
| Site | Allocated | Outputting |
|---|
| US_FNAL-FermiGrid | 375 | 0 |
| UK_RAL-Tier1 | 163 | 0 |
| UK_Manchester | 142 | 0 |
| UK_RAL-PPD | 99 | 0 |
| UK_QMUL | 80 | 0 |
| UK_Glasgow | 61 | 0 |
| NL_SURFsara | 60 | 0 |
| US_UChicago | 48 | 0 |
| UK_Durham | 35 | 0 |
| ES_PIC | 35 | 0 |
| CZ_FZU | 29 | 0 |
| NL_NIKHEF | 27 | 0 |
| UK_Bristol | 26 | 0 |
| CERN | 19 | 0 |
| US_Wisconsin | 12 | 0 |
| BR_CBPF | 10 | 0 |
| FR_CCIN2P3 | 8 | 0 |
| UK_Lancaster | 6 | 0 |
| US_FNAL-T1 | 5 | 0 |
| UK_Sheffield | 1 | 0 |
Jobscript
#!/bin/bash
:<<'EOF'
Test of RCDS/cvmfs tar files access from JUSTIN jobs. You need to
set up the justin commands
source /cvmfs/dune.opensciencegrid.org/products/dune/setup_dune.sh
setup justin
Then
1) Create a tar file
mkdir somedir
cd somedir
date > hello_world.txt
tar cvf hello_world.tar *
2) Create an X.509 proxy (no need for VOMS)
kx509
3) Upload to cvmfs
INPUT_TAR_DIR_LOCAL=`justin-cvmfs-upload hello_world.tar`
4) Wait until ls $INPUT_TAR_DIR_LOCAL works (minutes?)
5) Create and run a workflow
justin simple-workflow --monte-carlo 1 \
--env INPUT_TAR_DIR_LOCAL="$INPUT_TAR_DIR_LOCAL" \
--jobscript cvmfs-hello-world.jobscript
Check the output through the dashboard: the date in hello_world.txt
should beprinted.
EOF
DUNE_VERSION=${DUNE_VERSION:-v10_09_00d00}
DUNE_QUALIFIER=${DUNE_QUALIFIER:-e26:prof}
source /cvmfs/dune.opensciencegrid.org/products/dune/setup_dune.sh
setup dunesw "$DUNE_VERSION" -q "$DUNE_QUALIFIER"
if [ "$NUM_EVENTS" != "" ] ; then
events_option="-n $NUM_EVENTS"
fi
# Get an unprocessed file from this stage and say we processed it
did_pfn_rse=`$JUSTIN_PATH/justin-get-file`
echo "${did_pfn_rse}"
if [ "$did_pfn_rse" != "" ] ; then
did=`echo $did_pfn_rse | cut -f1 -d' '`
echo "$did" > justin-processed-dids.txt
for i in {3501..3600} #3501 to 4000
do
cp $INPUT_TAR_DIR/togridallb/myLightSourceSteering_$i.txt .
lar -c $INPUT_TAR_DIR/togridallb/light_generator_pdvd_$i.fcl $events_option -o scint_$i.root > scint_$i.log 2>&1
rm myLightSourceSteering_$i.txt
done
fi
tar zcf `echo "$JUSTIN_JOBSUB_ID.logs.tgz" | sed 's/@/_/g'` *.log
exit 0
