TestingExecutorBlanca

wmt-testing executor on blanca

Instructions for installing and configuring a WMT executor on blanca.

--Mpiper (talk) 15:44, 28 February 2018 (MST)

Set install directory

The install directory for this executor is /projects/mapi8461/wmt/_testing.

install_dir=/projects/mapi8461/wmt/_testing
mkdir -p $install_dir

Install Python

Install a Python distribution to be used locally by WMT. We like to use Miniconda.

cd $install_dir
curl https://repo.continuum.io/miniconda/Miniconda2-latest-Linux-x86_64.sh -o miniconda.sh
bash ./miniconda.sh -f -b -p $(pwd)/conda
export PATH=$(pwd)/conda/bin:$PATH

If working with an existing Miniconda install, be sure to update everything before continuing:

conda update conda
conda update --all

Install the CSDMS software stack

Using the csdms-stack conda channel (the Bakery) install the CSDMS software stack, including several pre-built components, with the `csdms-stack` metapackage.

conda install csdms-stack -c csdms-stack -c defaults -c conda-forge

This metapackage currently includes

• pymt
• cca-tools
• csdms-child
• csdms-sedflux-3d
• csdms-hydrotrend
• csdms-permamodel-ku
• csdms-permamodel-frostnumber
• csdms-permamodel-kugeo
• csdms-permamodel-frostnumbergeo
• csdms-brake
• csdms-pydeltarcm

Before continuing, load the `git` module.

module load git

Next, install `wmt-exe` from source.

mkdir -p $install_dir/opt && cd $install_dir/opt
git clone https://github.com/csdms/wmt-exe
cd wmt-exe
python setup.py develop

Note that I had to write a new SbatchLauncher class for wmt-exe because blanca uses Slurm instead of Torque for job control.

Optionally install the `babelizer`, in case a component needs to be built from source.

conda install -c csdms-stack babelizer

Optionally install IPython for testing.

conda install ipython

Recall that when running IPython remotely, it's helpful to set

export MPLBACKEND=Agg