Skip to content
Tyson L. Swetnam edited this page Jun 8, 2018 · 19 revisions

Background

This workflow tool was originally developed by students of the Applied Concepts in Cyberinfrastructure (ACIC) in 2014 at the University of Arizona. The semester long project resulted in a parallel workflow tool run on the University's high performance computing (HPC) system.

The project then received an Extreme Science and Engineering Discovery Environment (XSEDE) Extended Collaborative Support (ECS) start-up allocation. The results of that effort were described in Swetnam et al. (2016). The start-up allocation was followed by a research allocation on SDSC Comet and the Open Science Grid. A publically available tool using the workflow is deployed on OpenTopography.org.

The workflow is containerized and can be run on local machines (laptops, desktops, clusters), cloud, or HPC/HTC using Singularity.

Sol

The student's called their solar radiation project Sol, and we continue to use that naming scheme here. The Sol program calculates daily and monthly global irradiation and hours of sun.

EEMT

Effective Energy and Mass Transfer (EEMT) Rasmussen et al. (2015) is a representation of environmental energy and mass transfer doing work on the Earth's 'critical zone'. To learn more about the critical zone, visit the NSF Critical Zone Observatories.

Santa Ritas Global Insolation

Figure: Global insolation over 365 days calculated using GRASS r.sun.

Contents

This Github repository consists of (1) an Opal2 virtual machine deployment script for running jobs on the OpenTopography, (2) a Singularity file which is hosted on Singularity Hub, (3) provisioning scripts for running the workflow on Jetstream and the Open Science Grid, (4) scripts for running Sol with Makeflow, and (5) scripts for calculating EEMT with Makeflow.

Workflow with Singularity

On a small VM or workstation.

Pull this repository:

git clone https://cyverse-gis/eemt

Start the master:

./eemt/sol/run-master eemt/sol/examples/mcn_10m.tif

Start the worker:

./eemt/sol/run-worker EEMT

Run GRASS, QGIS, Saga-GIS GUI

Download the OSGEO GIS Singularity container to run locally.

singularity pull --name osgeo.simg shub://tyson-swetnam/osgeo-singularity

then

singularity exec osgeo.simg qgis

or

singularity exec shub://tyson-swetnam/osgeo-singularity qgis

Climate Data

Climate data are available from numerous organizations, e.g. Daymet, WorldClim, Chelsa. These data are used in the EEMT calculation.

Opal2 Virtual Machine Setup

Instructions

Running the scripts on University of Arizona HPC

UA HPC Documentation

Instructions

Running the scripts on XSEDE HPC

Instructions

License & Acknowledgments

All of the GIS software used by the scripts are open-source. Most are licensed under the GNU General Public License.

Clone this wiki locally