Skip to content
Tyson L. Swetnam edited this page Jun 4, 2018 · 19 revisions

Background

This workflow tool was originally developed by students of the Applied Concepts in Cyberinfrastructure (ACIC) in 2014 at the University of Arizona. The semester long project resulted in a parallel workflow tool run on the University's high performance computing (HPC) system.

The project then received a Extreme Science and Engineering Discovery Environment (XSEDE) Extended Collaborative Support (ECS) start-up allocation. That workflow was described in Swetnam et al. (2016). That was followed by an XSEDE-ECS research allocation, which has been deployed on OpenTopography.org.

The newest workflow has been ported from only HPC to now run on local machines, cloud, or OSG-HTC using Singularity.

Sol

The student's called their solar radiation project Sol, and we continue to use that naming scheme here. The Sol program calculates daily and monthly global irradiation and hours of sun.

EEMT

Effective Energy and Mass Transfer (EEMT) is a representation of environmental energy and mass transfer doing work on the Earth's 'critical zone'. To learn more about the critical zone, visit the NSF Critical Zone Observatories.

EEMT was reported in [Rasmussen et al. (2015)(https://www.researchgate.net/profile/Craig_Rasmussen/publication/276350418_Quantifying_Topographic_and_Vegetation_Effects_on_the_Transfer_of_Energy_and_Mass_to_the_Critical_Zone/links/5584588c08ae71f6ba8c4649.pdf).

Santa Ritas Global Insolation

Figure: Global insolation over 365 days calculated using GRASS r.sun.

Contents

This Github repository consists of (1) an Opal2 virtual machine deployment script for running jobs on the OpenTopography, (2) a Singularity file which is hosted on Singularity Hub, (3) provisioning scripts for running the workflow on Jetstream and the Open Science Grid, (4) scripts for running solar radiation OSGEO software stack a solar calculation only with Makeflow, and (5) an EEMT calculation with Makeflow.

Workflow with Singularity

On a small VM or workstation.

Pull this repository:

git clone https://cyverse-gis/eemt

Start the master:

./eemt/sol/run-master examples/mcn_10m.tif

Start the worker:

./eemt/sol/run-worker EEMT

Run GRASS, QGIS, Saga-GIS GUI

Download the OSGEO GIS Singularity container to run locally.

singularity pull --name osgeo.simg shub://tyson-swetnam/osgeo-singularity

then

singularity exec osgeo.simg qgis

or

singularity exec shub://tyson-swetnam/osgeo-singularity qgis

Climate Data

Climate data are available from numerous groups, e.g. Daymet, WorldClim, Chelsa

Opal2 Virtual Machine Setup

Running the scripts on University of Arizona HPC

Running the scripts on XSEDE HPC

License & Acknowledgments

All of the GIS software used by the scripts are open-source. Most are licensed under the GNU General Public License.

Clone this wiki locally