Skip to main content

esm-viz allows you to monitor and visualize ongoing simulations

Project description

esm-viz

https://img.shields.io/pypi/v/esm_viz.svg https://img.shields.io/travis/pgierz/esm_viz.svg Documentation Status

ESM Viz is a command line tool to schedule automatic monitoring of Earth System Model simulations.

First Steps

The easiest way to get started is:

$ esm_viz --help

This will display a series of options you can use. In order to set up automatic monitoring for an experiment, you can use esm_viz template

Installation

For AWI Users

On paleosrv1.awi.de; the software is already installed.

For Other Users

There are several external packages that need to be installed in order for everything to work correctly. The easiest way to get everything in one go is:

$ pip install esm_viz

You can then type

$ esm_viz configure

This will ask open up a configuration file for you to edit.

Usage Demonstration

Interactively setting up a new monitoring job:

$ esm_viz

Setting up a monitoring job from a YAML file:

$ esm_viz </PATH/TO/EXPERIMENT.yaml>

Setting up a monitoring job from a YAML file already stored in ${HOME}/.config/monitoring

$ esm_viz EXPERIMENT

Performing only certain parts of a job:

$ # Only schedule a job to run every 2 hours:
$ esm_viz schedule EXPERIMENT
$ # Schedule a job to run every 6 hours:
$ esm_viz schedule --frequency 6 EXPERIMENT
$ # Deploying monitoring scripts and running them on the supercomputer
$ # Note that the scripts actually run depend on the configuration file
$ esm_viz deploy EXPERIMENT
$ # Combining results into a webpage
$ esm_viz combine EXPERIMENT

In the next section, the command line interface and python modules are explained in more detail. Then, we show an explanation about how to customize what is shown in the plots. - - - -

Features

  • TODO

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

History

Upcoming 0.9.6

  • Py2/Py3 agnostic FileNotFoundError

  • SSH Key generation

  • Installing with pip -v gives you a message about PATH and PYTHONPATH. However, the -v is required for this to show up. See here: https://github.com/pypa/pip/issues/2933

0.9.5 (2019-09-16)

Install seems to work for Chris. Dependencies still need to be more tightly controlled.

0.9.4 (2019-09-14)

Lots of changes since the last update. Missing history, sorry. Version 0.10.0 planned onces Christopher can monitor a job.

0.3.0 (2019-04-12)

Monitoring update to include ECHAM Global Timeseries

0.1.1 (2019-04-08)

Happy birthday to Paul!

  • Most of general analysis works for SLURM; only tested by Paul. PBS Queues are in principle possible, but untested. This should be expanded.

0.1.0 (2019-03-23)

  • Start of project in this repository. It has other history; but that is undocumented. See the proxy records…

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

esm_viz-0.9.7.tar.gz (8.1 MB view hashes)

Uploaded Source

Built Distribution

esm_viz-0.9.7-py2.py3-none-any.whl (225.0 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page