Skip to main content

The land ice verification and validation toolkit.

Project description

The land ice verification and validation toolkit

LIVVkit is a python-based toolkit for verification and validation of ice sheet models. It aims to provide the following capabilities:

Model V&V * Numerical verification – “Are we solving the equations correctly?” * Physical validation – “Are we using the right physics?”

Software V&V * Code verification – “did we build what we intended?” * Performance validation – “did we build what the users wanted?”

Within LIVVkit, these capabilities are broken into four components:

Model V&V * Numerics * Validation

Software V&V * Verification * Performance

Currently, LIVVkit is being developed and used in conjunction with the Community Ice Sheet Model (CISM), but is designed to be extensible to other models.

For further documentation view the full documentation.

Installation

The latest LIVVkit release can be installed via pip:

pip install livvkit

or into a conda environment:

conda install -c jhkennedy livvkit

Additionally, LIVVkit is released on github, and you can clone the source code:

git clone https://github.com/LIVVkit/LIVVkit.git

If you are having any troubles with installation or dependencies, open an issue on the issue tracker or contact us!

Usage

LIVVkit is primarily controlled via options specified at the command line. To see the full list of options, run:

livv -h

Verification

In verification mode, LIVVkit analyzes and compares a regression testing dataset to a reference dataset, both of which are produced by CISM’s built and test structure (BATS). For example, LIVVkit may analyze the dataset produced from a proposed CISM 2.0.6 release (~400MB; download here) and compare it to the dataset produced from the CISM 2.0.0 release (~400MB; download here):

export TEST=cism-2.0.6-tests/titan-gnu/CISM_glissade/
export REF=cism-2.0.0-tests/titan-gnu/CISM_glissade/

livv -v $TEST $REF -o cism206v200

This will produce a portable website in the cism206v200 directory, which can be viewed by pointing your preferred browser to cism206v200/index.html.

Note: recently we’ve been getting reports that Chrome will not display the javascript elements of our output website when viewed on the local file system. If you’re not seeing any elements on the ``cism206v200/index.html`` page, try viewing with another browser (Firefox and Safari appear to be working; IE untested).

Validation

LIVVkit’s validation option allows you to execute validation extensions (internal or external) by pointing to one or more extension config file. LIVVkit ships with a extension template located in livvkit/components/validation_tests/template/. If you don’t know the location of livvkit, run this command:

python -c 'import livvkit; print(livvkit.__file__)'

which will output something like:

/home/joe/anaconda/envs/LIVVkit/lib/python3.6/site-packages/livvkit/__init__.py

Then, you can execute the extensions template like:

export LIVVKIT=/home/joe/anaconda/envs/LIVVkit/lib/python3.6/site-packages/livvkit

livv -V $LIVVKIT/components/validation_tests/template/template.json -o val_test

This will produce a portable website in the val_test directory, which can be viewed by pointing your preferred browser to val_test/index.html.

*Note: recently we’ve been getting reports that Chrome will not display the javascript elements of our output website when viewed on the local file system. See our FAQ for a work-around.

More

For more information about using LIVVkit see the documentation.

Contact

If you would like to suggest features, request tests, discuss contributions, report bugs, ask questions, or contact us for any reason, use the Issue Tracker.

Want to send us a private message?

Joseph H. Kennedy * github: @jhkennedy * email: kennedyjh [at] ornl.gov

Katherine J. Evans * github: @kevans32 * email: evanskj [at] ornl.gov

If you’re emailing us, we recommend CC-ing all of us.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

livvkit-2.1.0.tar.gz (2.3 MB view hashes)

Uploaded Source

Built Distribution

livvkit-2.1.0-py2.py3-none-any.whl (2.3 MB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page