Skip to main content

Identify changes in model outputs at prediction time.

Project description

predeval

https://img.shields.io/pypi/v/predeval.svg https://img.shields.io/travis/dvatterott/predeval.svg Documentation Status https://codecov.io/gh/dvatterott/predeval/branch/master/graph/badge.svg Updates

This software is built to identify changes in a model output before evaluation data becomes available.

For example, if you create a churn model, you will have to wait X number of weeks before learning whether users churned (and can evaluate your churn model predictions).

This software will not guarantee that your model is accurate, but it will alert you if your model’s outputs (i.e., predictions) are different from what they have been in the past. A model’s output can pass predeval tests and be inaccurate and a model’s output can fail predeval and be accurate. That said, unexpected changes in model outputs likely represent a change in accuracy.

Installation

Installation is described here: https://predeval.readthedocs.io/en/latest/installation.html

Example Usage

Examples can be found here: https://predeval.readthedocs.io/en/latest/usage.html

API Documentation

Documentation of the software can be found here: https://predeval.readthedocs.io/en/latest/api.html

Contributing

Info about contributing can be found here: https://predeval.readthedocs.io/en/latest/contributing.html

Changelog

Changelog can be found here: https://predeval.readthedocs.io/en/latest/history.html

Credits

Info about contributors can be found here: https://predeval.readthedocs.io/en/latest/authors.html

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

History

0.0.1 (2019-01-06)

  • First release on PyPI.

0.0.2 (2019-01-06)

  • Adding pypi deploy to travis.

0.0.3 (2019-01-06)

  • Only one travis version publishes to pypi.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

predeval-0.0.10.tar.gz (18.3 kB view hashes)

Uploaded Source

Built Distribution

predeval-0.0.10-py2.py3-none-any.whl (11.0 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page