Skip to main content

A package for running AB tests in a Bayesian framework.

Project description

Bayesian AB Test Report Builder

Build Status PyPI version

Baker Moran

This allows AB testers to create a standard report for test results with python. Handles multiple variant tests, with a variety of prior function types. This is meant to be an abstraction from the nitty gritty of the details of Bayesian statistics. That said, some knowledge about which prior function to use etc. will be helpful for the user.

Installation

  • Install via pip (or specify pip3)

    pip install BayesABTest
    

    OR

  • Download files from PyPi and install

Package Functions and Classes

ab_test_model

Class implementing out of the box AB testing functionality. Simple, easy to use AB testing with many different prior function types, all in one clean interface.

ab_test_dist_explorer

Functions allowing a user to explore different distributions with simple to user interface. Allows a user to visually learn about bayesian statistics, and inform proper prior function choice when doing Bayesian AB testing.

Appendix

Learning

For a documentation explaining and motivating the use of Bayesian statistics to evaluate A/B tests, see documentation

Acknowledgements

There is a lot of documentation out there about a Bayesian framework of A/B testing. Some of the specific articles are listed below. Most of the work I came across was written in R, and I set out to create a Python implementation. The visuals were inspired by a standard template we use at Root, first written by https://github.com/zachurchill-root.

Articles Reference:

Version History

  • 0.1.0-prealpha - 12/02/2019
  • 1.0.0-alpha - 12/27/2019
  • 1.0.1-alpha - 01/02/2020
  • 1.0.2-alpha - 02/11/2020
  • 1.0.3-alpha - 02/21/2020
  • 1.0.4-alpha - 06/22/2020

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

BayesABTest-1.0.4.tar.gz (1.1 MB view hashes)

Uploaded Source

Built Distribution

BayesABTest-1.0.4-py3-none-any.whl (19.8 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page