Simple framework for planet-scale idempotent computations in Python.
Project description
Pythagoras
Scalable idempotent computations in Python.
What is it?
Pythagoras
is a framework for easy and cost-efficient
massive algorithm parallelization in Python. It helps to accelerate
data science, machine learning, and AI workflows.
Pythagoras offers:
- Persistent function memoization that tracks data dependencies and changes in the functions' code.
- Scalable parallel execution of memoized functions on a local machine or in a distributed environment.
- Simple and inexpensive storage-based orchestration backend.
Usage
Introduction to Pythagoras
notebook: https://colab.research.google.com/drive/1tSJkpHl49Y9ZrYskkdoH2ti3_VZ5_6cj
How to get it?
The source code is hosted on GitHub at: https://github.com/vladlpavlov/pythagoras
Installers for the latest released version are available at the Python package index at: https://pypi.org/project/pythagoras
pip install pythagoras
Dependencies
- persidict
- jsonpickle
- joblib
- lz4
- pandas
- numpy
- psutil
- boto3
- pytest
- moto
- boto3
- scipy
- jsonpickle
- scikit-learn
- autopep8
- pytorch
- tensorflow
- keras
Key Contacts
About The Name
Pythagoras of Samos was a famous ancient Greek thinker and scientist who was the first man to call himself a philosopher ("lover of wisdom"). He is most recognised for his many mathematical findings, including the Pythagorean theorem.
Not everyone knows that in antiquity, Pythagoras was also credited with major astronomical discoveries, such as sphericity of the Earth and the identity of the morning and evening stars as the planet Venus.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.