Skip to main content

A decentralized and distributed horizontally scalable model execution framework.

Project description

scattermind

Scattermind is a decentralized and distributed horizontally scalable model execution framework. Worried your model won't fit in memory? Scattermind splits the model into small independently executable sub-models to accomodate even small machines (*).

(*) Currently only available through plugins. Once the plugins have matured they will be included in the main distribution.

TODOs

A rough outline of planned features:

  • node based caching
  • record / replay inputs
  • record / replay activity
  • log granular activity
  • split nodes
  • benchmark
  • diffusion model
  • push notification on result
  • computation timing estimates
  • self configuration
  • config hotloading
  • model training

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scattermind-0.3.3.tar.gz (108.2 kB view hashes)

Uploaded Source

Built Distribution

scattermind-0.3.3-py3-none-any.whl (153.5 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page