Skip to main content

A fast & compressed ndarray library with a flexible compute engine.

Project description

A fast & compressed ndarray library with a flexible compute engine

Author:

The Blosc development team

Contact:

blosc@blosc.org

Github:

https://github.com/Blosc/python-blosc2

Actions:

actions

PyPi:

version

NumFOCUS:

numfocus

Code of Conduct:

Contributor Covenant

What is Python-Blosc2?

Python-Blosc2 is a high-performance compressed ndarray library with a flexible compute engine, using C-Blosc2 as its compression backend. It allows complex calculations on compressed data, whether stored in memory, on disk, or over the network (e.g., via Caterva2). It uses the C-Blosc2 simple and open format for storing compressed data.

More info: https://www.blosc.org/python-blosc2/getting_started/overview.html

Installing

Binary packages are available for major OSes (Win, Mac, Linux) and platforms. Install from PyPi using pip:

pip install blosc2 --upgrade

Conda users can install from conda-forge:

conda install -c conda-forge python-blosc2

Documentation

The documentation is available here:

https://blosc.org/python-blosc2/python-blosc2.html

You can find examples at:

https://github.com/Blosc/python-blosc2/tree/main/examples

A tutorial from PyData Global 2024 is available at:

https://github.com/Blosc/Python-Blosc2-3.0-tutorial

It contains Jupyter notebooks explaining the main features of Python-Blosc2.

License

This software is licensed under a 3-Clause BSD license. A copy of the python-blosc2 license can be found in LICENSE.txt.

Discussion forum

Discussion about this package is welcome at:

https://github.com/Blosc/python-blosc2/discussions

Social feeds

Stay informed about the latest developments by following us in Mastodon, Bluesky or LinkedIn.

Thanks

Blosc2 is supported by the NumFOCUS foundation, the LEAPS-INNOV project and ironArray SLU, among many other donors. This allowed the following people have contributed in an important way to the core development of the Blosc2 library:

  • Francesc Alted

  • Marta Iborra

  • Aleix Alcacer

  • Oscar Guiñón

  • Juan David Ibáñez

  • Ivan Vilata i Balaguer

  • Oumaima Ech.Chdig

In addition, other people have participated to the project in different aspects:

  • Jan Sellner, contributed the mmap support for NDArray/SChunk objects.

  • Dimitri Papadopoulos, contributed a large bunch of improvements to the in many aspects of the project. His attention to detail is remarkable.

  • And many others that have contributed with bug reports, suggestions and improvements.

Citing Blosc

You can cite our work on the various libraries under the Blosc umbrella as follows:

@ONLINE{blosc,
  author = {{Blosc Development Team}},
  title = "{A fast, compressed and persistent data store library}",
  year = {2009-2025},
  note = {https://blosc.org}
}

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page