Hopefully safe and deterministic serializer to binary format, including Pandas data
Project description
lazydf - Serialization of nested objects to binary format
An alternative to pickle, but may use pickle if safety is not needed.
Principle: Start from the simplest and safest possible and try to be fast.
- try orjson
dict
,str
,int
, etc
- try bson
- standard types accepted by mongodb
- serialize as numpy
- ndarray, pandas dataframe/series
Non-deterministic and unsafe modes (pickle) are planned for the near future.
Python installation
from package
# Set up a virtualenv.
python3 -m venv venv
source venv/bin/activate
# Install from PyPI
pip install lazydf
from source
git clone https://github.com/lazydf/lazydf
cd lazydf
poetry install
Examples
Some usage examples.
Grants
This work was partially supported by Fapesp under supervision of Prof. André C. P. L. F. de Carvalho at CEPID-CeMEAI (Grants 2013/07375-0 – 2019/01735-0).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
lazydf-0.220726.1.tar.gz
(17.9 kB
view hashes)
Built Distribution
Close
Hashes for lazydf-0.220726.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 121e930cd404c3ec363c84b578f560c456f517dfb9e5e39ef49d7a388a2cf39f |
|
MD5 | a00b9c4cd9e80ae8330d879b30dc2a2f |
|
BLAKE2b-256 | 040fe5af767259a45e8045785a123bb2acfc74478a51c270b4c8c28993d766c7 |