Skip to main content

Python hdf5 tools

Project description

This git repository contains a python package with an H5 class to load and combine one or more HDF5 data files (or xarray datasets) with optional filters. The class will then export the combined data to an HDF5 file, file object, or xr.Dataset. This class is designed to be fast and safe on memory. This means that files of any size can be combined and saved even on a PC with low memory (unlike xarray).

TODO:

  • Create a sel method for the File class. This should mimic xarray, but create a copy of the File with optional saving to a local file just like creating a new file using the File class. At least initially to make it easier, just do straightforward indexing like is done with the LocationIndexer which gets copied over to a newly created File/dataset object.

  • The to_pandas method in datasets should be similar to xarray, which creates pandas indexes. The to_pandas method for the File class should concat all of the datasets to_pandas output together.

  • The to_xarray method for both Dataset and File should use the existing hdf5 local file if it exists and close the file via h5py before linking to it via the xarray open_dataset.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hdf5tools-0.4.0.tar.gz (19.2 MB view hashes)

Uploaded Source

Built Distribution

hdf5tools-0.4.0-py2.py3-none-any.whl (19.2 MB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page