The elegant bridge between hugginface data and fastai2
Project description
hugdatafast
The elegant integration of huggingface/nlp and fastai2, and some handy data transformation for huggingface/nlp.
🎓 ** Documentation ** : https://hugdatafast.readthedocs.io/en/latest/
Install
pip install hugdatafast
Furture Plan
- I will try to merge this library to fastai2 and huggingface/nlp respectively. But to not introduce bugs into the two great libraries and for fast development, I may try it after my personal project which hugdatafast is created for, is completed (few months later I think), to somewhat assure it is mature enough to be merged into two libraries.
- The implemenatation of
ConcatTransform
works but might be too complexed to extend, so I may discuss with huggingface to see how to improve it, if I have time. - Currently, it is designed to work with the dataset part of huggingface/nlp, I may also integrate metric part of it.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
hugdatafast-0.4.0.tar.gz
(14.9 kB
view hashes)
Built Distribution
Close
Hashes for hugdatafast-0.4.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 935b5252eafaa456983be34be916d1f8260d247f374ed0394c8e8d87115c8b02 |
|
MD5 | 4682d0d16bfe86b79c17d4aa3e3acf7c |
|
BLAKE2b-256 | eec39d01aebae56e955971dfd1c7cca52d27e11b202e2f6b0b480927c10f17e1 |