Supercharge Your LLM Training with Checkpointable Data Loading
Project description
Epochraft
Supercharge your LLM training with checkpointable data loading.
Key Features
- Checkpointing - Epochraft operates completely deterministically, and allows for a full restoration of state through checkpointing.
- Simple - It's a minimally readable implementation that makes it easy for users to add sources and transforms.
- LLM-Ready - It is equipped out of the box with features necessary for pre-training and SFT of LLMs.
Development
pip install -e .[development]
mypy .; black .; flake8 .; isort .
pytest tests
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for epochraft-0.1.0.dev20230804.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | a5be70f6972b48041fee79aff3e72f10bb9704f76e7d01b3fc07b743b53eb07d |
|
| MD5 | f05cb880ee1569fce1fcbc9af989b415 |
|
| BLAKE2b-256 | b666fca7ff63743c5717b081434e2162d838274751276e506cdfe96c7bfb3370 |
Close
Hashes for epochraft-0.1.0.dev20230804-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | aacfa3b122b0f9661f6df7fd90d87feed59c9ae509c875972b13b49f1d3ba360 |
|
| MD5 | 28688f34936f4a6ccef7ae9814cf4809 |
|
| BLAKE2b-256 | 730e3f396ad1a4491384c1de7b0e817cfb85188596e54098451dbf7c54171f42 |
