Efficient Large-Scale Distributed Training with Colossal-AI and Lightning AI.
Project description
Lightning ⚡ Colossal-AI
Efficient Large-Scale Distributed Training with Colossal-AI and Lightning AI
Installation
pip install -U lightning lightning-colossalai
Usage
Simply set the strategy argument in the Trainer:
import lightning as L
trainer = L.Trainer(strategy="colossalai", precision="16-mixed", devices=...)
For more fine-grained tuning of Colossal-AI's parameters, pass the strategy object to the Trainer:
import lightning as L
from lightning_colossalai import ColossalAIStrategy
strategy = ColossalAIStrategy(...)
trainer = L.Trainer(strategy=strategy, precision="16-mixed", devices=...)
Find all configuration options in the docs!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for lightning-colossalai-0.1.0rc1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7bef57bcb6649ec961046b7a877d2db3b0deea02ae0a9fdb4fbd8a9c46dad33e |
|
MD5 | f4cd6ab90d87638764013d2bb64bfdfe |
|
BLAKE2b-256 | 6b12dd12f6ce32b75b4b0b34d8d43522abe0a3118c7b5ac8ee928aacea81d4d9 |
Close
Hashes for lightning_colossalai-0.1.0rc1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 857d835507a9be396a55d0c40d89baba946a4fd0de38fcc0e2f8bd277189787b |
|
MD5 | 7719e2f6afd2175bb9b80ffe2a071cc0 |
|
BLAKE2b-256 | 75d69f2297fcdb23e325b6354b99a286f7abe324dfb7d35bf67073b8a74158ad |