Ongoing research training transformer models at scale.
Cross-referenced across 55 tracked directories
#2814
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
3/21/2019
Created
15,731
GitHub Stars
3,713
Forks
652
Open Issues
3/19/2026
Last Commit
Recently added to the ecosystem
Score: 100/100
0 dependency vulnerabilities found
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Open-source framework for fine-tuning and evaluating LLMs. It simplifies the process of experimenting with different training configurations and makes it easy to reproduce and share results, supporting features like LoRA, QLoRA, DeepSpeed, PEFT, and multi-GPU setups.
...more