An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
Cross-referenced across 55 tracked directories
#2875
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
12/22/2020
Created
7,470
GitHub Stars
1,125
Forks
109
Contributors
129
Open Issues
10/11/2026
Last Commit
Recently added to the ecosystem
Score: 100/100
0 dependency vulnerabilities found
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Making large AI models cheaper, faster, and more accessible.