A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.
Cross-referenced across 55 tracked directories
#432
Popularity Rank
2 / 55
Listed In
Growing
Adoption Stage
3/19/2023
Created
39,433
GitHub Stars
4,788
Forks
1,003
Open Issues
6/2/2025
Last Commit
Gaining traction in the ecosystem
Cross-Posting Opportunities
Could also be listed in these directories:
Score: 100/100
0 dependency vulnerabilities found
GitHub Actions
Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.
...moreMaking large AI models cheaper, faster, and more accessible.
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities.