Run LLMs and batch jobs on any cloud. Get maximum cost savings, highest GPU availability, and managed execution -- all with a simple interface.
Cross-referenced across 55 tracked directories
#2872
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
8/11/2021
Created
10,755
GitHub Stars
1,311
Forks
280
Contributors
518
Open Issues
10/27/2026
Last Commit
Recently added to the ecosystem
Score: 100/100
0 dependency vulnerabilities found
A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.
an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.
...more