A high-throughput and low-latency inference and serving framework for LLMs and VLs
Cross-referenced across 55 tracked directories
#432
Popularity Rank
2 / 55
Listed In
Growing
Adoption Stage
6/15/2023
Created
7,703
GitHub Stars
666
Forks
571
Open Issues
3/19/2026
Last Commit
Gaining traction in the ecosystem
Cross-Posting Opportunities
Could also be listed in these directories:
Score: 100/100
0 dependency vulnerabilities found
vLLM Team
A high-throughput and memory-efficient inference and serving engine for LLMs
SkyPilot Team
Run LLMs and batch jobs on any cloud. Get maximum cost savings, highest GPU availability, and managed execution -- all with a simple interface.
...more