Blazingly fast LLM inference.
Cross-referenced across 55 tracked directories
#2882
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
2/26/2024
Created
7,780
GitHub Stars
748
Forks
98
Contributors
419
Open Issues
10/24/2026
Last Commit
Recently added to the ecosystem
Score: 100/100
0 dependency vulnerabilities found
vLLM Team
A high-throughput and memory-efficient inference and serving engine for LLMs
A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.