Run LLMs and batch jobs on any cloud. Get maximum cost savings, highest GPU availability, and managed execution -- all with a simple interface.
Cross-referenced across 55 tracked directories
#2820
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
8/11/2021
Created
9,593
GitHub Stars
999
Forks
366
Open Issues
3/19/2026
Last Commit
Recently added to the ecosystem
Score: 100/100
0 dependency vulnerabilities found
A high-throughput and low-latency inference and serving framework for LLMs and VLs
SGLang is a fast serving framework for large language models and vision language models.