a toolkit for deploying and serving Large Language Models (LLMs).
Cross-referenced across 55 tracked directories
#2820
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
3/13/2026
First Seen
Recently added to the ecosystem
A high-throughput and low-latency inference and serving framework for LLMs and VLs
SGLang is a fast serving framework for large language models and vision language models.