Nvidia Framework for LLM Inference
Cross-referenced across 55 tracked directories
#340
Popularity Rank
2 / 55
Listed In
Growing
Adoption Stage
8/16/2023
Created
13,147
GitHub Stars
2,197
Forks
1,130
Open Issues
3/19/2026
Last Commit
Gaining traction in the ecosystem
Cross-Posting Opportunities
Could also be listed in these directories:
Score: 100/100
0 dependency vulnerabilities found
A high-throughput and low-latency inference and serving framework for LLMs and VLs
SGLang is a fast serving framework for large language models and vision language models.