Easily deploy any LLM on a VM with minimal configuration, using Ansible.
Cross-referenced across 55 tracked directories
#560
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
5/1/2025
Created
3
GitHub Stars
Score: 100/100
0 dependency vulnerabilities found
Run an AI-powered security scan to analyze this package's source code for vulnerabilities, prompt injection vectors, data exfiltration risks, and behavior mismatches.
Scans fetch actual source code from the GitHub repository, not just the README.
vLLM Team
A high-throughput and memory-efficient inference and serving engine for LLMs
A high-throughput and low-latency inference and serving framework for LLMs and VLs
Nvidia Framework for LLM Inference
SGLang is a fast serving framework for large language models and vision language models.
5/1/2025
Last Commit
Recently added to the ecosystem