vllm-project
@vllm-project
3
Published Tools
0
Total Stars
0
Weekly Downloads
100/100
Avg Security
Published Tools
3 Skillsacross 3 categoriesvllm
vLLM Team
A
A high-throughput and memory-efficient inference and serving engine for LLMs
SkillLLM Inference
2 dirs
llm-katan
Yossi Ovadia <yovadia@redhat.com>
A
LLM Katan - Lightweight LLM Server for Testing - Real tiny models with FastAPI and HuggingFace
Skilluncategorised
1 dir
vllm-sr
vLLM-SR Team
A
vLLM Semantic Router - Intelligent routing for Mixture-of-Models
Skillai-ml
1 dir