Back to Agents
LMDeploy
AgentLLM Inferencellmai-appawesome-list
A high-throughput and low-latency inference and serving framework for LLMs and VLs
Directory Presence
Cross-referenced across 55 tracked directories
Adoption Metrics
#314
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
2d
Listed For
Recently added to the ecosystem
Related Agents
NVIDIA Framework for LLM Inference(Transitioned to TensorRT-LLM)
AgentLLM Inference
1 dir
SGLang is a fast serving framework for large language models and vision language models.
AgentLLM Inference
1 dir