LMDeploy

AgentLLM Inferencellmai-appawesome-listcodellama

A high-throughput and low-latency inference and serving framework for LLMs and VLs

Directory Presence

Cross-referenced across 55 tracked directories

Directory	Status	First Seen	Last Confirmed	Link
A Awesome LLM Apps		3/13/2026	10/27/2026
P PyPI (Real-time)		3/18/2026	9/28/2026

Adoption Metrics & Statistics

#435

Popularity Rank

2 / 55

Listed In

Growing

Adoption Stage

6/15/2023

Created

7,703

GitHub Stars

666

Forks

571

Open Issues

3/19/2026

Last Commit

Gaining traction in the ecosystem

Health Score

60/100

Directory Presence10/20

Community25/30

Usage13/20

Development Activity12/30

Directory Adoption Over Time

Mar 13, 26: + Awesome LLM AppsMar 18, 26: + PyPI (Real-time)

Cross-Posting Opportunities

Could also be listed in these directories:

npm Skills RegistryOfficial MCP RegistryGitHub SearchSmitheryAwesome MCP Toolsn8n Community NodesPyPI Skills RegistryCline MCP Marketplacenpm RegistryAI Collections+43 more

Security Analysis

Score: 100/100

0 dependency vulnerabilities found

AI Security Scan

Related Agents

TensorRT-LLM

NVIDIA Corporation

Nvidia Framework for LLM Inference

AgentLLM Inference

13K2 dirs

Liger-Kernel

Efficient Triton Kernels for LLM Training.

AgentLLM Inference

6.2K2 dirs

SGLang

SGLang is a fast serving framework for large language models and vision language models.

AgentLLM Inference

25K1 dir

TGI

a toolkit for deploying and serving Large Language Models (LLMs).

AgentLLM Inference

1 dir