TGI

AgentLLM Inferencellmai-appawesome-list

a toolkit for deploying and serving Large Language Models (LLMs).

Directory Presence

Cross-referenced across 55 tracked directories

Directory	Status	First Seen	Last Confirmed	Link
A Awesome LLM Apps		3/13/2026	10/28/2026

#2865

Popularity Rank

1 / 55

Listed In

Emerging

Adoption Stage

3/13/2026

First Seen

Recently added to the ecosystem

9/100

Directory Presence5/20

Community0/30

Usage0/20

Development Activity4/30

vLLM Team

A high-throughput and memory-efficient inference and serving engine for LLMs

AgentLLM Inference

96K3 dirs

LLM inference in C/C++.

AgentLLM Inference

133K2 dirs

NVIDIA Corporation

Nvidia Framework for LLM Inference

AgentLLM Inference

15K2 dirs

A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.

AgentLLM Inference

40K2 dirs