mistral.rs

AgentLLM Inferencellmai-appawesome-list

Blazingly fast LLM inference.

Directory Presence

Cross-referenced across 55 tracked directories

Directory	Status	First Seen	Last Confirmed	Link
A Awesome LLM Apps		3/13/2026	3/16/2026

Adoption Metrics

#311

Popularity Rank

1 / 55

Listed In

Emerging

Adoption Stage

Listed For

Recently added to the ecosystem

Related Agents

llama.cpp

LLM inference in C/C++.

AgentLLM Inference

2 dirs

FastChat

A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.

AgentLLM Inference

2 dirs

Haystack

an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.

AgentLLM Inference

2 dirs

OpenLLM

Fine-tune, serve, deploy, and monitor any open-source LLMs in production. Used in production at [BentoML](https://bentoml.com/) for LLMs-based applications.

AgentLLM Inference

2 dirs