prima.cpp

AgentLLM Inferencellmai-appawesome-list

A distributed implementation of llama.cpp that lets you run 70B-level LLMs on your everyday devices.

Directory Presence

Cross-referenced across 55 tracked directories

Directory	Status	First Seen	Last Confirmed	Link
A Awesome LLM Apps		3/13/2026	3/16/2026

#314

Popularity Rank

1 / 55

Listed In

Emerging

Adoption Stage

Listed For

Recently added to the ecosystem

a toolkit for deploying and serving Large Language Models (LLMs).

AgentLLM Inference

1 dir

NVIDIA Framework for LLM Inference(Transitioned to TensorRT-LLM)

AgentLLM Inference

1 dir

SGLang is a fast serving framework for large language models and vision language models.

AgentLLM Inference

1 dir

Nvidia Framework for LLM Inference

AgentLLM Inference

1 dir