Awesome LLM Apps

Node.JS community benchmarks result sets

A high-throughput and low-latency inference and serving framework for LLMs and VLs

Fine-tune, serve, deploy, and monitor any open-source LLMs in production. Used in production at [BentoML](https://bentoml.com/) for LLMs-based applications.

A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.

Nvidia Framework for LLM Inference

Train transformer language models with reinforcement learning.

Making large AI models cheaper, faster, and more accessible.

veRL is a flexible and efficient RL framework for LLMs.

A simple, performant and scalable Jax LLM!

A Challenging, Contamination-Free LLM Benchmark.

Curated list of resources for ChatGPT and GPT-3 from OpenAI.

Open-source framework for fine-tuning and evaluating LLMs. It simplifies the process of experimenting with different training configurations and makes it easy to reproduce and share results, supporting features like LoRA, QLoRA, DeepSpeed, PEFT, and multi-GPU setups.

A curation of awesome tools, documents and projects about LLM Security.

A framework for evaluating language models

LLM application: Other Papers

The testing framework dedicated to ML models, from tabular to LLMs

A guidance language for controlling large language models.

LLM inference in C/C++.

LLM application: LLM Evaluation