LLM Applications

Tools for LLM prompt testing and experimentation

The TypeScript library for building AI applications.

A guidance language for controlling large language models.

MLflow is an open source platform for the complete machine learning lifecycle

The zero-boilerplate LLM framework for humans.

AI Observability and Evaluation

Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

An open-source GPU cluster manager for running LLMs

Use ChatGPT On Wechat via wechaty

First LLM Multi-agent framework.

a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted!

An interactive chat project that leverages Ollama/OpenAI/MistralAI LLMs for rapid understanding and navigation of GitHub code repository or compressed file resources.

simplifies the evaluation of LLMs by providing a unified microservice to access and test multiple AI models.

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

Comprehensive set of tools for working with local LLMs for various tasks.

- A Device-Inference framework, including LLM Inference on device(Mobile Phone/PC/IOT)

Build your own conversational search engine using less than 500 lines of code by [LeptonAI](https://github.com/leptonai).

Create, deploy and operate Actions using Python anywhere to enhance your AI agents and assistants. Batteries included with an extensive set of libraries, helpers and logging.

Playground for devs to finetune & deploy LLMs

Simple API for deploying any RAG or LLM that you want adding plugins.