Search

Easily deploy any LLM on a VM with minimal configuration, using Ansible.

Comprehensive set of tools for working with local LLMs for various tasks.

Use ChatGPT On Wechat via wechaty

a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted!

simplifies the evaluation of LLMs by providing a unified microservice to access and test multiple AI models.

Build your own conversational search engine using less than 500 lines of code by [LeptonAI](https://github.com/leptonai).

Create, deploy and operate Actions using Python anywhere to enhance your AI agents and assistants. Batteries included with an extensive set of libraries, helpers and logging.

Playground for devs to finetune & deploy LLMs

Simple API for deploying any RAG or LLM that you want adding plugins.

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

An open-source GPU cluster manager for running LLMs

- A Device-Inference framework, including LLM Inference on device(Mobile Phone/PC/IOT)

First LLM Multi-agent framework.

An interactive chat project that leverages Ollama/OpenAI/MistralAI LLMs for rapid understanding and navigation of GitHub code repository or compressed file resources.

Interact with LLM using Ollama models(or openAI, mistralAI)via pure shell scripts on your Linux(or MacOS) system, enhancing intelligent system management without any dependencies.

AdalFlow: The library to build&auto-optimize LLM applications.

An open-source framework to evaluate, test and monitor ML and LLM-powered systems.

A Python library for validating outputs and retrying failures. Still in alpha, so expect sharp edges and bugs.

A paid product for tracking model training and prompt engineering experiments.

A paid product for detecting toxicity, hallucination, prompt injection, etc.