Search

A simple, performant and scalable Jax LLM!

Open-source framework for fine-tuning and evaluating LLMs. It simplifies the process of experimenting with different training configurations and makes it easy to reproduce and share results, supporting features like LoRA, QLoRA, DeepSpeed, PEFT, and multi-GPU setups.

LLM inference in C/C++.

Nvidia Framework for LLM Inference

A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.

an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.

Fine-tune, serve, deploy, and monitor any open-source LLMs in production. Used in production at [BentoML](https://bentoml.com/) for LLMs-based applications.

A high-throughput and low-latency inference and serving framework for LLMs and VLs

Efficient Triton Kernels for LLM Training.

Locally running websearch using LLM chains

A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.

A paid product for building, comparing, and shipping language model apps.

A paid product for testing and improving prompts.

An open-source library for evaluating task performance of language models and prompts.

A programming language for LLM interaction with support for typed prompting, control flow, constraints, and tools.

Open Source Hybrid AI Search Engine, Instantly Get Accurate Answers from the Internet, Bookmarks, Notes, and Docs. Support One-Click Deployment

Open source AutoML tool for RAG. Optimize the RAG answer quality automatically. From generation evaluation datset to deploying optimized RAG pipeline.

TensorZero is an open-source framework for building production-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluations, and experimentation.

A guide to building your own working LLM.

Share your wildest ChatGPT conversations with one click.