Developer tools

an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.

Easily build, version, evaluate and deploy your LLM-powered apps.

A programming language for LLM interaction with support for typed prompting, control flow, constraints, and tools.

Write, edit, and chat about your code with a powerful AI.

Cohere provides access to advanced Large Language Models and NLP tools.

A neuro-symbolic framework for building applications with LLMs at the core.

An open-source Python RAG framework for SQL generation and related functionality. [#opensource](https://github.com/vanna-ai/vanna)

A full-stack LLMOps platform for LLM monitoring, caching, and management.

Train, fine-tune-and run inference on AI models blazing fast, at low cost, and at production scale.

Turn any Git repository into a simple text digest of its codebase so it can be fed into any LLM. [#opensource](https://github.com/cyclotruc/gitingest)

Official inference framework for 1-bit LLMs, by Microsoft. [#opensource](https://github.com/microsoft/BitNet)

A unified interface for LLMs. [#opensource](https://github.com/OpenRouterTeam)

A low-code framework for building custom AI models like LLMs and other deep neural networks. [#opensource](https://github.com/ludwig-ai/ludwig)

A Python library for fine-tuning LLMs [#opensource](https://github.com/unslothai/unsloth).