Autonomous AI agents that perform tasks independently
A curation of awesome tools, documents and projects about LLM Security.
veRL is a flexible and efficient RL framework for LLMs.
Making large AI models cheaper, faster, and more accessible.
A simple, performant and scalable Jax LLM!
Open-source framework for fine-tuning and evaluating LLMs. It simplifies the process of experimenting with different training configurations and makes it easy to reproduce and share results, supporting features like LoRA, QLoRA, DeepSpeed, PEFT, and multi-GPU setups.
...moreLLM inference in C/C++.
Nvidia Framework for LLM Inference
A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.
Fine-tune, serve, deploy, and monitor any open-source LLMs in production. Used in production at [BentoML](https://bentoml.com/) for LLMs-based applications.
...moreA high-throughput and low-latency inference and serving framework for LLMs and VLs
Locally running websearch using LLM chains
A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.
...moreAn open-source library for evaluating task performance of language models and prompts.
Open Source Hybrid AI Search Engine, Instantly Get Accurate Answers from the Internet, Bookmarks, Notes, and Docs. Support One-Click Deployment
...moreOpen source AutoML tool for RAG. Optimize the RAG answer quality automatically. From generation evaluation datset to deploying optimized RAG pipeline.
...moreTensorZero is an open-source framework for building production-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluations, and experimentation.
...moreLarge-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities.
chiragjoshi12
Anthropic's agentic coding tool that lives in your terminal and helps you turn ideas into code.
"building applications with LLMs through composability"
mahseema
A curated list of Artificial Intelligence Top Tools
GitHub Actions
n8n community node for retainr.dev — AI agent memory persistence API. Store, search, and retrieve semantic memories for AI agents across workflow runs.
...morebetterdata
OpenAI adapter for creating Loop Engine AI actor submissions
boomslag
Coding agent CLI with read, bash, edit, write tools and session management
unwarkz
N8N community node for Mem0 - intelligent memory layer for AI applications