ai-ml

Routra Python SDK - OpenAI-compatible client with intelligent multi-provider routing

LM Proxy Server is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

KvikIO - GPUDirect Storage (C++)

Provides the underlying framework to enhance langchain and add loading configurations

KvikIO - GPUDirect Storage

LLM Proxy Server is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

Extensible conversation context management toolkit for LLM applications

PyO3 bindings and Python interface to FragGeneScanRs, a gene prediction model for short and error-prone reads.

LLM Router API server for OmniComp providers

Production-ready Telegram FAQ bot with Russian LLMs, RAG, and multi-provider fallback

Portable Claude Code workspace archives

A Python package for tuning vLLM hyperparameters.

Self-hosted semantic search and knowledge management for LLM-driven development

Atomic Model Fragmentation (AMF) - Universal LLM Decomposition Library

Backend.AI Storage Proxy

LangChain BaseTool for estimating and deploying NEAR smart contracts

Canonical result and measurement data storage APIs for Cogniflow

LLMOps Observability SDK: decorators + SQS dispatch with compression

AI-powered Python fuzzer using LiteLLM and Atheris to automatically generate and execute fuzzing harnesses.

TurboQuant KV cache compression for local LLM inference