Search

AI-powered log analyzer for CI environments using LLMs

Turn Python functions into typed LLM calls using docstrings as prompts

Intelligent multi-LLM request router for cost optimization

A CLI tool to list available LLM models from various providers

Lightweight SDK for LLM cost & latency monitoring

Advanced system information tool for local LLM usage

Use an LLM to run inference, for NER (named entity recognition) and/or NEL (named entity linking). Build a knowledge graph. Evaluate results.

LLM plugin providing access to models running on an Ollama server

LLM plugin for models hosted by OpenRouter

No description available

A library for scraping and managing LLM pricing information

Test prompt variants across LLM providers with LLM-as-judge evaluation

Cloud-agnostic rate limit mitigation for LLM APIs

Privacy-first text redaction using local LLM models with rule generation capabilities

A centralized registry for discovering and managing LLM model capabilities. Track model features, costs, and limitations across providers like OpenAI and Anthropic. Supports both verified model definitions and user-managed entries with local storage.

A safety+observability layer for LLM calls: policy guardrails, secret scanning, sanitization, schema validation, retries, budgets, and logs.

Dynamic feature distillation framework for robust zero-shot LLM annotation.

LLM-ify your JSON schemas

This is a python sdk for llm

Smart memory management for LLM conversations - topic-aware compression that just works