Search

Feature discovery and generation utilities

Identify LLMs by their response fingerprints

Black-box LLM fingerprinting system for model identification

LLM plugin to load entire folder contents as fragments

LLM plugin to access Google's Gemini family of models

Add your description here

LLM plugin providing access to Grok models using the xAI API

CLI tool for managing LLM IDE prompts and rules

A comprehensive toolkit that provides building blocks for LLM-based named entity recognition, attribute extraction, and relation extraction pipelines.

A readable LLM inference server implementing paged attention and continuous batching

LLM inferencing utilities for multiple projects.

Async OpenAI Responses API client with typed tool calling, lazy output parsing, and Azure/Databricks backends

使用 LLM 修正 json 文件

Robust JSON parsing for LLM outputs with automatic repair and field extraction

Confidence-driven escalation middleware for classifier edge cases

LLM Katan - Lightweight LLM Server for Testing - Real tiny models with FastAPI and HuggingFace

Framework for collecting and managing LLM context

A tool for loading and computing on parts of LLM models.

Production-ready LLM client with audit trail, deterministic caching, and provenance tracking

LLM plugin for models served by LMStudio (local LLM studio HTTP API)