Switchyard is an open-source Rust proxy and library from NVIDIA NeMo for routing LLM application traffic across model providers. It preserves OpenAI and Anthropic API compatibility, translates between request formats, records operational metrics, and gives teams typed routing algorithms for model selection, benchmarking, and cost-aware deployments.
Cross-referenced across 55 tracked directories
#9020
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
10/28/2026
First Seen
Recently added to the ecosystem
Score: 100/100
0 dependency vulnerabilities found
Alex Jones <[email protected]>
Unofficial PyPI distribution of llmfit – the LLM model management CLI
OpenTPU is an open-source AI accelerator project that combines RTL, ISA design, simulation, compiler work, profiling, and model demos in one GitHub repository. It targets builders exploring how LLM inference can run on custom accelerator hardware and FPGA boards.
...moreTokenHub is an Apache-2.0 AI model gateway written primarily in Go. Its README describes OpenAI-compatible, Anthropic Messages, image generation, provider channels, routing policies, project-scoped keys, usage analytics, RBAC, OAuth/OIDC identity sources, audit trails, and deployment through native Linux systemd or Docker Compose.
...moreKubernetes-native distributed inference serving for large language models on modern accelerators and production infrastructure The listing is based on the official GitHub repository, README, stars, forks, open issues, license, and recent commit metadata available during the daily OpenTools pipeline run.
...more