A high-throughput and memory-efficient inference and serving engine for LLMs
Cross-referenced across 55 tracked directories
#8856
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
2/9/2023
Created
75,297
GitHub Stars
15,176
Forks
458
Contributors
4,114
Open Issues
4/5/2026
Last Commit
Recently added to the ecosystem
vercel-release-bot
This package provides a foundation for implementing providers that expose an OpenAI-compatible API.
vercel-release-bot
The **[OpenAI provider](https://ai-sdk.dev/providers/ai-sdk-providers/openai)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the OpenAI chat and completion APIs and embedding model support for the OpenAI embeddings API.
...moretannerlinsley
OpenAI adapter for TanStack AI chat, tools, images, video, speech, transcription, realtime, and structured outputs.
Jan Oberhauser
