A high-throughput and memory-efficient inference and serving engine for LLMs
Cross-referenced across 55 tracked directories
#8889
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
2/9/2023
Created
75,297
GitHub Stars
15,176
Forks
458
Contributors
4,114
Open Issues
4/5/2026
Last Commit
Recently added to the ecosystem
vercel-release-bot
This package provides a foundation for implementing providers that expose an OpenAI-compatible API.
vercel-release-bot
The **[OpenAI provider](https://ai-sdk.dev/providers/ai-sdk-providers/openai)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the OpenAI chat and completion APIs and embedding model support for the OpenAI embeddings API.
...moreJan Oberhauser
