Queue-driven local-inference primitive — drives a cloudflared-tunneled vLLM tower (or any OpenAI-compatible endpoint) with an SQLite-backed job queue, iteration loop runtime, fallback to Workers AI, and reusable job templates.
Cross-referenced across 55 tracked directories
#8884
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
10/18/2026
First Seen
Recently added to the ecosystem
benvargas
AI SDK v6 provider for Claude via Claude Agent SDK (use Pro/Max subscription)
packy-anthropic
The official TypeScript library for the Anthropic API
jagdishpal02000
Apple's on-device (Foundation Models) and Private Cloud Compute LLMs from Node: tools, streaming, structured output, an OpenAI-compatible server and a Vercel AI SDK provider. No API key, no account.
...more