Python wrapper for llama.cpp server - OpenAI API compatible backend with auto device detection
Cross-referenced across 55 tracked directories
#322
Popularity Rank
2 / 55
Listed In
Growing
Adoption Stage
3/10/2023
Created
98,637
GitHub Stars
15,635
Forks
1,276
Open Issues
3/19/2026
Last Commit
Gaining traction in the ecosystem
Cross-Posting Opportunities
Could also be listed in these directories:
Score: 100/100
0 dependency vulnerabilities found
Jan Chorowski
LLM-App is a library for creating responsive AI applications leveraging OpenAI/Hugging Face APIs to provide responses to user queries based on live data sources. Build your own LLM application in 30 lines of code, no vector database required.
...moreA neuro-symbolic framework for building applications with LLMs at the core.
An open-source Python RAG framework for SQL generation and related functionality. [#opensource](https://github.com/vanna-ai/vanna)
...moreA full-stack LLMOps platform for LLM monitoring, caching, and management.