- A Device-Inference framework, including LLM Inference on device(Mobile Phone/PC/IOT)
Cross-referenced across 55 tracked directories
#2867
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
4/15/2019
Created
16,297
GitHub Stars
2,490
Forks
194
Contributors
76
Open Issues
10/27/2026
Last Commit
Recently added to the ecosystem
Score: 100/100
0 dependency vulnerabilities found
GitHub Actions
Open-source LLM observability, prompt evaulation, and prompt optimzation platform.
Mahmoud Mabrouk
Easily build, version, evaluate and deploy your LLM-powered apps.
GitHub Actions
Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.
...moreComprehensive set of tools for working with local LLMs for various tasks.