judgekeeper
Organization@judgekeeper
Check your LLM-as-a-judge in 5 steps. Find. Mark. Measure. Fix. Re-check.
www.judgekeeper.com On GitHub since October 2026
3
Published Tools
2
Total Stars
35
Weekly Downloads
0
GitHub Followers
2
Public Repos
100/100
Avg Security
Published Tools
1 MCP Server2 Skillsacross 2 categoriesSathvik Thota
A
pytest plugin that fails a test when an LLM judge stops agreeing with human labels (installs judgekeeper).
Skillai-ml
11 dir
Sathvik Thota
A
Validate, monitor and migrate your LLM-as-judge against a frozen human reference set.
Skillai-ml
11 dir
Sathvik Thota
A
Holds the name for judgekeeper MCP. It has no features; the first release will be 0.1.0.
MCP Serveruncategorised
1 dir