>_Skillful
Need help with advanced AI agent engineering?Contact FirmAdapt
judgekeeper

judgekeeper

Organization

@judgekeeper

Check your LLM-as-a-judge in 5 steps. Find. Mark. Measure. Fix. Re-check.

www.judgekeeper.com On GitHub since October 2026

3

Published Tools

2

Total Stars

35

Weekly Downloads

0

GitHub Followers

2

Public Repos

100/100

Avg Security

Published Tools

1 MCP Server2 Skillsacross 2 categories

Sathvik Thota

pytest plugin that fails a test when an LLM judge stops agreeing with human labels (installs judgekeeper).

Skillai-ml
11 dir

Sathvik Thota

Validate, monitor and migrate your LLM-as-judge against a frozen human reference set.

Skillai-ml
11 dir

Sathvik Thota

Holds the name for judgekeeper MCP. It has no features; the first release will be 0.1.0.

MCP Serveruncategorised
1 dir