Challenges in evaluating AI systems | Anthropic

The LLM Evaluation Framework

LLM Comparator: An interactive visualization tool for side-by-side LLM evaluation

Awesome Gen AI Tools: LLM Benchmarks: MMLU, HellaSwag, BBH, and Beyond - Confident AI

Awesome Gen AI Tools: Cleanlab Trustworthy Language Model: Score the trustworthiness of any LLM response