Tag: LLM evaluation

0

ReviewBench: An open benchmark for AI code review

Posted by

AI code reviewers are everywhere now. Open a pull request, and a bot jumps in with comments: a possible bug here, a missing test there, a nitpick about naming. But here’s the awkward question nobody could answer well: which of these AI reviewers is actually good? And if you’re building your own code review tool, […]

Read More →
0

The Wiggle Framework for LLM as a Judge

Posted by

The Wiggle Framework is an evaluation method introduced in Meta’s research paper, “Jagged Judges: Epistemic Stability Under Perturbation.” It is designed to test how easily large language model (LLM) judges abandon their original verdicts when challenged. Why this matters Traditional LLM evaluation often measures a judge’s accuracy once against a fixed gold-standard dataset. That tells us how […]

Read More →