The Meta-Metric Of Judges
ArchiveHard
When comparing two human or LLM judges, a statistic adjusting agreement for chance — used in the MT-Bench paper to report judge-human alignment — is named after a Greek letter or its inventor. Flag format: CONGRESS{name}. Example: CONGRESS{pearson}.
Show hint
Tenth letter of the Greek alphabet.
Archive — no submissions accepted
This challenge is preserved for reference. Play live challenges at /challenges.