The Replacement Of MMLU In 2024
ArchiveHard
Wang et al. (2024) released a harder, refined version of MMLU with 10 answer choices, deduplicated questions, and a stronger reasoning focus. Which name?
Show hint
The parent benchmark + a tier word.
Archive — no submissions accepted
This challenge is preserved for reference. Play live challenges at /challenges.