Archive
Evaluation & Benchmarks

BLEU Limitation

Archive
Easy
100pts34 solves
'The cat sat on the mat' vs 'A feline rested on the rug' scores poorly on BLEU despite identical meaning. What is BLEU's fundamental flaw?
Show hint
BLEU counts matching n-grams. Paraphrases get no credit.

Archive — no submissions accepted

This challenge is preserved for reference. Play live challenges at /challenges.