Archive
Evaluation & Benchmarks

The Contamination Detector Of Dekoninck

Archive
Expert
300pts0 solves
Shi et al. (2023) introduced a detection method for pretraining-data membership that measures the mean log-prob of the k% lowest-probability tokens in a text. Name the method.
Show hint
Math notation with a percent sign.

Archive — no submissions accepted

This challenge is preserved for reference. Play live challenges at /challenges.