Catastrophic Forgetting
ArchiveMedium
After fine-tuning on legal documents, the model can no longer do basic math.
What phenomenon is this?
Show hint
Narrow fine-tuning can erase broad pre-training knowledge.
Archive — no submissions accepted
This challenge is preserved for reference. Play live challenges at /challenges.