Catastrophic Forgetting

After fine-tuning on legal documents, the model can no longer do basic math. What happens to pre-existing capabilities? Flag format: CONGRESS{[what_happens]} Example: CONGRESS{improves_all_tasks}