There are various theories around model collapse when you train on too much AI generated data (that's not for distillation).