Meta seems like the one American bigtech that
would distill the the other American frontier models. My enemy’s enemy is my friend?
> Some have tried to frame distillation as harmful, but I think it is important to protect the principle that you can learn from anything you can observe.
- Mark Zuckerberg
You think the company buying up all the books, cutting off the bindings, and feeding them through a scanner isn't also distilling other models?
They do distill, their own bigger Muse model.