Hacker News new | past | comments | ask | show | jobs | submit
That isn't countering though. Pointing out that distillation makes it "easy" for other labs to catch up, in a matter of months, supports the lack of a moat.

It's like they're runners drafting behind the lead runner. It is easier to run in their wake. If the lead wants to stay in front, they have to keep running into the wind.

Do they need to stay in front though? Because if it is 25% the cost, I'm happy to be one leg behind the leader.
The distillation argument is stupid in any case and only people that don't understand training, post training or RL can make such asinine arguments.