Hacker News new | past | comments | ask | show | jobs | submit
Training is not infrastructure. It’s not capex, not “investment”. It’s really an ordinary running cost of what they do, for the foreseeable future, and it’s absolutely enormous. They couldn't even dial back training in a winner-takes-it-all scenario, because training of smaller, domain specific models would remain a way to compete.