I guess his big bet on world models didn’t pay off quickly enough
I think it's more than that. I made prediction in earlier 2024 that the main players of AI will stick with transformers while second class players will want to transcend it. The difference is admittedly a bit subtle but ai researchers would get it. I wrote it with mamba in mind back then, but google was still trying to come up with the 'next transformers' and one that can remember using weights and all that stuffs. You can say the same abt lecun's and ilya's now.
My main reasoning was that transformers was the lightning in a bottle and the best work is in extending it instead of transcending it, which requires you to capture another lightning . Which to me appears to miss the assignment. OpenAI, Antrophic, they understand this intimately. Google on the other hand, fell victim to their own ambition.
loading story #49198602