I think we will need a timeframe of at least a year to see if we reached any plateu.

But I do expect a combination of fast progress to continue alone due to the fact that hardware will catch up and will be faster.

And when we reached a real bottleneck, the next thing will be to put the frontier model on a chip and advancing world models and other architectures.

We are still 'just' steamrolling LLMs.