> This means llms have not improved in their programming abilities for over a year. Isn’t that wild? Why is nobody talking about this?
Because it's not true. They have improved tremendously in the last year, but it looks like they've hit a wall in the last 3 months. Still seeing some improvements but mostly in skills and token use optimization.
> but mostly in skills and token use optimization.
I have heard rumors that token use optimization has been a recent focus to try to tidy up the financials of these companies before they IPO. take that with a grain of salt though
After only 3 months (!) you can claim a plateau, but not a wall.