For a human you need to train everyone every year and if you have more and more material to teach, harder it will be for the humans.
Not so for AI.
Then we will also see more simulations, an AI will be able to play through scenarios and we will have models being able to invent new scenarios.
While this is happening, hardware will be faster, more and more improvements on every front. Humans have not progressed really
More generally, if you assume that magic can replaces the laws of statistical learning, then yes, AI can do everything and we're all doomed.
I reject this premise on the basis of knowing how RL and LLM training works.
How many people learn one particular job? If its a job which educates 10.000 people per year, when is the financial motivation big enough to create enough training data to make them obsolete and transfer the learning into an AI model?
Also we don't know yet were the journey goes, 'dreaming' models finetuning over night might help.
Or its already just enough to have the biggest RL Loop in history of humanity: everyone of us using the chatbots and giving them signals like thumbs up and thumbs down and stuff like "DUDE WTF I TOLD YOU..." you know :)
Then we also know that the frontierlabs are paying experts and people with PhDs to generate challanges and answers.
Educating just a 1000 people every year over and over is very very expensive even if LLMs need more training data. In worst case frontierlabs will just keep investing in generating traingindata manually with their earnings and it takes. longer.
Or we find a breakthrough like how LeCun is complaining all the time that LLMs are not learning properly. We are still early and progress is still happening fast.
So, based on bitter, bitter experience around user feedback, this is generally not useful for training.
More generally, in order to make RL (or any other method) work, then we need tons of labelled data, which is very very expensive to collect.
Like, take a product manager, where can you get labelled data enough to train a model to talk to customers, get some insights, and figure out whether or not this makes sense and then determine how to build & market it.
None of this data exists basically anywhere, and it seems really hard to collect.
But even if you do, how does one train a model in an RL environment to talk to customers. Presumably they talk to agents, right? Does this generalise to actual people? (Maybe, maybe not).
And then consider the whole figure out what to do from the customer meetings, this is basically meta-cognition combined with awareness of human body language and emotions. How do we train for that? I'm not even convinced this is possible (but I've been wrong before).
I think the weakest form of my argument is that current LLM/RL pipelines make this borderline impossible to do. It's possible that new methods work incredibly well, but you'll still be blocked on the data (this is why I'm extremely sceptical of white collar work getting automated).
If you see a way around this, please help me understand what I'm missing.
Or maybe cut back on the acid.
Would you like to have a proper discussion and use the format of arguments so we can align our views and get out of this discussion with benefits to both of us?