The researchers who published Attention Is All You Need didn’t have the benefit of the LLMs they birthed. Take a look at the prompt that solved the Cycle Double Cover conjecture, and which has been adapted to achieve breakthroughs in cybersecurity. The field is entering a feedback loop that is leading to exponential innovation. We’re at the beginning of the curve. And right now the big iron data center approach is brute forcing the problem.
Because I wasn't familiar with it and others might be curious too: that prompt is available at https://cdn.openai.com/pdf/04d1d1e4-bc75-476a-97cf-49055cd98... and is just below 5 KiB of text.
Do we know how much token dollars it took to solve?
I dont think its exponential innovation. Rapid incremental innovation is happening very fast with some occasional bigger bumps.
Where can I find more information on the cybersecurity breakthroughs adapted prompt?
Intelligence per unit of compute will almost certainly keep increasing. That doesn't mean having more compute isn't still way, way better.