I see a ton of criticism and not a single person coming up with anything better, unless it's to take away options, like removing effort level.
What about buying Intel CPUs? A car? Electrical components?
If you're not just using this at a consumer level to ask about cooking recipes (and if that's your use case, you really don't care about API pricing, or any of this, and can just use the default), and are using it professionally, then this seems like a low bar of effort to understand what you're buying.
I do grant you the relationship between model and effort level has an unclear relationship, but there are also tradeoffs in most complex technical products that are not always clear; this is exacerbated by the fact that this product is stochastic.
Why are engineers using this as a professional tool expecting this to be bought like a consumer gadget and then blaming the maker?
This morning I asked GPT which models and settings I should use to inspect my VM dashboard with computer control. It said: - GPT-6 Astra at Medium - GPT-6.1 Sol at Medium (alt) - use Luna only when the route was already known.
But I had already completed the task twice with Luna and it was 5.6! It navigated through a few pages of my dashboard, pulled up the 30-day usage chart, analyzed my CPU and RAM, and explained why I didn’t need an upgrade. I’d give Luna 5.6 an A on this task.
Maybe OpenAI should give us a “Tiptronic” selector: recommend the model and reasoning level based on the prompt, while still letting users override it.
What are you talking about? If it's for some slop you vibe check it. If it's for a serious effort you write an eval. Same as it has been for the last 3 years.
Why is it ok for engineers to have confusing names and ways to interact with something?
How am I supposed to decide between these options: https://imgur.com/a/bXHWowL
How am I supposed to keep up with the changes every few months?
No worries, you can always ask a AI.
Are you presenting this as evidence that OpenAI's naming scheme is bad?
If you don't want to spend the time to know the difference between all these different suppliers and their models, then why are you using whatever this program is that gives you so many choices, most of which are bad? Why is this OpenAI's fault?
They should have a guide saying "Terra is best at technical documentation and communication, Astra is best at large software projects and research, Sol is good for development" or something like that.