Hacker News new | past | comments | ask | show | jobs | submit
What category of work did it underperform on for you? I am seeing comparable outcomes in some technical document processing, but the cost is not lower for me.
Gold plating for tasks where the agent is given the intention, the explicit ask to make the best impression, and ways of self evaluating. Much like openai's agents pre 6.2 sol/astra, it considers the task satisfactorily completed a bit earlier than anthropic models which seem to better guess what the specs left out. It is a useless feature for those who keep their llms at a short leash - my hobby benchmark aims to evaluate performance at under-specified tasks and, well, vibe coding as it was described a year ago.

It's a good model for delegating work to, but not deciding the detailed scope. So, not fable class for me.