No one is saying “build x” and getting good results unless they didn’t have any expectations to begin with. What you describe is precisely right. Using the agents require a short leash and clear requirements and good context management (docs, skills, rules).

Some people (like me) still think that’s a fantastic tool, some people either don’t know how to do this or think the fact you have to do this means the tools are bunk. Shrug.