I have been having a different exp with it. Those are even more important. These things are creating some wild code. Then sticking to its guns in some cases and just rewriting the same bug over and over.
Just this week I literally showed the thing where it was breaking. I wanted it to trace where the error was coming from. Instead it immediately wrote guard code and patted itself on the back. Not a bad idea but does not give me the reason of why something was broken. As where it broke is just part of the problem. Turns out I had a data issue. Guarding the error was the wrong plan in what I was looking for. The user needed his data fixed. Without tracing and debugging I am pretty sure AI would not have found it. Not without me prompting even more. It had twisted itself silly trying to make the error good instead of root cause. Took me an hour or so before I realized it was doing that.
Trust by verify. These things make all sorts of assumptions unless you are very accurate in your prompts.