I have about three modes, working with LLMs:
A) Just use them for (2), do (3) and (4) myself.
B) Just use them for (2) and (3), but with very fine grained instructions - to the point where it barely saves me time.
C) Use them for (2), (3) and (4), but with this workflow, it quickly degrades into slop for me.
I still get the best results with (A), but for a quick PoC, (C) is hard to beat.
What's hilarious (or sad) is that I see a lot of people throw them at (1) as well, which seems to have a high chance of inducing AI psychosis and creating software nobody understands, let alone needs.
I find I get the best results when I just use it for (3), and sometimes a bit for (2). Going in with at least an idea of how to make it work has the best chance of ending up with a good changeset. And if you already know how to make it work, don't leave it to chance. Tell the LLM what to do, then let it do it.
Why is it always hours to consult docs? I find most answers within minutes (including if I have to read code) and it’s only take a bit longer when I want to understand the why’s.
The key is to make sure you have the right questions. I see people struggle with that where they only know something wrong but they can’t put it in words.