just want to remind HN that it was as little as a year when I mentioned I used LLMs to do all my coding, totally hands off and people here found it a curiosity. One year later and its madness to even contemplate coding manually.
Im not complaining Im just pointing out how quickly the overton window is shifting.
Hey will you share your workflow and how you get LLMs to build correct things for you (or inspite of you)?
If you’re using the latest models( Opus/Fable/Astra/ maybe Sol) and the default harness, along with a little guidance against the worst tendencies like over-writing tests, you really shouldn’t be getting the wrong things built. Like a coworker, you can’t throw it blind into a monster codebase without some guidance, but otherwise the latest models genuinely just work TM.
Testing, testing, and more testing. In the project I'm working on right now, about 2/3 of the code is in one way or another related to testing. As a human coder, I'd never spend that much time on building test harnesses, automating regressions, writing unit tests, etc, but it's cheap when you can have a robot do it.
So you assume code written by the agent canno be trusted? But how comes you are trusting the tests?
It's not the overton window, it's the capabilities of the models that have changed significantly in 1 year.
I am sure it’s all so good that these incidents should not take more than 5 minutes to resolve. Don’t get me wrong, I am one of the people who would look at you suspiciously a year ago and only in the last year “saw the light”. You were ahead. But that doesn’t mean that at some point you will not overshoot. What we witness today we haven’t witnessed in some time. People also made horrible software but they enriched it with hole plugging hacks that made it run, mostly. AI may build better software but who is plugging the holes. At least today no one. In 1 or 5 years maybe AI. In the meantime, we need to plug some holes and they are not as easy to spot when we are not the ones who left them there.
How are you handling all the errors that are hidden in code you can not understand?
You give it time....the same way Technical debt is code you chose not to clean up....your Vibe Debt for code you never understood in the first place... will come through.
I dont think so man, it havent really had any issues that Ive noticed
"Overton window"? It's just developers being obtuse, short-sighted and slow.
It was obvious in 2023 and it is obvious now yet we still have people in denial even today. These people need AI to take over the world and threatening them with eternal suffering before they will change their minds even a bit.
May I ask why you care so much? Some people like hand-coding, they are free to do whatever they want, stop being so weirdly angry and controlling about what people do/how they do it.