I see this on my team. I honestly thought as engineers we'd all understand the limitations and nuance a bit better. Right now it's kind of a shit show. In addition to seeing my teammates open huge AI generated PRs and just asking for review without them having done much verification, I'm also seeing my teammates (smart ones whom I respect) use AI to "do code reviews". And we already have automated AI code reviews added to our PRs. So now I'm sometimes getting hallucinated BS responses from "human" reviews.
This makes me absolutely SURE that the general public is fucked and that we're going to start seeing huge AI generated fuckups on a regular basis. If people in this industry, basically experts compared to the general public, are misusing this tech in such seemingly obvious ways, imagine the ways non technical people will misunderstand and misapply it. Of course, with the help of overhyped BS from everyone hyping and selling it.
I think this is a kind of nerd chauvanism. What I see is that the general public are deeply skeptical of "AI" in all its forms. Software "engineers" are especially vulnerable to believing that LLMs are smart generally, because LLMs are good at writing code, and skill at writing software is how the software engineer measures the superiority of their own intelligence. But a poet is in no danger of over-anthromorphising an LLM.
Yep, it's bad. It's too easy to press the publish button without double-checking the outputs. Programming has always been about discipline, and now it's even more so.