Hacker News new | past | comments | ask | show | jobs | submit
A lot of this university research on AI feels dated. This is something we all faced months ago. Many times they're also reaching conclusions using obsolete models, etc. Feels like things move too fast for traditional research cycles to catch up to AI dev
I think you are way overestimating the speed of diffusion into non-SV companies.

I was sitting with someone the other day who worked at a major ecommerce/media company (outside the US). They had access to Opus 4.5 via Co-pilot.

loading story #50541215
loading story #50541016
Its not resolved though, by any measure, except by removing human code review and coherence at the code level. Which is a pretty big tradeoff that has some at this point well-known downsides.
loading story #50542831
That’s what academia tech studies are like. I’m working full time as a SWE while in grad school (not CS but closely related) and sat in a seminar with a world-renowned researcher as they went over their yet to be published study which included testing things against the new agentic models. That was a couple of months ago, the study used the “latest” models like ChatGPT 4.1. And they seemed quite amazed by its capabilities. Kind of funny to watch when you’re running Astra 6 for your daily driver.
It's important to have proper research by groups of professionals dedicated to carefully scrutinizing if an effect is real, even on things that seem very obvious. Every now and again, they show that some obvious things are actually false.
loading story #50546981
I think the only thing that matters are:

* the code does what you want

* it has no security holes

* it's able to be updated in the future without breaking everything

if the code looks like spaghetti, it doesn't really matter anymore, because humans are editing it. The only one of those three that I'm not entirely comfortable with yet is the security issue, and I don't know how to resolve it without actually having a human audit the code. If we figure out how to ensure security of AI generated code, there will be no point to code review anymore.

loading story #50543238
Agreed, by the time the study is done, they're studying the well established and past.

Of course for industries and corporate it might not be an issue.

What exactly changed in couple of months? You suddenly become faster at reviewing code? Or your company decided to abandon human review in favor of merging whatever an agent reviewed and approved?
Not that I think most academic research is worth the time consumed producing it, but it feels dated because it actually takes time to do research instead of just rapidly changing direction based on feels, which is what developers are currently doing. It's the intellectual rigor of javascript frameworks, but with slop cannons.

In particular, code review is not solved. Pointing another error-prone bot at the output of your first error-prone bot, and then pressing "Enter" if the test suite passes, is not a solution. But you have to do it, because the next guy will beat you to prod if you don’t. And before too long, I'm sure that pressing Enter will be the bottleneck...

Right now what we have is a prisoner’s dilemma, where you can’t be slower than the guy next to you. So we rationalize slop and call it innovation.

If you click through, the original paper was released in January 2026. Months ago indeed.
loading story #50557281
Exactly. What a weird clickbait title to come out of a Tier 1 institution. You have Harvard PhD's concluding this!? This is what a PhD at that insitution is putting out? That is really sad. FTA:

The paper’s interviews show what that looks like on a team: a junior software engineer described a project where only one senior engineer could approve changes and could review the interviewee’s code only once a week.

So the issue is not AI. The issue is organizations and certain personalities who think that a human is going to be a better coder than an engineer. At this point rolling and writing your own code is akin to making up your own encryption scheme.

loading story #50539957
hard to know where to start here. but I think it is sufficient to say you seem to misunderstand the fundamental purpose and process of academic research and may wish to avoid commenting on it until you do.