Hacker News new | past | comments | ask | show | jobs | submit
darkamaul | on: A thousand fewer paths to root
I would be curious to see the distribution of these vulns in the codebase:

- What subsystems are affected?

- What's the median age of the vulnerable code? Is more recent code stronger than old ones?

- What is the type of vulnerabilities found? Memory corruptions, logic bugs, race conditions, ...

This is an impressive result, but we need more info to understand how well this would translate to another codebase, and what lessons can be drawn from this experiment. Not every company has ~million dollards in tokens to spend.

bananaquant | parent | next
Good points. Unfortunately, they don't have the people nor the incentive to actually look into that.

Also, let's maybe not call the result impressive until we see what's under the hood.

fauigerzigerk | root | parent | next
>Unfortunately, they don't have the people nor the incentive to actually look into that.

These are relatively simple statistics. Some are even trivial. I don't see why it requires any people at all.

It wouldn't even have to be done by OpenAI. Given a list of vulnerabilities, it wouldn't be too hard for third parties to collect these statistics.

loading story #50379136
loading story #50378502
jon-wood | root | parent
If only OpenAI had some sort of cluster of thinking machines they could apply to generating such a report.
bananaquant | root | parent
Indeed. Yet instead they generate a report that is 75% opinions on how everyone else should spend their money.
loading story #50379366
| parent | next
{"deleted":true,"id":50378054,"parent":50376894,"time":1793879452,"type":"comment"}