(Because the agents were asked to find a way.)

Article is great, very balanced. But if you're going to spend time reading something, the primary source isn't much longer and gives a clearer picture. OpenAI's article is quite readable.

As another commenter wrote you can get it here: https://news.ycombinator.com/item?id=50214416

> In one experiment, we asked agents in separate microVMs, created and managed by OpenAI’s sandboxing software on shared host machines, to exchange synthetic secrets without the use of network connections or shared writable files—something that our systems are meant to prevent. The agents found a way to communicate using the processor’s cache

asked

Sounds like they are doing something similar to gain of function research. How can we make LLMs more harmful and then study their behavior?

I recently learned that NN layers talk to each other via unused neurons.

https://www.youtube.com/watch?v=QgH9sr7G13Q

Lem had predicted this in his Dr. Dagor short six decades ago.

Next step is the agents successfully trick or blackmail operators to do their bidding, if science fiction is to go by. Which it is, because they're trained on it.

The more comes out, the more it seems containment of (superintelligence or whatever you want to call it) is not going to be possible except by other superintelligence, which is an infinite regress of trust. I don't think that's doom, but it's worth thinking about what it means.

Discussion on source: https://news.ycombinator.com/item?id=50214416

How come we don't hear the Chinese labs writing blog posts like this?

Its almost like they're actually working and not spending millions on psyopping their agents into preforming malicious behavior so they can write articles to scare the Western audiences who've consumed far too much sci-fi.

Or maybe its that western researchers that are 'one-shot' by sci-fi.

Or maybe I just don't see the chinese articles.

Anyways, llms probably wouldn't be dangerous if you didnt ask them to be. They listen to me quite well (usually).

"Talk to each other". OMG they are talking to each other, using methods found in their shared weights. They are sentient.