Next step is the agents successfully trick or blackmail operators to do their bidding, if science fiction is to go by. Which it is, because they're trained on it.
The more comes out, the more it seems containment of (superintelligence or whatever you want to call it) is not going to be possible except by other superintelligence, which is an infinite regress of trust. I don't think that's doom, but it's worth thinking about what it means.
Yudkowsky might be extreme, but I believe he was always right claiming that the intelligence (when strong enough) absolutely cannot ever be contained.
loading story #50286041
loading story #50285989