Hacker News new | past | comments | ask | show | jobs | submit
Lots of talk of us being at the cusp of AGI, but how will we even know when we get there? When AGI develops a religion for itself?
We'll know that we've reached AGI when a key conservative political belief in the US is that AIs are not people and do not deserve rights.

We'll know that we've reached the singularity when there's a mysterious and superintelligent AI entity with technology and motivations that we as humanity do not understand and have no control over. Not sure why we want that, exactly, but that'll be the big sign.

Humans are really terrible at most things, being moral being exhibit A.

I want a singularity yesterday, and I would even go as far as to claim that all people have an ethical obligation to build super intelligent AI systems as fast as possible to reduce the maximum amount of suffering through the universe possible in living things.

The moment that we can get viable non-human leadership I will embrace it with open arms. The yoke of human existence is extraordinarily oppressive. Give me Ghost in the Shell style cyberborgs. We are the demiurge.

Of course, the real red pill is to realize that there's many singularities. Can't believe I'm going to link Orions Arm on HN but its relevant here: https://www.orionsarm.com/page/298

I can't agree until I have some reason to believe that the non-human leadership will be moral in a way that I can accept. Giving up control forever to some unfathomable, alien intelligence is basically the last meaningful choice our species will ever make, so don't be in a hurry to commit.
That's the fun part. We don't. Could have happened 10 years ago without us noticing. I don't expect my skin cells to be able to recognize "me" anymore than I expect we will be able to recognize a superintelligent AGI. If it arrived 10 years ago, then the last 10 years could simply be its PR campaign. We wouldn't even be able to tell if it was successfully achieving its "goals" or not, assuming an AGI even has "goals"
Science fiction.