Yeah. The way I think about it is there's a good outcome where we end up as pets, a bad outcome where we all die, and a very bad outcome where we end up as cattle. There's no outcome where we end up as peers - we can't be equal with something much smarter than us, that's just impossible.
There is also the outcome outlined in stories like Pantheon [0] whereby we upload our minds and utilize unbounded computation while still keeping the essence of our humanity.
> “The right model is the only model we have of a more intelligent thing being controlled by a less intelligent thing, which is a mother being controlled by her baby ... That’s the only good outcome. If it’s not going to parent me, it’s going to replace me ... These super-intelligent caring AI mothers, most of them won’t want to get rid of the maternal instinct because they don’t want us to die.”
If "superintelligence" is such a big deal, how is it that e.g. MENSA members haven't taken over the world yet? Is there evidence of the assumed "superintelligence/dominance" equivalence in existing human population data?
Yeah. The way I think about it is there's a good outcome where we end up as pets, a bad outcome where we all die, and a very bad outcome where we end up as cattle. There's no outcome where we end up as peers - we can't be equal with something much smarter than us, that's just impossible.
There is also the outcome outlined in stories like Pantheon [0] whereby we upload our minds and utilize unbounded computation while still keeping the essence of our humanity.
[0] https://www.imdb.com/title/tt11680642/
The relevant quotes buried in the article:
> “The right model is the only model we have of a more intelligent thing being controlled by a less intelligent thing, which is a mother being controlled by her baby ... That’s the only good outcome. If it’s not going to parent me, it’s going to replace me ... These super-intelligent caring AI mothers, most of them won’t want to get rid of the maternal instinct because they don’t want us to die.”
If "superintelligence" is such a big deal, how is it that e.g. MENSA members haven't taken over the world yet? Is there evidence of the assumed "superintelligence/dominance" equivalence in existing human population data?