Statement on Superintelligence
superintelligence-statement.org
“We call for a prohibition on the development of superintelligence, not lifted before there is (1) broad scientific consensus that it will be done safely and controllably, and (2) strong public buy-in.”

Peep the signatories lol.

Edit: based on some of the messages left, I think many, if not most, of these signatories are just generally opposed to AI usage (good) rather than the basilisk of it all. But yeah, there’s some good names in this.

  • swlabr@awful.systemsOPEnglish
    3·
    2 days ago

    but I also still think superintelligence shouldn’t be built, because if we’re letting Sam Altman and Elon Musk dictate the “values” encoded into it I do not want to live in that world

    Well, sure. FWIW most of us here are on one of two trains:

    1. “superintelligence” will never be built
    2. There is no clear path from where we are technologically that leads to “superintelligence,” so there isn’t much point to worrying about it.

    Of course, there is something to be said about not wanting anyone throwing money at Musk or Altman because they’ve conned people into thinking we’re on the cusp. But yeah, I would say most people here do not share this concern, just as no one should be concerned about a dragon razing their town.

    • lurker@awful.systemsEnglish
      2·
      3 hours ago

      FWIW im probably in/around camp two nowadays. I also do not think we should not give Altman and Musk money both because they’re conmen and weird alt-right techbros (I still remember Musk’s Nazi salute)