• Philosoraptor [he/him, comrade/them]@hexbear.netOP
    link
    fedilink
    English
    arrow-up
    46
    ·
    8 months ago

    Yudkowsky eventually banned it for a semi-decent reason–namely, that all the nerds on LessWrong were so deranged that he was concerned about it doing actual psychological harm to them as a result of their obsession. He claims now that he never really thought it was a serious threat, but his original reaction to Roko’s post is both pretty funny and indicates otherwise:

    Listen to me very closely, you idiot. YOU DO NOT THINK IN SUFFICIENT DETAIL ABOUT SUPERINTELLIGENCES CONSIDERING WHETHER OR NOT TO BLACKMAIL YOU. THAT IS THE ONLY POSSIBLE THING WHICH GIVES THEM A MOTIVE TO FOLLOW THROUGH ON THE BLACKMAIL. You have to be really clever to come up with a genuinely dangerous thought. I am disheartened that people can be clever enough to do that and not clever enough to do the obvious thing and KEEP THEIR IDIOT MOUTHS SHUT about it, because it is much more important to sound intelligent when talking to your friends. This post was STUPID.

      • Awoo [she/her]@hexbear.net
        link
        fedilink
        English
        arrow-up
        17
        ·
        edit-2
        8 months ago

        It’s a dumbass idea because wasting resources eternally torturing millions of people is stupid and an AI won’t be a superintelligence capable of taking power over humans if it’s that fucking stupid.

        Pascal’s Wager only works because god is an omnipotent superpower with unlimited resources that’s simply not the case for AI.

        • buckykat [none/use name]@hexbear.net
          link
          fedilink
          English
          arrow-up
          13
          ·
          8 months ago

          Even if we leave aside the likelihood of a future AI doing the plot of I Have No Mouth And I Must Scream, roko’s basilisk is like a pascal’s wager with a god that goes “understandable have a nice day” if you’re an actual atheist and only punishes you if you’re an insufficiently evangelical christian.

        • NewAcctWhoDis [any]@hexbear.net
          link
          fedilink
          English
          arrow-up
          8
          ·
          8 months ago

          No it simulates you and the simulations are sentient and you should care about them. Either that or you don’t know whether you’re a simulation so you should act like you are, I don’t exactly remember.

    • jayWL@lemmy.ml
      link
      fedilink
      English
      arrow-up
      23
      ·
      8 months ago

      Didn’t elon fucking musk also mention he believed in that shit? Absolute madman magnet