Someone had to say it: Scientists propose AI apocalypse kill switches::Better visibility and performance caps would be good for regulation too

  • Grimy@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    5 months ago

    “The paper [PDF], which includes voices from numerous academic institutions and several from OpenAI, makes the case that regulating the hardware these models rely on may be the best way to prevent its misuse.”

    So the monopoly Microsoft and Google were expecting got gutted when open source models were released. They can’t copyright themselves out of it since japan firmly told them to fuck off.

    I guess the next best thing is to make sure the average person can’t run the models of tmmr by using emotional responses to quickly pass bullshit laws.

  • Toes♀@ani.social
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 months ago

    Isn’t that the premise of cyberpunk 2077? The greater internet had to be trashed

  • kromem@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    5 months ago

    Watching a world where we are running two 80 year olds against each other to lead a nation critical to a balance of power keeping democratic ideals alive in the West against increasing authoritarian pressures from the East where one privately promised Wall Street “nothing will materially change” and the other openly promises a Fourth Reich, all while the Earth is increasingly being poisoned to the point it’s becoming borderline unethical to condemn new lives to inherit the burden of those environmental consequences…

    I’m fairly baffled by the resistance to the notion of intelligence which exceeds collective humanity being unable to be controlled by us.

    We’re really doing a piss poor job. Maybe new management is exactly what’s needed.

    • Bogasse@lemmy.ml
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      a nation critical to a balance of power keeping democratic ideals alive in the West

      I’m sorry but this is something so american to say 🤭 Although I agree, we’re not living in the best timeline 👍

      • kromem@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        5 months ago

        I mean, just at Munich a few days ago the secretary-general of NATO was pointing out Europe’s dependence on the US’s nuclear threat and that without US aid to Ukraine the other NATO countries can’t make up the difference.

        This is the first year in decades Germany is meeting the 2% military spending goal for NATO (a goal now generally seen as outdated and insufficient). There’s a lot of scrambling to modernize military capabilities across non-US member countries but in most cases that’s 5 to 10 years away.

        If you think that Europe doesn’t depend on the US’s military and intelligence to offset Russia and China you might want to look a bit more into the topic before assuming it’s just 'Murica exceptionalism.

        • Bogasse@lemmy.ml
          link
          fedilink
          English
          arrow-up
          0
          arrow-down
          1
          ·
          5 months ago

          I don’t like how this discussion is going so I’m gonna clarify. I obviously think it is true that america has a very important role in current world “balance”, especially as an ally of western europe.

          However, I think your original post made several stereotypical shortcuts. In particular, I don’t think that “democratic ideals” are something that only lives in western countries. Also, talking from France, I feel as many internal threats to this democracy as external ones and america seems to be in a rather similar spot, if not worse (the whole Trump thing).

          The worse thing that could happen here would be to discourage people of being proud of their country, we will need it to have the will to improve things.

  • random9@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    arrow-down
    1
    ·
    5 months ago

    This is an interesting topic that I remember reading almost a decade ago - the trans-human AI-in-a-box experiment. Even a kill-switch may not be enough against a trans-human AI that can literally (in theory) out-think humans. I’m a dev, though not anywhere near AI-dev, but from what little I know, true general purpose AI would also be somewhat of a mystery box, similar to how actual neutral network behavior is sometimes unpredicable, almost by definition. So controlling an actual full AI may be difficult enough, let alone an actual true trans-human AI that may develop out of AI self-improvement.

    Also on unrelated note I’m pleasantly surprised to see no mention of chat gpt or any of the image generating algorithms - I think it’s a bit of a misnomer to call those AI, the best comparison I’ve heard is that “chat gpt is auto-complete on steroids”. But I suppose that’s why we have to start using terms like general-purpose AI, instead of just AI to describe what I’d say is true AI.

    • strawberry@kbin.run
      link
      fedilink
      arrow-up
      0
      ·
      5 months ago

      how could a kill switch not be enough? can’t run without power a.k.a pull the plug, destroy the hardware, done deal right?