cross-posted from: https://lemmy.ml/post/35349105

Aug. 26, 2025, 7:40 AM EDT
By Angela Yang, Laura Jarrett and Fallon Gallagher

[this is a truly scary incident, which shows the incredible dangers of AI without guardrails.]

  • Scrubbles@poptalk.scrubbles.tech
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    3
    ·
    14 hours ago

    Proves over and over society was not ready for AI chatbots like this. I use it daily, but as someone who fully knows the limitations of what it is and what it can do. I’m mentally sound and can handle whatever garbage it can vomit up, but it helps with my coding. The fact that it was unleashed to everyone going full pandora’s box was an insane pure profit driven motive.

    Those of us who understand it can completely see it going off the rails. It’s just a prediction machine. If you give it horrible stuff like that it’s going to predict that it should come up with horrible stuff in response. It’s almost impossible to stop it from doing that because the only real way to prevent it is to not train on that stuff before, but when you’re dealing with the entire fucking internet that’s pretty hard too. (Seriously people, Reddit and 4chan were included in training. How stupid were they with this?)

    This was inevitable. Of course people are too trusting in AI and those mentally unwell will not be able to distinguish it. It was designed to be like that. They were wrong to release it openly to society.

    • eldavi@lemmy.ml
      link
      fedilink
      English
      arrow-up
      9
      ·
      14 hours ago

      i had a 8 hour long troubleshooting session yesterday that should have only have taken on hour at most because my new boss was asking copilot for troubleshooting ideas and insisted that i pursue each one instead of listening to me.

      then, this morning, he “corrected” the root cause analysis report i created because copilat said that something like this will never happen again. (it will happen again).

      i never felt like the smartest person in the room before but; when everyone else is asking AI; being the smartest person becomes a very low bar.