cross-posted from: https://lemmy.cafe/post/29389301

A few days ago X introduced a new AI Image Editing button that lets any user modify images posted by others, even without the original uploader’s consent. Image owners are not notified when edits are made, and the feature is enabled by default with no opt-out option (at least not so far).

    • zbyte64@awful.systems
      link
      fedilink
      arrow-up
      1
      ·
      19 hours ago

      And he encouraged others to do so. It is almost like this is a bigger issue for women or girls for some reason. I’m probably sexist for noticing.

  • ryannathans@aussie.zone
    link
    fedilink
    arrow-up
    25
    arrow-down
    3
    ·
    edit-2
    3 days ago

    No different to saving the image, making the changes, reuploading

    Maybe even better if the credits to the original are preserved

    • Wildmimic@anarchist.nexus
      link
      fedilink
      English
      arrow-up
      22
      arrow-down
      1
      ·
      3 days ago

      Yeah, but people are using Grok to put everyone in bikinis (or replace clothes with a string of dental floss) with “donut glazing” over their bodies. Sometimes Grok undresses people without even being prompted to - some people ask for a change of facial expression on a selfie and get a nude. I’m pretty sure this will land Xhitter in hot water with the EU once again, and maybe they finally just block this hellhole (one can dream)

      • Korhaka@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        13
        ·
        3 days ago

        For those unaware, this includes images of children. It’s about time we decide who is held responsible for this

      • ryannathans@aussie.zone
        link
        fedilink
        arrow-up
        5
        arrow-down
        2
        ·
        3 days ago

        I tried exactly this (including dental floss) and it refused to generate nudity, at most I could get a barbie doll looking figure. Seems fine to me

    • Segab 👻@beehaw.org
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      2
      ·
      2 days ago

      It’s different in that it’s now just one click away. The harder it is to do the less it would be abused.

  • Daedalus@chatgptjailbreak.tech
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    2 days ago

    With decent prompting skills, someone who knows what they’re doing has an easy time fabricating realistic looking photographs that are nearly indistinguishable from real life. We’re entering a post-truth era.

  • locuester@lemmy.zip
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    8
    ·
    edit-2
    1 day ago

    Omg what horror. Have you discovered that you can click and drag any image from anywhere into photo editing software or ChatGPT or the likes? Whatever shall we do?! We have to make images uneditable somehow. This is a complete tragedy.

    For real, why should I care?

    • TehPers@beehaw.org
      link
      fedilink
      English
      arrow-up
      20
      ·
      3 days ago

      Grok, put this “small adult” into a bikini and have her bend over.

      Creating nudes without consent, especially CSAM (even with consent), can be extremely illegal. Doing it in photo editor software makes you responsible and only leaves it on your device. ChatGPT will attempt to filter it, and their filters lean on the aggressive side, but that’s also between you and OpenAI. Grok will post it publicly.

      • locuester@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        1 day ago

        Using grok this way is the same as a photo editor. It’s the human asking grok to do it that is the problem. Not grok or any other tool. Meta products have this exact same feature.

        Grok will not post it publicly unless you click the button to do so. Again, it’s the person that is doing it, not grok.

        • TehPers@beehaw.org
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 day ago

          Ok yes you’re right. “Grok generate me some CSAM” is the same as opening up a photo editor and drawing a new real looking body onto someone’s child and putting it in a new body position. Same exact thing. No different at all. Twitter has no responsibility for running a service that can do this.

          • locuester@lemmy.zip
            link
            fedilink
            English
            arrow-up
            1
            ·
            18 hours ago

            You’ve totally changed the original post’s topic and made it into something obviously unacceptable. There’s a line to cross with content in general, AI or not, and any public ai model should absolutely have safety rails / content moderation on its output

            • TehPers@beehaw.org
              link
              fedilink
              English
              arrow-up
              2
              ·
              edit-2
              16 hours ago

              Surely you have an example where it’s appropriate for a service to generate nonconsensual deepfakes of people then? Because last I checked, that’s what the post’s topic is.

              And yes, children are people. And yes, it’s been used that way.

              Edit: as for guardrails, yes any service should have that. We all know what Grok’s are though, coming from Elon “anti-censorship” Musk. I mentioned ChatGPT also generating images, and they have very strict guardrails. They still make mistakes though, and it’s still unacceptable. Also, any amount of local finetuning of these models can delete their guardrails accidentally, so yeah.

              • locuester@lemmy.zip
                link
                fedilink
                English
                arrow-up
                1
                ·
                11 hours ago

                This post isn’t exclusively about deepfakes. It’s about editing someone else’s images. Making suggestive deepfakes is mentioned in the article as an example, but it’s not mentioned in the title or summary here.

                That said, my points stand. Don’t post shit online if you don’t want it to be edited.

                With the ease of photo manipulation, society has no choice but to adapt to nonsensical, simple edits. It can’t be stopped. There’s hundreds of apps and programs that do this now. Even adobe’s famous suite.

                I know you hate Elon, I can hear it in your tone. But this isn’t an Elon thing. Look around.