Some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies.

Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.

While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.

  • ඞmir@lemmy.mlEnglish
    2118·
    2 months ago

    On the other end, I welcome the widespread creation of these of EVERYONE, so that it becomes impossible for them to be believable. No one should be refused from a job/promotion because of the existence of a real one IMO and this will give plausible deniability.

    • exanime@lemmy.todayEnglish
      338·
      2 months ago

      People are refused for jobs/promotions on the most arbitrary basis, often against existing laws but they are impossible to enforce.

      Even if it is normalized, there is always the escalation factor… sure, nobody won’t hire Anita because of her nudes out there, everyone has them and they are probably fake right?.. but Perdita? hmmm I don’t want my law firm associated in any way with her pics of tentacle porn, that’s just too much!

      Making sure we are all in the gutter is not really a good way to deal with this issue… specially since it will, once again, impact women 100x more than it will affect men

      • TwilightVulpine@lemmy.worldEnglish
        92·
        2 months ago

        This is a consideration that a lot of people are glossing over. Schlubby dudes might not even be affected to it at all. It’s not going to be widespread for everyone.

      • ipkpjersi@lemmy.mlEnglish
        21·
        2 months ago

        How should we deal with this issue then? I’m not sure what can be done about it.

        • exanime@lemmy.todayEnglish
          51·
          2 months ago

          That’s a good question… I’m not an expert in this area but I do think it should be criminalized to a certain extent (even if it’s hard to enforce)

          Probably legislation should out some onus on the makers of these tools as well

    • BreakDecks@lemmy.mlEnglish
      11·
      2 months ago

      Yeah, let’s just sexually violate everyone. /s

      Who the hell is upvoting this awful take? Please understand that it would never be equitable. If this became reality, it would be women and girls that were exploited the most viciously.

      I guess if you don’t give a shit about people, especially women and girls, feeling safe in public at all, you would say something like this…

      • ඞmir@lemmy.mlEnglish
        11·
        2 months ago

        It’s already possible. Do you want to make it punishable by jail time? How do you prove some anon on 4chan that posts nudes of someone else actually deepfaked it?

        I don’t see how this can otherwise be contained.

        • BreakDecks@lemmy.mlEnglish
          11·
          2 months ago

          Do you want to make it punishable by jail time?

          Yes, sex crimes deserve harsh punishments.

          How do you prove some anon on 4chan that posts nudes of someone else actually deepfaked it?

          It’s either deepfaked, or revenge porn. Whichever charge sticks. If 4chan refuses to unmask anons posting illegal content, throw the book at 4chan. Way overdue anyway.

          I don’t see how this can otherwise be contained.

          See previous two answers.

          • ඞmir@lemmy.mlEnglish
            11·
            2 months ago

            Okay if you want to make everything punishable by law then we simply fundamentally disagree.

          • ඞmir@lemmy.mlEnglish
            11·
            2 months ago

            Okay if you want to make everything punishable by law then we simply fundamentally disagree.