A very NSFW website called Pornpen.ai is churning out an endless stream of graphic, AI-generated porn. We have mixed feelings.

    • inspxtr@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      1 year ago

      I remember reading that this may be already happening to some extent, eg people sharing tips on creating it on the deep web, maybe through prompt engineer, fine tuning or pretraining.

      I don’t know how those models are made, but I do wonder the ones that need retraining/finetuning by using real csam can be classified as breaking the law.

        • JackbyDev@programming.dev
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          If a search engine cannot index it then it is the deep web. So yes, Discord chats are technically part of the deep web.

            • JackbyDev@programming.dev
              link
              fedilink
              English
              arrow-up
              1
              ·
              edit-2
              1 year ago

              Wikipedia on the deep web

              The deep web,[1] invisible web,[2] or hidden web[3] are parts of the World Wide Web whose contents are not indexed by standard web search-engine programs.

              Try accessing a Discord channel through your browser without being logged in. They aren’t indexed by search engines because you have to be logged in.

                • JackbyDev@programming.dev
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  1 year ago

                  I don’t care about some arbitrary challenge to get money from you. I’m trying to get you to think critically. If search engines like Google don’t index it then it’s part of the deep web. Just because things like Discord aren’t what people typically mean when people talk about the deep web doesn’t make Discord chats not part of the deep web.

    • Rustmilian@lemmy.world
      link
      fedilink
      arrow-up
      6
      arrow-down
      1
      ·
      edit-2
      1 year ago

      Hentai maybe. But realistic shit is 100% illegal, even just making such an AI would require breaking the law as you’d have to use real CSAM to train it.

    • mrnotoriousman@kbin.social
      link
      fedilink
      arrow-up
      5
      ·
      1 year ago

      There was an article the other day about underage girls in France having AI nudes spread around based on photos as young as 12. Definitely harm there.

    • drekly@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 year ago

      CivitAI is a pretty perverted site at the best of times. But there’s a disturbing amount of age adjustment plugins to make images of children on the same site they have plugins to make sex acts. It’s clear some people definitely are.

      • oats@110010.win
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 year ago

        Some models also prefer children for some reason and then you have to put mature/adult in positive prompt and child in negative

        • lloram239@feddit.de
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          1 year ago

          I think part of the problem is that there is a lot of anime in the models and when you don’t filter that out with negative prompts it can distort the proportions of realistic images (e.g. everybody gets huge breasts unless you negative prompt it away). In general models are always heavily biased towards what they were trained on, and when you use a prompt or LORA that worked well on one model on another, you can get weird results. There is always a lot of nudging involved with keywords and weights to get the images to were you want it.

      • Jesus_666@feddit.de
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 year ago

        Typically, the laws get amended so that anything that looks like CSAM is now CSAM. Expect porn generators tuned for minor characters to get outlawed very quickly.

    • 👁️👄👁️@lemm.ee
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      1 year ago

      You’d also have to convince them that it’s not real. It’ll probably end up creating laws tbh. Then there are weird things like Japan where lolis are legal, but uncensored genitals aren’t, even drawn.

    • Knusper@feddit.de
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      7
      ·
      1 year ago

      Well, to develop such a service, you need training data, i.e. lots of real child pornography in your possession.

      Legality for your viewers will also differ massively around the world, so your target audience may not be very big.

      And you probably need investors, which likely have less risky projects to invest into.

      Well, and then there’s also the factor of some humans just not wanting to work on disgusting, legal grey area stuff.

      • d13@programming.dev
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 year ago

        Unfortunately, no, you just need training data on children in general and training data with legal porn, and these tools can combine it.

        It’s already being done, which is disgusting but not surprising.

        People have worried about this for a long time. I remember a subplot of a sci-fi series that got into this. (I think it was The Lost Fleet, 15 years ago).