Hacker News new | past | comments | ask | show | jobs | submit

Europe takes first step to banning AI-generated child sexual abuse images

https://www.reuters.com/business/europe-takes-first-step-banning-ai-generated-child-sexual-abuse-images-2026-03-13/
Is there an actual case for outlawing this that isn't based on moral panic? Wouldn't you actually want people to generate those images with AI so they are less incentivized to pay for the real stuff?

As long as you don't need actual CSAM material in the training data and the generated images are different enough from a real person (both of which seem to be very possible technology-wise), that seems to be a good thing.

Or is there any indication that availability of CSAM material actually increases the likelihood that people act on it later?

We don't have (and I doubt we will ever have) tools for distinguishing between real and ai generated images with a guaranteed 100% accuracy (and 0% false negative and false positive rates).

Given that, I don't see how you can allow ai generated CSAM without effectively making "real" csam images be unprosectable.

So you think that currently, until this law is implemented, CSAM is effectively unprosecutable because people can just claim they generated the image with AI?
I think that there is a >0% probability that a individual case can be unprosecutable (or at least have the image evidence be much less useful) if the person in question actively starts generating CSAM using AI for the purpose of casting doubt on the legitimacy of any individual real image that the prosecutor wants to use as evidence.

The standard is beyond reasonable doubt, and I think that's going to become an increasingly difficult bar to clear if the AI generated versions (either made for their own case or as decoys) are allowed to remain legal.

Well they could ask the child in the photo...
You could have government-signed models + programs that are approved for generating CP (not CSAM). It's legal if the signature checks out. Something like https://contentauthenticity.org/ but for verifying that something is definitely made by AI.

(You need to sign both the models and the programs to make sure there's no img2img.)

The level of tech solutionist brain rot you need to reach to propose state sponsored child porn generator... This forum is a parody of itself
So no real arguments against it, only insults. That's great news, thank you! :)
loading story #47398116
You don’t even need to give them a model, just generate some images and publish them. If you find those images, it’s fine, if you find anything else, arrest them.
That works too, though it'll of course result in a smaller selection and therefore smaller impact on the real market.
We can't agree on weed or safe injection sites, you think we'll have government approved CP generation?
I totally agree, we should aim for all three harm reduction measures.
> Wouldn't you actually want people to generate those images with AI so they are less incentivized to pay for the real stuff?

You got a study showing that's how it works!

> Or is there any indication that availability of CSAM material actually increases the likelihood that people act on it later?

There's a decent amount of research that shows the escalating nature of pornography consumption.

https://fightthenewdrug.org/how-porn-can-become-an-escalatin...

You can follow the references in this article.

Surely it's better to ask why people are looking for any kind of child abuse material, generated or not, and find ways to help them.

As much as it's reasonable to worry about moral panic one might also worry about moral complacency.

loading story #47397524
I completely agree. Most people were marrying 13 and 14 year olds less than 100 years ago. Yes we want to make people only be sexually attractive after they turn 18 but that’s not reality.

That being said I don’t know if the availability of CSAM would increase or decrease real world abuse.

loading story #47396695
loading story #47390440
loading story #47396786
loading story #47391120
loading story #47392475