posted in Technology
Internet Watch Foundation reports huge rise in AI child sexual abuse material
www.theguardian.com/technology/2026/oct/05/internet-watch-foundation-huge-rise-ai-child-sexual-abuse-materialposted in Technology
Internet Watch Foundation reports huge rise in AI child sexual abuse material
www.theguardian.com/technology/2026/oct/05/internet-watch-foundation-huge-rise-ai-child-sexual-abuse-materialReplying to @Orwi@programming.dev
One of the wealthiest men in the world is now in the CSAM business, yet has faced no consequences.
Replying to @Seimhe@lemmy.world
And the president uses Grok everyday.
Replying to @Orwi@programming.dev
The companies that produce these images should be prosecuted for each and every one. They must have safeguards against stuff like this out go out of business.
Replying to @Dryad@lemmy.world
What companies? Only grok had serious problems (which are fixed by now, supposedly). Rest of the companies models cannot generate such stuff, this is all done with custom models by individuals.
Replying to @REDACTED@infosec.pub
this is all done with custom models by individuals.
This is really important for people to understand.
Powerful open weight models are already out there. Anyone can download them and run them. There is no possibility for government control of AI content without North Korean style internet controls.
Politicians and corporations will absolutely start trying to push for more controls. They will tell you to “think of the children” and they will use this to take power for themselves, knowing full-well that they can’t actually meaningfully prevent this from happening. We need people to understand that the push for control here has nothing to do with morality or protecting anyone.
Replying to @Dryad@lemmy.world
This is the pretext for taking away individual’s rights to general computing – because once all the providers have guard rails and are locked out, individual users with local hardware are the last source for ‘illegal content’. “We have to scan everything you do on your local computer, or you could be doing something we don’t approve of”. lemmy.world/post/52743759 <-- see this story up on the front page just now. She (foolishly) thought her prompts in OpenAI were private to her, and now she’s charged with “sending a threat in a way that others can read” – we won’t be able to use our computers for private diaries or planning anymore the more they get locked down to only ‘approved’ data and programs.
And remember, it starts with CSAM, and then it moves on to “illegal content”, then “terrorist content” – and how many times has the Trump said “if you are against the president and the laws I’m enforcing, you must be a terrorist?” …
lemmy.worldFlorida woman used Claude as a diary, then Anthropic reported an entry to police - Lemmy.WorldWhat just happened? Another incident has taken place that illustrates the need
to be careful what you tell AI. A Florida woman is facing felony charges after
she used Claude as a diary and allegedly wrote that she planned to “shoot up”
the Sheriff’s office. After a human reviewer examined the statements, they were
reported to police. According to the arrest report, Carli Michelle Heller, of
Bonita Springs, Florida, wrote on September 26 that she would attack the
Sheriff’s office. She later said that she uses Anthropic’s chatbot like a
“diary.” Claude’s safety systems flagged the entry and it was escalated to a
human reviewer. After deciding it was a credible threat, the reviewer reported
it to law enforcement. The company says it may share user information in limited
emergencies if it believes disclosure is necessary to prevent death or serious
physical injury. Deputies identified Heller and visited her home. She was
detained without incident before an LCSO intelligence detective took This is the pretext for taking away individual’s rights to general computing
No it isn’t.
Replying to @mystik@lemmy.world
The Four Horsemen of the Infocalypse - terrorists, pedophiles, drug dealers, and money launderers
Replying to @Nollij@sopuli.xyz
But enough about the president…
Replying to @mystik@lemmy.world
Sorry, what? The other side of this coin is not regulating companies like OpenAI and them using their enormous level of influence to push whatever they want. When a large part of the population uses these platforms, and any (political) query always gets replied to with an answer that fits what they want to achieve, what happens?
The potential power these AI companies hold is horrifying. They absolutely should be regulated.
Replying to @mystik@lemmy.world
Another commenter mentioned that most of the major platforms do have safeguards against this stuff at this point and are more being done with local models. That’s my ignorance and I’m sorry about that. I would agree with you in general - what you do on your local device should be private, which will protect a lot of important usage but also some nefarious usage. Terms and conditions of freedoms.
Replying to @Dryad@lemmy.world
Fine, as long as you agree to prosecute also all companies that produce software to work with images (or generate them without using AI), every company that produce software that can be used to create 3d models and then the renderer that get these models and render them into photorealistic images.
Then you need to go after everyone who produces plugins fot these softwares. And then you need to go to every open source software that do the same thing and every person who contribute to them.
And maybe even hardware vendors that sell graphics tablets for drawing.
Sometime it seems that, especially with AI, people think that the solution is to ban the tool and not to punish who use it to do something illegal.
True, AI make it extremely easy to create such horrific images but AI is not the first tool to do so, it make only faster. Back at the time there were entire Usenet groups dedicated to fake nude/xxx images of persons, both celebrities and normal people, but we have not banned internet, we simply prosecuted (when/if caught) who created the images.
Yeah, that these images are repulsive, but prosecute the companies that make tools that can also generate them was like to prosecute a phone company because someone use a phone to plan and commit an homicide.
Replying to @gian@lemmy.grys.it
Another commenter mentioned that most of the major platforms do have safeguards against this stuff at this point and are more being done with local models. That’s my ignorance and I’m sorry about that. I would agree with you in general - what you do on your local device should be private, which will protect a lot of important usage but also some nefarious usage. Terms and conditions of freedoms.
I was thinking of how Grok in particular was just open to generating these sorts of images without any guardrails. In my mind that was similar to a company producing deadly chemicals without any guardrails for preventing it from poisoning everyone around.
Replying to @Orwi@programming.dev
Remember when they discovered a huge child sex ring and locked up one woman and then told us we’re moving on from it
They locked her up and gave her a puppy.
Replying to @snooggums@piefed.world
Put her in a resort, where she reported:
“The food is legions better, the place is clean, the staff is responsive and polite,” Maxwell wrote in an email to her brother, adding: “I feel like I have dropped through Alice in Wonderlands [sic] looking glass. I am much happier here and more importantly safe.”
How nice for her.
Replying to @Orwi@programming.dev
Ah. This is the reason the Epstein class is so adamant about AI.
Replying to @fuzzyfirefox@lemmy.world
Well at least it’s better than them abusing actual children?
There is zero chance that there is a reduction in child abuse by these evil fucks because they get the kick out of the abuse part.
Replying to @frongt@lemmy.zip
It isn’t because it’s still both.
Replying to @db2@lemmy.world
I hate that you’re right
Replying to @Orwi@programming.dev
i still remember when being a pedo was frowned upon
Replying to @dektep@lemmy.world
Seeing how many people vote for MAGA, there are likely a lot more would be pedos walking among us than anyone ever realized.
Replying to @tidderuuf@lemmy.world
All MAGAs are pedophiles, and all Republicans are MAGAs.
Replying to @Orwi@programming.dev
This is, in part, why Microsoft is having human reviewers peruse people’s private prompt data.
To make Copilot a better smut generator, even of CSAM, according to info leaked to 404 media last week. They’re not reporting the pedophiles who use their LLM for this either, they’re having reviewers evaluate different outputs and pick the ones that are the best fit for the user’s prompt, even for material of questionable legality. I talked about it on my channel this week, but be aware I did make a few off color jokes if you’re offended by that sort of thing.
Replying to @Orwi@programming.dev
CSAM is LITERALLY National Security!
-LITERALLY Republicans and AI bosses!