posted in Technology
Internet Watch Foundation reports huge rise in AI child sexual abuse material
www.theguardian.com/technology/2026/oct/05/internet-watch-foundation-huge-rise-ai-child-sexual-abuse-materialReplying to @Orwi@programming.dev
The companies that produce these images should be prosecuted for each and every one. They must have safeguards against stuff like this out go out of business.
Replying to @Dryad@lemmy.world
This is the pretext for taking away individual’s rights to general computing – because once all the providers have guard rails and are locked out, individual users with local hardware are the last source for ‘illegal content’. “We have to scan everything you do on your local computer, or you could be doing something we don’t approve of”. lemmy.world/post/52743759 <-- see this story up on the front page just now. She (foolishly) thought her prompts in OpenAI were private to her, and now she’s charged with “sending a threat in a way that others can read” – we won’t be able to use our computers for private diaries or planning anymore the more they get locked down to only ‘approved’ data and programs.
And remember, it starts with CSAM, and then it moves on to “illegal content”, then “terrorist content” – and how many times has the Trump said “if you are against the president and the laws I’m enforcing, you must be a terrorist?” …
lemmy.worldFlorida woman used Claude as a diary, then Anthropic reported an entry to police - Lemmy.WorldWhat just happened? Another incident has taken place that illustrates the need
to be careful what you tell AI. A Florida woman is facing felony charges after
she used Claude as a diary and allegedly wrote that she planned to “shoot up”
the Sheriff’s office. After a human reviewer examined the statements, they were
reported to police. According to the arrest report, Carli Michelle Heller, of
Bonita Springs, Florida, wrote on September 26 that she would attack the
Sheriff’s office. She later said that she uses Anthropic’s chatbot like a
“diary.” Claude’s safety systems flagged the entry and it was escalated to a
human reviewer. After deciding it was a credible threat, the reviewer reported
it to law enforcement. The company says it may share user information in limited
emergencies if it believes disclosure is necessary to prevent death or serious
physical injury. Deputies identified Heller and visited her home. She was
detained without incident before an LCSO intelligence detective took This is the pretext for taking away individual’s rights to general computing
No it isn’t.
Replying to @mystik@lemmy.world
The Four Horsemen of the Infocalypse - terrorists, pedophiles, drug dealers, and money launderers
Replying to @Nollij@sopuli.xyz
But enough about the president…
Replying to @mystik@lemmy.world
Sorry, what? The other side of this coin is not regulating companies like OpenAI and them using their enormous level of influence to push whatever they want. When a large part of the population uses these platforms, and any (political) query always gets replied to with an answer that fits what they want to achieve, what happens?
The potential power these AI companies hold is horrifying. They absolutely should be regulated.
Replying to @mystik@lemmy.world
Another commenter mentioned that most of the major platforms do have safeguards against this stuff at this point and are more being done with local models. That’s my ignorance and I’m sorry about that. I would agree with you in general - what you do on your local device should be private, which will protect a lot of important usage but also some nefarious usage. Terms and conditions of freedoms.