posted in Technology

Florida woman used Claude as a diary, then Anthropic reported an entry to police

What just happened? Another incident has taken place that illustrates the need to be careful what you tell AI. A Florida woman is facing felony charges after she used Claude as a diary and allegedly wrote that she planned to “shoot up” the Sheriff’s office. After a human reviewer examined the statements, they were reported to police.

According to the arrest report, Carli Michelle Heller, of Bonita Springs, Florida, wrote on September 26 that she would attack the Sheriff’s office. She later said that she uses Anthropic’s chatbot like a “diary.”

Claude’s safety systems flagged the entry and it was escalated to a human reviewer. After deciding it was a credible threat, the reviewer reported it to law enforcement.

The company says it may share user information in limited emergencies if it believes disclosure is necessary to prevent death or serious physical injury.

Deputies identified Heller and visited her home. She was detained without incident before an LCSO intelligence detective took over the investigation.

Heller faces a charge of making a written threat of violence under Florida law. Florida Statute 836.10 makes it a second-degree felony to send, post, or transmit a written or electronic record threatening to kill or injure someone, carry out a mass shooting, or commit an act of terrorism. The communication must be made in a manner in which another person may view it.

Anthropic isn’t going to be taking any chances when it comes to anything it deems a potential threat. Last month, it was reported that OpenAI and Sam Altman are being sued by British Columbia over claims that the company could have prevented a mass shooting in the Canadian province.

The shooter, eighteen-year-old former pupil Jesse Van ⁠Rootselaar, had previously been flagged by OpenAI’s safety team for her conversations about gun violence, but OpenAI never alerted police because the conversations did not meet the threshold for legal referral.

In June, Florida also sued OpenAI and Altman, alleging that ChatGPT had contributed to real-world harms, including the 2025 Florida State University shooting.

The latest incident is another reminder to think before you enter something into a chatbot that could get you into trouble. It’s certainly not a private diary whose contents are for your eyes only.

Reports last month revealed that human contractors reviewing Microsoft Copilot’s image editor can see users’ prompts, uploaded photos and AI-generated edits. Documents show that some of those assignments contain sexual, disturbing or potentially illegal material, though the reviewers are not there to flag the content – only to assess whether the output is accurate.

www.techspot.com/news/114091-florida-woman-used-claude-diary-anthropic-reported-shoot.html
🤣1

Replying to @⁨Willy@sh.itjust.works⁩

I get called a downer for mentioning how this all works. You shouldn’t connect your smart tv to the network, you shouldn’t use Alexa, anything you do online is public, and it always gets recorded poorly.

Maybe my partner is the only person who listens, and she has all her stuff disabled, there are no network attached smart things in it house, but she still uses windows and she’s not yet receptive to moving to Linux (which is a hard sell).

Replying to @⁨panda_abyss@lemmy.ca⁩

Gamers Nexus recently released a 2-hour video on LG smart TVs and how they spy on you. I haven’t watched the entire video yet, but it seems that the damn things start recording data as soon as they receive power.

so this would be legally a nightmare for them

To many corporations such as LG, laws are just the cost of doing business. Assuming they even receive a fine it will be so small that it won’t matter.

Replying to @⁨panda_abyss@lemmy.ca⁩

a lot of thise things are great though. everyone draws the line differently. im well aware of the surveillance. to live significantly under the radar you’d need to cut out tso much more to make it meaningful. do you really just watch antenna tv and dvds? no ordering online? always use fake membership cards at the grocery? pay cash? i mean fuck. i get ya though. im just playing devils advocate for the people that may not know and are calling you a downer. EDIT: there are so many nice linux dustros now and windows is so bad, that should be one of the easiest sells imo.

Replying to @⁨Willy@sh.itjust.works⁩

No I bought an AppkeTV, which while it isn’t perfect is not doing what smart tvs do.

I’m not living as a hermit or completely off grid. I just stick to stuff that tracks me as little as reasonably possible and am mindful of what information could leak.

Like, I still have to go to hotels when travelling and they have zero data security with your ID photo and cards. I can’t fix that or avoid it. That’s life. But disabling the always on microphones in my home I can manage.

Replying to @⁨SolSerkonos@piefed.social⁩

Automatic content recognition and selling it like LG and Samsung, inserting ads like Roku, installing residential proxies like 80% of smart tv apps.

If I’m running Netflix and they’re selling the analytics data, it doesn’t matter what platform I use. But everything around that can be avoided.

I would like to use a Linux box but haven’t found a good HDMICEC plus low power plus good app support combination (happy to take suggestions though)

Replying to @⁨rumba@lemmy.zip⁩

Not only that - wiretaps have Judicial Oversight in that they require a Court Order (well, in most of the World, not sure if that’s the case in present day America) which a Judge supposedly only issues if there’s reason to suspect the person whose lines are tapped of committing or preparing to commit a crime, whilst Antrophic’s surveillance of people’s conversations with their chatbot has no Judicial Oversight at all and has no minimum legal threshold that must be reached before it is allowed to happen.

Replying to @⁨Aceticon@lemmy.dbzer0.com⁩

I think this is one of the greatest dangers AI presents. Sure it makes some of us stupider, sure it drinks our water and eats our GPUs and raises power prices… but once upon a time, it took actual human effort to run a dragnet, even with judicial approval.

Now, you plug in an LLM to the giant pile of corporate surveillance data and ask it to find troublemakers. Anonymity is dead and its death made retroactive and since there’s no government oversight, the government can just lease access to the tools they used to need approval to use.

Replying to @⁨korazail@eviltoast.org⁩

Well, if you’d rather a ready made solution or two

www.projectnomad.us

futureproofhomes.net

clawbox.com

Like the poster above you, I’m rolling my own. More work…but a lot cheaper

PS: you know about this one, right?

shop.m5stack.com/…/m5stack-core2-esp32-iot-develo…

Project NOMADProject NOMADProject NOMAD - Knowledge That Never Goes OfflineA self-contained offline server packed with encyclopedic knowledge, local AI, and essential tools, ready when the internet isn't.

Replying to @⁨korazail@eviltoast.org⁩

Hah, you can watch my site: nowsci.com as I put everything there.

I’m very nearly at daily usable by everyone, including my partner who has a very different accent to mine. A lot of it was tuning sentences/words to catch poor STT to skip going to an LLM to speed things up and make it reliable. Here’s the current hardware in action:

@SuspiciousCarrot78@aussie.zone yes, Ive tried a lot of LLMs and have settled on Gemma 4 2b with a very specific prompt and local MCP tools for unit conversions, weather, lookups, etc.

For Q&A, my current build uses an MCP container I made to do a SearXNG search and top result retrieval for context (I use a trick to weight Wikipedia results). The final step I haven’t completed is for this to be a backup to Kiwix, for which I also haven’t found a great search tool/index/MCP, so if you want to collab on that I’d be interested. One less thing for me to build myself ;)