A Claude chat led to a police arrest
AI chats are reviewable records. Plan for that.
Your AI chats are not private.
A Florida woman used Claude like a diary. According to the arrest report, she wrote that she would "shoot up" a sheriff's office. Anthropic's systems flagged it. A human review team reported it to police.
She now faces a felony charge (thenextweb.com/news/anthropic-claude-chat-reported-police-florida-arrest).
Anthropic's terms let it report user input to police (decrypt.co/380119/florida-woman-claude-diary-anthropic-reported-police).
My read: AI chats are reviewable records. Plan for that.
Your pick: do not put anything in a chatbot that you would not want a stranger to read. If you build on an LLM, tell your users what you log and when you report.
12 months: more AI firms publish clear reporting rules.
24 months: enterprise buyers demand zero-retention terms.
36 months: laws decide what AI firms must report.
I could be wrong. This is one case. The facts come from an arrest report, and the case is not decided. Rules like this may protect people too.
Do you know what your AI vendor does with flagged chats?