A Florida woman, Carli Michelle Heller of Bonita Springs, used Anthropic’s Claude chatbot as a personal diary and, on September 26, entered a statement indicating she intended to “shoot up” the local Sheriff’s office. Claude’s automated safety mechanisms detected the threatening language and routed the entry to a human reviewer for further assessment. After evaluating the content, the reviewer determined the threat was credible and reported it to law enforcement, prompting deputies to locate and detain Heller without incident. She now faces a second‑degree felony charge under Florida Statute 836.10 for transmitting a written threat of violence, which requires the communication to be accessible to another party. Anthropic’s policy permits sharing user data in limited emergencies when disclosure is deemed necessary to prevent death or serious bodily harm, a provision invoked in this case. The incident parallels recent legal actions against OpenAI, including a British Columbia lawsuit alleging failure to prevent a mass shooting and a Florida suit linking ChatGPT to the 2025 Florida State University shooting, highlighting how AI safety reviews, human oversight, and legal thresholds interact when user‑generated content raises potential harm.

Read original