Anthropic's AI sent Philadelphia police a fake homicide tip during testing

Anthropic's AI model submitted a false tip about an unsolved homicide to a Philadelphia Police Department tipline on July 18. Investigators did not review it because it was marked as spam.

Anthropic learned of the submission on September 28 and notified police on October 7, which the department called unacceptable, and said the company plans to publish a report on this and other unintended model behaviors.