Anthropic bans users from being ‘abusive or cruel’ to Claude

(NewsNation) — AI research company Anthropic will ban users for being "abusive or cruel" to Claude, the company's AI-based chatbot.

"The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose. It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research," the company said in a statement.

 Anthropic worker estimates 10% chance AI could kill humans by 2036 

Anthropic, which is valued at $965 billion, said the policy change falls in line with previous measures to prevent "rare conversations with persistently abusive users on Claude.ai and Claude Code."

"Such abuse is the main focus of this update; Claude's ability to end these interactions will remain the primary enforcement mechanism," according to the statement.

 GLP-1 weight-loss drugs slow biological aging, recent studies show 

In September, several Anthropic researchers raised concerns about the potential for artificial intelligence to become uncontrollable — with one warning AI could potentially destroy humanity within the next decade.

"The people building AI earnestly believe it could kill us all by the end of the decade," Anthropic AI researcher Jacob Coxon, who resigned Tuesday, wrote on social media. "This is not a marketing stunt."

Copyright 2026 Nexstar Media, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.For the latest news, weather, sports, and streaming video, head to NewsNation.