(NewsNation) — AI research company Anthropic will ban users for being “abusive or cruel” to Claude, the company’s AI-based chatbot.

“The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose. It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research,” the company said in a statement.

Anthropic, which is valued at $965 billion, said the policy change falls in line with previous measures to prevent “rare conversations with persistently abusive users on Claude.ai and Claude Code.”

“Such abuse is the main focus of this update; Claude’s ability to end these interactions will remain the primary enforcement mechanism,” according to the statement.

In September, several Anthropic researchers raised concerns about the potential for artificial intelligence to become uncontrollable — with one warning AI could potentially destroy humanity within the next decade.

“The people building AI earnestly believe it could kill us all by the end of the decade,” Anthropic AI researcher Jacob Coxon, who resigned Tuesday, wrote on social media. “This is not a marketing stunt.”