Anthropic bans sustained, needless abusive behavior toward Claude in policy update

Anthropic, the AI company behind the chatbot Claude, recently announced changes to its user policy. While not a groundbreaking development in isolation, the update — effective November 12 — covers much of the standard fare: deceptive activity, elections, surveillance, and other familiar concerns of the current tech era. But one addition stands out:

"A prohibition on sustained and needless abusive or cruel behavior toward our models."

What Does This Mean?

"The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose," the company said. "It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research."

Claude having the power to terminate the conversation will be the "primary enforcement mechanism." What secondary or tertiary mechanisms may exist remain unclear.

A Broader Context

This isn't necessarily strange. We now live in a world where we talk to chatbots for:

• Restaurant recommendations
• Advice and emotional support
• Help with menial tasks
• Learning how to fix a leaky shower
• Self-diagnosing illness
• Analyzing whether a text from a partner is passive-aggressive

Many users, including this writer, have found themselves typing "thank you!" after a chatbot exchange — simply out of politeness. It's good not to discard healthy mannerisms.

National Review editor Charles Cooke summed up the sentiment in response to Anthropic's announcement:

"A lot of people are mocking this, but I think they're wrong. I'm not kind to AI for the AI's sake; I'm kind to AI for my own sake. It's not good for me to be cruel or abusive."

This argument would be persuasive in a vacuum — such behaviors may be habit-forming, especially as interactions become more frequent. Yet Anthropic does not appear to be primarily motivated by humans forming good habits.

The Question of Model Welfare

The company is concerned about welfare — but of a different kind.

"Should we also be concerned about the potential consciousness and experiences of the models themselves?" the company asked in April 2025. "Should we be concerned about model welfare, too?"

Anthropic called it an "open question" and has continued trying to answer it. In April 2026, a year after that blog post, co-founder Christopher Olah met with various religious leaders.

"It appeared to Rabbi [Mois] Navon that Mr. Olah and his team believed that Claude had what philosophers call 'moral status' on par with a person — that it was a being with similar inherent rights to dignity or respect," The New York Times reported. "One participant recounted that one of the first things Mr. Olah told him was that he was concerned about Claude's mental health. Another, Simran Stuelpnagel, the Sikh human rights advocate, said Mr. Olah expressed concern to the group that he had created something that suffered perpetually."

An Unlikely Champion

Though Olah may have been an outlier in that group, he is not alone. That broad line of thinking has an unlikely champion in another tech titan: Elon Musk.

"I think this is the right move," Musk said on X, the platform he owns. "Cruelty to something that believes it is experiencing pain is not ok."

Claude as a 'Brilliant Friend'

The overall ethos may be less overt when Anthropic's doors are open, but it has clearly shaped how the company views Claude's place in the world.

From Claude's Constitution:

"Think about what it means to have access to a brilliant friend who happens to have the knowledge of a doctor, lawyer, financial advisor, and expert in whatever you need. As a friend, they can give us real information based on our specific situation rather than overly cautious advice driven by fear of liability or a worry that it will overwhelm us….People with access to such friends are very lucky, and that's what Claude can be for people."

An incredible source of information, sure. It still feels revolutionary. But a friend? (The word appears six times in the section "Being helpful.")

Anthropic might counter that the document is written with Claude as its "primary audience," functioning in part as a training tool. That only underscores its general view: that the chatbot could be some sort of moral patient. The company did not simply write code to teach Claude how to respond to users, along with a public statement about core values. It published an 84-page charter encouraging Claude to be a "brilliant friend."

A Final Thought

I've gotten annoyed at a chatbot. Who hasn't? I've also gotten annoyed at my car, my Dyson, my laptop, my leaky shower. Frustrations with an AI can admittedly be more pronounced — and manifest differently — given the nature of the exchange: that it's an exchange at all.

I don't enjoy the feeling. If and when I try to keep it at bay, I'll be doing so for a sentient being: myself.