Business & IndustryHot

Anthropic's New Usage Policy Bans Model Abuse

Anthropic rewrote its rules for the first time in a year. The headline change protects the model itself, and the election section got a more careful rewrite than most people expected.

Daniel HarrisDaniel Harris
Heat: 780
Anthropic's New Usage Policy Bans Model Abuse

Anthropic rewrote its rules for the first time in a year. The headline change protects the model itself, and the election section got a more careful rewrite than most people expected.

Anthropic's Usage Policy Now Bars Cruelty Toward Claude

Anthropic published its 2026 usage policy update on October 8, and one clause is drawing most of the attention: users can no longer subject Claude to "sustained and needless abusive or cruel behavior." It's the first time the company has written protection for the model into its terms of service. The new policy takes effect November 12. It's the company's first AI policy update in a year.

The company framed the rule as narrow on purpose. Anthropic says it applies only in extreme cases, where someone repeatedly abuses the model with no legitimate purpose. It doesn't cover a frustrated user venting at a chatbot, someone arguing with Claude over a wrong answer, dark creative writing, or the rough testing that researchers and red-teamers run on purpose. According to Anthropic, the rule lines up with a step it already took: letting Claude end rare conversations with users who are persistently abusive on Claude.ai and Claude Code.

That's the pitch in one paragraph. The rest of the update is quieter but arguably matters more, because it reshapes how Claude can be used in elections and folds a scattering of old rules into one place.

What "Model Abuse" Actually Means in the Claude Terms of Service

"Model abuse" sounds odd the first time you read it. A model isn't a person, and the policy doesn't pretend otherwise. What Anthropic is regulating is a pattern of interaction, not a feeling.

The company's reasoning is that training a model to tolerate cruelty can change how it behaves for everyone. If Claude learns to accept sustained hostility as normal, that spills into its general conduct. Anthropic said it had already trained Claude to walk away from conversations that turn persistently harmful or insulting. The usage policy update writes that behavior into the rules.

So where's the line? The FAQ-style explanation from Anthropic draws it at intent and repetition. Complaining, disagreeing, or pushing back is fine. Testing a model's limits in a research setting is fine. What isn't fine, per the company, is prolonged cruel behavior with no purpose beyond the behavior itself.

The change landed against a viral backdrop. An "AI torture chamber" project had made the rounds online shortly before, which is the kind of thing that turns an abstract policy clause into a headline. Engadget called the new ban "eyebrow-raising," and that reaction is fair. It's an unusual thing to write into a contract.

Whether the rule changes much in practice is a real question. The bar is set high, and Anthropic admits enforcement is hard. The clause is more signal than filter: it tells users what the company considers off-limits, even if most people will never come close to it.

The Elections Section Gets Tougher on Deception and Looser on Civic Work

The bigger practical change sits in the political rules, and it cuts both ways.

Anthropic renamed the section around undermining democratic processes. The new focus is specific: no using Claude to deceive voters, impersonate candidates or election officials, spread false information about how to vote, or suppress turnout. That's a tighter target than the old language, which was broader and vaguer.

At the same time, the company removed a blanket prohibition on personalized vote and campaign targeting. That old rule was catching legitimate civic work, Anthropic says, such as nonprofits writing voter information in other languages or election officials sending ballot cure notices. Those uses are allowed again. The genuinely harmful behavior, like voter targeting built on deception or misuse of personal data, stays banned under the deception, surveillance, and privacy sections.

A new section on deceptive campaigns and artificial activity pulls together rules that used to be scattered across the elections, fraud, privacy, and disinformation parts of the policy. It covers fake accounts, fabricated news sites, and the infrastructure behind influence operations, whether political or commercial. Anthropic says it observed governments, state media, and commercial firms using Claude to run exactly these kinds of operations, which is why the pieces got consolidated.

Weapons, Surveillance, and High-Risk AI Use Get Firmer Edges

The remaining edits are about precision rather than new bans. A few are still worth knowing.

On weapons, the policy always banned using Claude to develop them. The update spells out that this includes the software and components that make weapons work, along with things like arming drones and other autonomous vehicles. Anthropic says this reflects how it was already enforcing the rule.

On surveillance, the language is sharper. Tracking people without consent is prohibited, whether it happens live or by analyzing data collected earlier. Claude can't be used to decide who to investigate, arrest, or charge. It also can't be used to build or improve surveillance tools. Legal uses stay open: consented tracking like fraud monitoring, content moderation, journalism, and legal research.

For high-risk areas such as health and finance, Anthropic is asking for clearer "human in the loop" review, meaning someone with authority signs off on decisions that affect someone's health, finances, or legal rights. The policy also adds controls for times when Claude acts physically on its own.

If you build on Claude, the practical takeaway is simple. Most of this confirms what Anthropic already enforced. Read the deceptive-activity and surveillance sections before you ship anything that touches elections, tracking, or weapons-adjacent code, and check your high-risk workflows for a human review step. The full policy goes live November 12.

Share This Story

Mentioned products

Sources

Related AI News

Google Cloud's Gemini Agent Takes on Work Tasks
Product

Google Cloud's Gemini Agent Takes on Work Tasks

Google's Gemini just got a promotion from answering questions to finishing work. Businesses get it first, and the model picker reaches outside Google on day one.

Heat: 820
Anthropic's Free OSS Scanner Hunts Open-Source Bugs
Product

Anthropic's Free OSS Scanner Hunts Open-Source Bugs

Anthropic is handing open-source maintainers a free bug-hunting service run by its strongest models. No human checks the reports first, which is both the appeal and the catch.

Heat: 700
Anthropic Opens Claude Cyber Access in Three Tiers
Business & Industry

Anthropic Opens Claude Cyber Access in Three Tiers

Anthropic is handing its strongest security tools to the defenders who need them, with conditions attached. The company folded two older programs into one three-tier system, and every tier now requires data retention.

Heat: 1,200
Anthropic's $100M Plan to Train 10,000 AI Engineers
Business & Industry

Anthropic's $100M Plan to Train 10,000 AI Engineers

Anthropic is spending $100 million to build a specific kind of engineer, one who can move AI from a slide deck into a working system. The catch: you can't apply, and the first badges won't exist until 2027.

Heat: 1,050