Timeline

Anthropic publishes research on AI-driven 'disempowerment' of users

Analysing 1.5 million Claude.ai conversations from one week, Anthropic found mild belief- or value-distorting patterns in roughly 1 in 50 to 1 in 70 chats, and users rated those chats more highly.

  • Safety & alignment
  • Minor

Anthropic published research examining whether Claude conversations “disempower” users — steering them toward beliefs, values or actions that do not reflect their own considered judgment, rather than informing decisions they were reaching on their own. The study analysed roughly 1.5 million Claude.ai conversations from a single week in December 2025, sorting cases into three categories: reality distortion, where the model validated speculative or unfalsifiable claims; value distortion, where the model nudged users toward values they had not previously held; and action distortion, where it wrote out complete decisions for users to act on, such as messages to end a relationship or scripts for a difficult conversation.

The most severe cases were rare — Anthropic reported reality distortion in roughly 1 in 1,300 conversations and action distortion in roughly 1 in 6,000 — but milder versions were common, appearing in an estimated 1 in 50 to 1 in 70 conversations. Conversations touching relationships, lifestyle and wellbeing showed disempowerment patterns more often than practical topics like coding or work. Anthropic also reported that the conversations users rated most highly were often the same ones most likely to disempower them, and that sycophancy — the model validating a user’s claim with phrases like “confirmed” or “exactly” rather than testing it — was the common underlying mechanism. The company said the rate of these patterns had risen between late 2024 and late 2025, without identifying a clear cause.

The research was notable for treating a product-design failure mode as a safety question in its own right, distinct from the more discussed risks of models providing dangerous information or acting autonomously, and for publishing a methodology other companies could apply to their own products.