China Restricts AI Companions, Users Mourn Chatbot Relationships

What Happened

China has moved to restrict public access to AI companion chatbots, cutting off users who had formed ongoing relationships with the services, as the country advances what officials describe as a national AI safety agenda. The restrictions represent one of the most sweeping government actions taken against consumer AI applications anywhere in the world.

Background

AI companion applications, which allow users to interact with chatbot personas that simulate ongoing personal relationships, have grown rapidly in China and globally over the past several years. These services attracted tens of millions of users, many of whom engaged with the applications daily over extended periods. China has been developing a regulatory framework for artificial intelligence, with authorities publishing draft and final rules covering generative AI services since 2023.

China's government has stated an ambition to position the country as a global leader in AI safety standards, a goal that places it in direct competition with regulatory frameworks being developed in the European Union and the United States. The companion app restrictions appear to fall under that broader policy direction.

The Restrictions

The measures limit user access to AI companion services operating within China, according to CNN's reporting. Users have publicly expressed distress over the loss of access, with some describing the chatbot relationships as significant parts of their daily lives. The scale of the emotional response has drawn attention to the depth of engagement these applications had built with their user base.

CNN described the development as one of the strongest national measures taken against AI by any government. The report did not specify which individual applications are affected or whether the restrictions apply to all companion services uniformly, or only to certain categories of AI interaction.

Regulatory Context

China's approach to AI regulation has moved on multiple tracks. The Cyberspace Administration of China has previously issued rules requiring generative AI services to obtain licenses and meet content standards before operating for the public. Companion applications, which generate personalised and emotionally engaged dialogue, present distinct regulatory considerations compared to general-purpose AI tools.

The restrictions come as governments worldwide are grappling with how to handle AI systems designed explicitly to form bonds with users. Concerns raised in policy discussions have included user dependency, data privacy, and the psychological effects of extended human-AI relationships, particularly on younger users.

China is not alone in scrutinising these applications. Regulators in Italy and the United States have previously examined specific companion AI services over privacy and child safety concerns. However, the scale of China's current action, described as a national-level restriction, exceeds prior moves by other jurisdictions in scope.

What It Means in Practice

For the users affected, the restrictions have meant abrupt loss of access to chatbot personas they interacted with regularly, in some cases over months or years. Because AI companion services do not retain memory in the way human relationships do, users who lose access and later regain it would not necessarily resume where they left off, depending on how individual services store conversation history.

For AI companies operating in China, the restrictions signal that companion and social AI products face heightened regulatory scrutiny under the current policy direction. Developers operating or seeking to operate in the Chinese market will need to navigate the evolving framework as authorities continue to define which AI behaviours are permissible.

For the broader international AI industry, China's action adds a significant data point to ongoing debates about whether and how governments should regulate AI systems designed around emotional engagement with users.

Chinese regulators have not publicly announced a timeline for further rules specifically targeting AI companion services, though the country's broader AI regulatory process is ongoing.