China is moving to tighten regulation of artificial intelligence technologies that simulate human interaction, with a new draft framework aimed at curbing risks linked to addiction, misinformation, and emotional dependency.
The proposed rules focus particularly on “digital humans,” which are increasingly used in entertainment, customer engagement, and social platforms.
Crackdown on emotional AI manipulation, Balancing innovation with control
The new guidelines reflect Beijing’s growing concern about the psychological and social effects of AI systems capable of forming human-like relationships with users. Authorities have specifically banned services that encourage addictive usage patterns among minors, highlighting the potential harm posed by immersive AI experiences.
Digital human platforms will be required to implement strict safeguards, including clear identification of AI-generated content and systems to prevent misuse of personal data. The use of someone’s likeness without permission will be prohibited, signaling a push to address privacy and identity-related risks in the evolving AI ecosystem.
Another major focus of the draft rules is emotional safety. Companies will need to monitor user interactions and take action when individuals display signs of excessive dependence or mental distress. This includes offering support mechanisms or interventions in cases where users show indications of self-harm or psychological vulnerability.
China’s approach reflects a broader regulatory trend seen globally, where governments are increasingly stepping in to manage the societal impact of digital technologies. However, Beijing’s framework stands out for its comprehensive scope, combining content moderation, user protection, and strict control over AI behavior.
The draft also reinforces longstanding policies on internet governance, banning digital humans from producing content that undermines national unity, spreads misinformation, or promotes violence. These restrictions highlight the government’s continued emphasis on maintaining stability in online spaces.
The move comes as China pushes forward with ambitious plans to integrate AI into its economic and technological development. Policymakers are seeking to strike a balance between fostering innovation and ensuring that new technologies do not pose risks to users, particularly younger audiences.
Experts say the proposed rules could set a global benchmark for regulating AI-driven human-like systems, especially as digital companions and virtual influencers become more prevalent worldwide.