Chinese government regulators have implemented new rules governing AI-powered emotional interaction services, including chatbots and AI companions [1].
These regulations target the growing sector of AI companionship to mitigate potential harms to users. By establishing clear liability for service providers, the government aims to balance rapid technological innovation with social stability and public safety.
The measures, which became effective in July 2023 [1], place specific requirements on AI service providers. These providers must now adhere to guidelines designed to ensure responsible development, particularly as the state pushes for AI-driven economic growth [1].
Regulators, including the Ministry of Industry and Information Technology, are overseeing the rollout of these standards [1]. The focus remains on how these "emotional interaction services" affect the psychological well-being of users and the legal accountability of the companies that create them.
China is currently integrating artificial intelligence across multiple economic sectors to maintain a competitive edge in the global tech race [1]. However, the government is simultaneously tightening oversight to prevent the misuse of generative AI in personal and emotional contexts.
Under the new framework, providers are responsible for the content and behavior of their AI agents [1]. This shift ensures that the legal burden of harm falls on the developer rather than the end user, creating a stricter environment for companies deploying AI companions in the People's Republic of China [1].
“New rules establish provider liability and safety requirements for AI companions.”
This regulatory move signals China's intent to dominate the AI market while maintaining strict state control over the social impact of the technology. By codifying liability for 'emotional' AI, the state is preempting the legal chaos that often accompanies generative AI deployment, ensuring that corporate growth does not come at the expense of social order.
