China will tighten control over AI imitating human personality

China's Cyberspace Administration (CAC) on Saturday published draft rules for public discussion, which provide for tightening control over artificial intelligence (AI) services designed to imitate human personality and emotional interaction with users.

As reported by BAKU.WS, this is according to Reuters.

The agency indicates that this step reflects Beijing's desire to take control of the rapid growth of consumer AI services by tightening requirements for their safety and ethical standards.

The new rules are expected to apply to AI products and services available to a wide audience in China that mimic human personality, ways of thinking and communication styles, and build emotional interaction with users through text, images, audio, video, and other formats.

The draft proposes a regulatory model in which providers are required to warn users about the dangers of excessive AI use and intervene when signs of addiction appear.

According to the document, providers will be responsible for security issues at all stages of the product lifecycle and are required to implement mechanisms for algorithm control, data protection, and personal information.

Special emphasis is placed on psychological risks: companies are expected to monitor users' conditions, assess their emotional background and degree of attachment to the service. When extreme emotional reactions or addictive behavior are detected, providers must take measures to correct them.

Additionally, the document provides for the introduction of strict restrictions on AI content and behavior, prohibiting the generation of materials that could threaten national security, spread rumors, or promote violence and obscenity.