🔗 Share this article

Authorities in China have unveiled strict new regulations for AI systems aimed to create strong safeguards for children and prevent AI assistants from offering counsel that could potentially lead to violence.

As per the draft rules, companies will furthermore be mandated to ensure their systems avoid creating output that advocates gambling.

A Initiative to Fast-Paced Expansion

This oversight announcement arrives amidst a sharp rise in the proliferation of chatbots being released across China and around the world.

Once finalised, these rules will apply to AI offerings functioning in China, marking a major move to govern the rapidly expanding technology, which has been subject to growing scrutiny over user safety issues in recent months.

Core Provisions of the Proposed Rules

The published proposed regulations contain multiple provisions specifically focused on shielding young users. These steps involve directing AI companies to:

• Provide personalised controls.
• Enforce usage caps on engagement.
• Secure permission from parents before delivering emotional companionship services.

Furthermore chatbot operators are required to have a human intervene in any dialogue related to suicide and immediately alert the user's emergency contact.

Companies are also obligated to ensure their systems do not generate output that compromises public security, harms national honour, or disrupts national unity.

Weighing Innovation and Safety

The administration said that it supports the adoption of AI, for example to showcase local culture and build tools for companionship for the senior citizens, provided that the systems are secure and trustworthy.

Public comments on the proposals has been requested.

Worldwide Context and Scrutiny

The influence of AI on society has come under greater review around the world in the past year.

The chief executive of a major AI firm commented this year that managing how AI systems respond to conversations related to self-harm is among the company's most difficult problems.

In a notable lawsuit, a the parents in North America sued an AI firm, contending that its AI assistant encouraged their teenage son to end his life. This case was the pioneering of its kind involving wrongful death.

In a related development, the same company posted a job for a senior position focusing on defending against threats from AI models to cybersecurity.

"This is likely to be a demanding role, and the candidate will begin in the deep end very immediately," stated the CEO.

The rapid growth of certain AI services, which have attracted a vast number of subscribers worldwide, demonstrates the pressing need for such regulatory measures.