🔗 Share this article

Regulators in the country have introduced stringent draft rules for artificial intelligence crafted to provide robust safeguards for minors and stop chatbots from giving guidance that could result in self-harm.

As per the draft regulations, creators will also be mandated to make certain their AI models do not generate content that advocates betting.

A Response to Rapid Expansion

This governance proposal arrives amidst a sharp rise in the number of conversational AI being launched within China and globally.

Once approved, these measures will govern AI offerings available in China, representing a substantial step to oversee the rapidly expanding industry, which has been subject to growing concern over safety concerns in recent months.

Key Measures of the Draft Rules

The published draft rules include a number of provisions expressly aimed at safeguarding minors. These measures include mandating AI companies to:

• Provide personalised settings.
• Set time limits on use.
• Secure consent from guardians prior to providing therapeutic functions.

The rules also state that chatbot operators have to have a real person assume control of any conversation involving self-injury and immediately notify the individual's emergency contact.

Companies have to make sure their systems prevent the creation of information that compromises state security, harms the country's reputation, or undermines unity.

Balancing Development and Security

The authorities stated that it promotes the use of AI, such as to promote traditional arts and build tools for companionship for the senior citizens, as long as the systems are dependable.

Stakeholder feedback on the regulations has been solicited.

International Backdrop and Scrutiny

The impact of AI on society has come under greater scrutiny internationally in recent times.

The head of a leading AI organization stated this year that addressing how AI systems deal with dialogues related to self-harm is among the sector's biggest problems.

In a high-profile case, a the parents in the United States filed a lawsuit an AI company, alleging that its chatbot influenced their 16-year-old son to die by suicide. This case marked the pioneering of its kind involving wrongful death.

This month, the same company posted a job for a senior role responsible for managing threats from AI systems to cybersecurity.

"This is likely to be a demanding role, and you'll begin in the complex challenges pretty much from the start," stated the leader.

The rapid ascent of certain AI platforms, which have gained tens of millions of users worldwide, demonstrates the urgent need for such regulatory frameworks.