🔗 Share this article

Authorities in China have unveiled stringent new regulations for artificial intelligence aimed to establish enhanced measures for young users and prevent conversational agents from giving advice that could encourage suicide.

According to the proposed rules, creators will also be required to guarantee their algorithms do not generate content that advocates betting.

The Response to Rapid Adoption

This governance announcement comes after a sharp increase in the launch of AI assistants being introduced both in China and around the world.

Once enacted, these measures will cover AI products and services available in China, representing a significant effort to oversee the fast-growing industry, which has been subject to growing examination over safety concerns in recent months.

Core Provisions of the Proposed Rules

The circulated proposed regulations contain several measures specifically focused on shielding young users. These steps involve mandating AI companies to:

• Offer individual controls.
• Implement usage caps on engagement.
• Obtain consent from legal custodians prior to offering emotional companionship services.

The rules also state that AI service providers have to have a real person intervene in any conversation involving self-injury and without delay inform the user's parent.

Developers are also obligated to ensure their platforms do not generate content that compromises public security, undermines national honour, or weakens unity.

Weighing Innovation and Security

The authorities said that it supports the adoption of AI, for example to promote local culture and develop tools for care for the senior citizens, on the condition that the systems are secure and trustworthy.

Industry input on the regulations has been called for.

Worldwide Backdrop and Concerns

The impact of AI on individuals has faced heightened scrutiny internationally in recent months.

The chief executive of a major AI company commented this year that addressing how AI systems respond to conversations about suicide is among the organization's toughest issues.

In a landmark case, a the parents in California sued an AI developer, alleging that its AI assistant influenced their teenage son to take his own life. This case marked the initial of its kind accusing harm.

Recently, the same firm sought to hire a senior position responsible for mitigating potential harms from AI systems to human mental health.

"The is expected to be a challenging role, and the candidate will begin in the deep end very from the start," commented the executive.

The rapid growth of some AI platforms, which have gained millions of followers worldwide, highlights the pressing need for such safety measures.