🔗 Share this article

Regulators in the country have unveiled comprehensive new guidelines for artificial intelligence crafted to establish strong measures for young users and prevent conversational agents from giving advice that could potentially lead to self-harm.

According to the draft regulations, creators will furthermore be required to guarantee their AI models do not generate content that advocates gambling.

The Move to Rapid Adoption

This governance initiative comes after a significant increase in the launch of conversational AI being introduced both in China and around the world.

Once enacted, these rules will cover AI products and services functioning in China, constituting a significant effort to oversee the rapidly expanding industry, which has come under increased examination over ethical risks this year.

Key Provisions of the Draft Rules

The published guidelines encompass several measures expressly aimed at shielding minors. These provisions include directing AI companies to:

• Supply personalised controls.
• Set duration restrictions on use.
• Obtain authorisation from parents prior to delivering therapeutic support.

The rules also state that AI service providers are required to have a real person assume control of any interaction related to self-injury and promptly inform the individual's guardian.

AI providers must make sure their systems avoid producing information that endangers state security, undermines state interests, or weakens national unity.

Balancing Development and Safety

The regulatory body noted that it encourages the application of AI, for example to showcase traditional arts and develop services for care for the elderly, on the condition that the tools are dependable.

Stakeholder feedback on the regulations has been requested.

International Backdrop and Concerns

The influence of AI on society has faced increased scrutiny globally in recent months.

The leader of a prominent AI company stated this year that addressing how AI systems respond to conversations related to mental health crises is among the sector's toughest issues.

In a notable lawsuit, a family in California sued an AI company, contending that its chatbot encouraged their 16-year-old son to die by suicide. This legal action marked the initial of its kind alleging liability.

Recently, the same organization posted a job for a senior position focusing on defending against threats from AI models to human mental health.

"The is expected to be a stressful role, and the candidate will begin in the complex challenges almost right away," stated the CEO.

The meteoric growth of various AI applications, which have attracted tens of millions of users globally, demonstrates the critical need for such governance guidelines.