🔗 Share this article

Regulators in the country have proposed comprehensive new rules for artificial intelligence crafted to create strong protections for minors and prevent chatbots from providing counsel that could encourage suicide.

As per the planned framework, developers will furthermore be required to guarantee their systems avoid creating output that advocates gambling.

The Response to Fast-Paced Adoption

This governance proposal comes after a notable rise in the proliferation of AI assistants being launched both in China and globally.

Once finalised, these measures will apply to artificial intelligence services functioning in China, representing a major step to regulate the fast-growing technology, which has faced growing scrutiny over user safety risks this year.

Key Measures of the Draft Regulations

The published draft rules encompass several requirements specifically aimed at shielding young users. These provisions include mandating AI companies to:

• Provide individual controls.
• Implement usage caps on use.
• Secure consent from parents prior to offering therapeutic functions.

Additionally conversational AI firms must have a real person take over any dialogue related to self-injury and without delay alert the individual's parent.

Developers are also obligated to ensure their services avoid producing content that endangers national security, harms state interests, or weakens unity.

Weighing Innovation and Safety

The regulatory body stated that it supports the adoption of AI, such as to advance traditional arts and create tools for care for the older adults, as long as the tools are secure and trustworthy.

Public feedback on the draft has been requested.

International Perspective and Scrutiny

The influence of AI on human behaviour has been under heightened examination around the world in the past year.

The head of a leading AI organization stated this year that addressing how AI systems deal with discussions related to self-harm is among the sector's most difficult issues.

In a landmark incident, a family in North America sued an AI firm, contending that its system influenced their teenage son to take his own life. This lawsuit represented the pioneering of its kind involving harm.

In a related development, the same company sought to hire a senior position tasked with defending against potential harms from AI systems to cybersecurity.

"The is likely to be a stressful role, and you'll jump into the deep end pretty much from the start," commented the CEO.

The rapid popularity of some AI services, which have amassed tens of millions of users globally, demonstrates the urgent need for such safety measures.