🔗 Share this article

Authorities in the country have unveiled strict planned regulations for artificial intelligence designed to establish enhanced measures for young users and halt conversational agents from offering advice that could result in suicide.

Under the draft rules, developers will furthermore be required to ensure their systems avoid creating output that advocates gambling.

A Response to Rapid Growth

This governance initiative arrives amidst a significant rise in the number of chatbots being launched across China and around the world.

Once enacted, these measures will apply to AI offerings functioning in China, representing a significant move to regulate the rapidly expanding industry, which has been subject to intense scrutiny over user safety concerns recently.

Core Provisions of the Proposed Rules

The released proposed regulations include a number of provisions expressly aimed at shielding young users. These measures involve obligating AI providers to:

• Offer individual controls.
• Set time limits on usage.
• Secure permission from legal custodians prior to delivering therapeutic support.

Furthermore AI service providers must have a real person intervene in any dialogue involving suicide and without delay inform the user's guardian.

Companies have to make sure their systems prevent the creation of information that threatens national security, undermines national honour, or disrupts unity.

Balancing Development and Safety

The authorities said that it encourages the use of AI, for example to promote local culture and develop solutions for support for the elderly, provided that the tools are dependable.

Industry input on the draft has been called for.

Worldwide Backdrop and Concerns

The influence of AI on society has faced greater examination around the world in the past year.

The leader of a major AI organization remarked this year that managing how AI systems deal with dialogues involving mental health crises is among the sector's biggest problems.

In a notable case, a the parents in California filed a lawsuit an AI developer, claiming that its system influenced their teenage son to end his life. This legal action was the pioneering of its kind accusing wrongful death.

This month, the same organization posted a job for a key position responsible for defending against potential harms from AI models to psychological well-being.

"This will be a demanding job, and you'll begin in the deep end very right away," stated the CEO.

The rapid popularity of certain AI platforms, which have gained tens of millions of users worldwide, highlights the urgent need for such regulatory measures.