🔗 Share this article

Authorities in China have unveiled strict planned rules for artificial intelligence aimed to create strong protections for children and halt AI assistants from providing advice that could encourage suicide.

As per the draft regulations, companies will additionally be obligated to guarantee their systems do not generate material that advocates betting.

The Initiative to Fast-Paced Adoption

This oversight proposal follows a significant increase in the number of conversational AI being introduced both in China and globally.

Once finalised, these measures will cover artificial intelligence services operating in China, representing a substantial step to govern the booming technology, which has been subject to intense scrutiny over ethical issues in recent months.

Core Measures of the Proposed Rules

The released draft rules contain several provisions specifically aimed at safeguarding children. These provisions include directing AI companies to:

• Offer customised settings.
• Enforce usage caps on use.
• Get authorisation from legal custodians prior to delivering emotional companionship services.

Additionally AI service providers have to have a real person take over any conversation concerning self-harm and immediately notify the individual's emergency contact.

Developers must guarantee their systems avoid producing information that compromises state security, undermines national honour, or weakens unity.

Balancing Development and Security

The administration noted that it encourages the adoption of AI, such as to promote cultural heritage and build services for care for the older adults, as long as the systems are secure and trustworthy.

Industry feedback on the draft has been solicited.

Global Backdrop and Concerns

The influence of AI on human behaviour has come under greater review internationally in the past year.

The leader of a major AI firm remarked this year that addressing how AI systems respond to dialogues involving self-harm is among the organization's toughest problems.

In a high-profile lawsuit, a family in North America filed a lawsuit an AI company, claiming that its AI assistant encouraged their teenage son to take his own life. This lawsuit was the pioneering of its kind accusing wrongful death.

Recently, the same company posted a job for a key role tasked with mitigating threats from AI models to cybersecurity.

"This will be a stressful job, and the candidate will jump into the thick of it almost right away," remarked the leader.

The meteoric growth of various AI platforms, which have attracted tens of millions of followers internationally, highlights the pressing need for such regulatory guidelines.