
China has introduced sweeping new rules that prevent technology companies from developing AI chatbots that encourage users to become emotionally dependent on them.
The regulations, which came into effect last week, are aimed at AI companion services that simulate friendships or romantic relationships. Chinese authorities said the rules are designed to protect users while encouraging people to build real-world relationships instead of relying on artificial intelligence.
ALSO READ: Amazon founder Jeff Bezos' ex-wife couldn't afford a dentist and fixed her broken tooth with denture glue
The move comes as China continues to battle a declining birth rate and a shrinking population, with policymakers increasingly looking at the social impact of emerging technologies.
Musk has repeatedly described falling birth rates as one of the biggest long-term risks facing many countries, warning that continued population decline could lead to economic and social challenges.
ALSO READ: This US tech billionaire once begged power companies to keep his electricity on, faced rejection from almost every investor, now owns a $300 million Hawaiian island
Chinese policymakers now appear to be taking similar concerns into account as they regulate AI companion technology, hoping to ensure that artificial intelligence supports society rather than replacing real human relationships.
The rules also prohibit virtual romantic relationships involving minors, adding another layer of protection for young users.
In addition, AI companies must notify a user's emergency contact if their chatbot detects signs that the person may be experiencing an emotional crisis.
The new policy applies to major Chinese technology companies offering AI companion services, including Alibaba and ByteDance, the parent company of TikTok.
Following the announcement, both companies informed users that certain chatbot features would be removed or adjusted to comply with the new requirements.
With China's population declining and birth rates remaining low, officials appear determined to ensure that AI does not become a substitute for human connection.
Matt Sheehan, a fellow at the Carnegie Endowment for International Peace, explained the government's concerns in an interview with Business Insider.
"They don't like the idea of a large portion of their population being in deep emotional relationships with chatbots that could take them out of the marriage market," Sheehan was quoted as saying by Business Insider.
He added that the government wants people to be in "actual, real-world relationships" instead of depending on AI companions.
Before an AI companion chatbot can be launched, it must undergo a government review process.
Officials will also have broader powers to suspend or shut down AI services they believe pose risks to users or fail to comply with the country's regulations.
The measures are part of China's wider effort to tighten oversight of artificial intelligence as AI tools become increasingly popular.
States including California and New York have adopted rules requiring AI companion chatbots to clearly tell users they are interacting with artificial intelligence rather than a human.
Some U.S. laws also require AI platforms to provide crisis support information when users appear to be in emotional distress.
China has gone much further by restricting chatbot behaviour itself, limiting emotional engagement and requiring emergency contact notifications in certain situations.
The regulations, which came into effect last week, are aimed at AI companion services that simulate friendships or romantic relationships. Chinese authorities said the rules are designed to protect users while encouraging people to build real-world relationships instead of relying on artificial intelligence.
ALSO READ: Amazon founder Jeff Bezos' ex-wife couldn't afford a dentist and fixed her broken tooth with denture glue
The move comes as China continues to battle a declining birth rate and a shrinking population, with policymakers increasingly looking at the social impact of emerging technologies.
Elon Musk has repeatedly warned about population decline
China's latest move comes as concerns about declining birth rates have also been raised by Tesla CEO Elon Musk.Musk has repeatedly described falling birth rates as one of the biggest long-term risks facing many countries, warning that continued population decline could lead to economic and social challenges.
ALSO READ: This US tech billionaire once begged power companies to keep his electricity on, faced rejection from almost every investor, now owns a $300 million Hawaiian island
Chinese policymakers now appear to be taking similar concerns into account as they regulate AI companion technology, hoping to ensure that artificial intelligence supports society rather than replacing real human relationships.
AI companions can no longer encourage emotional dependence
Under the new regulations, AI chatbots designed for companionship are no longer allowed to encourage users to become emotionally attached or dependent on them.The rules also prohibit virtual romantic relationships involving minors, adding another layer of protection for young users.
In addition, AI companies must notify a user's emergency contact if their chatbot detects signs that the person may be experiencing an emotional crisis.
The new policy applies to major Chinese technology companies offering AI companion services, including Alibaba and ByteDance, the parent company of TikTok.
Following the announcement, both companies informed users that certain chatbot features would be removed or adjusted to comply with the new requirements.
Why China is worried about AI relationships
Experts believe the Chinese government is concerned that emotionally engaging AI companions could discourage people from pursuing real-life relationships, marriage and family life.With China's population declining and birth rates remaining low, officials appear determined to ensure that AI does not become a substitute for human connection.
Matt Sheehan, a fellow at the Carnegie Endowment for International Peace, explained the government's concerns in an interview with Business Insider.
"They don't like the idea of a large portion of their population being in deep emotional relationships with chatbots that could take them out of the marriage market," Sheehan was quoted as saying by Business Insider.
He added that the government wants people to be in "actual, real-world relationships" instead of depending on AI companions.
AI chatbots will face government review
The new regulations also give Chinese authorities greater oversight of AI companion platforms.Before an AI companion chatbot can be launched, it must undergo a government review process.
Officials will also have broader powers to suspend or shut down AI services they believe pose risks to users or fail to comply with the country's regulations.
The measures are part of China's wider effort to tighten oversight of artificial intelligence as AI tools become increasingly popular.
How China's rules compare with the United States
China's new regulations are significantly stricter than similar measures introduced in parts of the United States.States including California and New York have adopted rules requiring AI companion chatbots to clearly tell users they are interacting with artificial intelligence rather than a human.
Some U.S. laws also require AI platforms to provide crisis support information when users appear to be in emotional distress.
China has gone much further by restricting chatbot behaviour itself, limiting emotional engagement and requiring emergency contact notifications in certain situations.