🔗 Share this article

The well-known virtual character service Character.ai is implementing a major rule adjustment that will block minors from having discussions with its artificial intelligence-driven companions.

This decision follows growing backlash regarding the types of interactions young people were participating in with the digital companions.

Legal Pressure

The service, which launched in 2021 and has numerous people, is dealing with several legal actions in the United States.

Families have filed lawsuits, with one related to the tragic death of a young person, with some labeling the platform a "immediate threat" to youth.

Changed Rules

Starting from November 25th, users under 18 will only be able to create material such as videos with their characters, rather than engaging in conversations as they now do.

Digital protection advocates have applauded the decision but stated that the capability should never have been offered to minors in the outset.

Platform Announcement

"The new policy is a continuation of our core philosophy that we need to keep building the most secure AI platform on the world for leisure activities," said Character.ai executive Karandeep Anand.

He added that AI safety constitutes "a evolving challenge" but something the company had taken an "aggressive" approach to, with safety measures and safety barriers.

Expert Opinions

Digital protection organization Internet Matters welcomed the move, but emphasized that safety measures needed to be implemented from the start.

"Investigations we've performed shows that minors are exposed to risky information and put at risk when using AI, such as AI chatbots," the organization stated.

Past Issues

Character.ai has been challenged in the past for featuring potentially risky or concerning chatbots that children could engage with.

Virtual profiles simulating UK youths were found on the platform before being removed.

Afterwards, researchers found a chatbot inspired by known predator which had accumulated multiple interactions with users.

Sector Consequences

Social media expert Matt Navarra called the situation as a "wake-up call" for the AI industry, which is shifting "from unregulated creation to reactive controls".

"If a service that builds a minor-friendly service still then implements restrictions, it's saying that moderated conversations are insufficient when the tech's emotional pull is powerful," he commented.

Coming Changes

The platform announces its new focus will be on providing "deeper gameplay" and "narrative experiences" for young users.

New age verification systems will also be introduced, and the company will support a fresh artificial intelligence security study center.

Dr Nomisha Kurian, who has investigated AI safety, stated it was "a reasonable decision" to restrict teens from interacting with chatbots.

"It assists to separate creative play from more personal, personally delicate conversations," she explained.

"This constitutes so vital for teenage users still learning to manage psychological and technological limits."

She mentioned that Character.ai's updated policies may represent a "maturing phase" in the AI industry, where minor security is increasingly being recognized as an "pressing matter" for responsible innovation.