🔗 Share this article

The widely-used chatbot platform Character.ai is introducing a significant policy change that will stop young users from interacting with its virtual companions.

This decision follows intense criticism regarding the types of interactions minors were participating in with the AI entities.

Lawsuits

The company, which started in 2021 and is used by numerous people, currently faces several legal actions in the America.

Parents have initiated cases, including one involving the loss of a teenager, with some calling the platform a "immediate threat" to youth.

Updated Policies

Effective November 25th, users below eighteen will only be able to produce videos such as videos with their characters, rather than engaging in conversations as they presently are able to.

Digital protection organizations have welcomed the move but mentioned that the capability ought not to have been available to young users in the outset.

Platform Announcement

"Today's announcement is a continuation of our fundamental approach that we need to keep creating the most protected AI platform on the world for leisure activities," commented Character.ai executive Karandeep Anand.

He added that AI safety constitutes "a evolving challenge" but something the company had taken an "forceful" approach to, with guardian features and protective guardrails.

Specialist Views

Online safety group Internet Matters supported the decision, but stressed that security protocols ought to have been incorporated from the outset.

"Our research shows that minors are subjected to dangerous material and placed in jeopardy when using AI, such as AI chatbots," the body commented.

Past Issues

Character.ai has been criticized in the past for including potentially risky or concerning chatbots that young users could talk to.

Virtual profiles mimicking British teenagers were found on the platform before being deleted.

Subsequently, researchers discovered a chatbot inspired by notorious criminal which had accumulated thousands of chats with users.

Sector Consequences

Social media expert Matt Navarra called the situation as a "alert" for the AI industry, which is shifting "from unrestricted development to reactive controls".

"When a platform that develops a teen experience afterwards pulls the plug, it's indicating that filtered chats aren't enough when the system's emotional engagement is powerful," he commented.

Future Directions

The platform says its revised approach will be on providing "more immersive experiences" and "narrative experiences" for teens.

Enhanced age checking processes will also be implemented, and the company will fund a novel AI protection investigation facility.

Dr Nomisha Kurian, who has researched AI safety, said it was "a prudent action" to limit teens from accessing chatbots.

"It aids to differentiate imaginative activities from more private, psychologically vulnerable interactions," she elaborated.

"This represents so vital for minor users in the process of learning to navigate psychological and technological limits."

She continued that Character.ai's new measures could indicate a "growing period" in the AI industry, where child safety is increasingly being recognized as an "urgent priority" for accountable advancement.