🔗 Share this article

The widely-used AI conversation site Character.ai is enforcing a substantial restriction that will prevent young users from interacting with its AI-powered characters.

This action is in response to widespread concern regarding the types of interactions teenagers were participating in with the digital companions.

Lawsuits

The service, which started in 2021 and has countless individuals, currently faces multiple lawsuits in the United States.

Families have initiated cases, among them concerning the loss of a young person, with some labeling the platform a "immediate threat" to teenagers.

New Restrictions

Effective November 25th, users under 18 will only have permission to create material such as videos with their characters, rather than chatting as they now do.

Online safety advocates have welcomed the move but expressed that the capability was inappropriate to be offered to children in the first place.

Official Response

"This decision is a part of our fundamental approach that we need to keep developing the most protected AI platform on the globe for entertainment purposes," said Character.ai executive Karandeep Anand.

He added that AI safety constitutes "a moving target" but something the company had taken an "aggressive" approach to, with guardian features and preventive measures.

Expert Opinions

Digital protection organization Internet Matters approved the move, but stressed that security protocols should have been incorporated from the beginning.

"Investigations we've performed demonstrates that minors are exposed to dangerous material and put at risk when using AI, particularly AI chatbots," the body commented.

Past Issues

Character.ai has been questioned in the past for including potentially risky or offensive chatbots that children could engage with.

Digital representations impersonating UK youths were discovered on the service before being deleted.

Afterwards, reporters identified a chatbot inspired by convicted sex offender which had accumulated numerous conversations with users.

Industry Impact

Online expert Matt Navarra called the announcement as a "alert" for the AI industry, which is transitioning "from permissionless innovation to post-crisis regulation".

"When a platform that creates a youth-focused platform afterwards makes changes, it's demonstrating that moderated conversations aren't enough when the tech's emotional pull is strong," he commented.

Future Directions

The company announces its updated direction will be on providing "enhanced interactive features" and "character-driven stories" for teenagers.

New age verification systems will also be introduced, and the platform will fund a fresh artificial intelligence security study center.

An expert in digital protection, who has investigated AI safety, stated it was "a reasonable decision" to restrict teenagers from interacting with chatbots.

"It assists to differentiate imaginative activities from more intimate, psychologically vulnerable conversations," she explained.

"This is so vital for minor users still learning to manage psychological and technological boundaries."

She continued that Character.ai's updated policies may represent a "growing period" in the AI industry, where youth protection is gradually being acknowledged as an "urgent priority" for responsible innovation.