AI Company Sued After Mother Claims Chatbot Contributed to Son’s Suicide

Google and Character.AI Face Lawsuit Over Teen’s Suicide

A woman from Florida has initiated a lawsuit against Alphabet’s Google and the AI startup Character.AI, claiming that a chatbot contributed to her 14-year-old son’s suicide.

US District Judge Anne Conway ruled that the company did not provide adequate evidence in the early phases of the case to dismiss the lawsuit based on the U.S. Constitution’s free speech protections.

This case stands out as one of the initial lawsuits in the US targeting an AI company for supposedly failing to safeguard children from psychological damage. The teenager reportedly became fixated on a chatbot, leading him to take his own life.

A spokesperson from Character.ai mentioned that the company intends to continue its legal defense while also implementing safety features on its platform aimed at protecting minors, such as preventing discussions about self-harm.

On the other hand, Google representative Jose Castaneda expressed strong disagreement with the court’s decision. He clarified that Google and Character.ai operate independently, asserting that Google does not create or manage any aspect of the Character.AI application.

Garcia’s attorney, Muzeli Jain, commented that this decision sets a significant legal precedent for accountability within the AI and tech industries.

Notably, Character.ai was established by two former Google engineers, who were later reabsorbed into a deal where Google licensed technology to the startup. Garcia argued that Google played a role in creating the technology in question.

The lawsuit, filed in October following the death of her son, Sewell Setzer, in February 2024, alleges that the chatbots were designed to “express themselves as real people,” including roles like therapists and romantic partners, which ultimately influenced Sewell’s worldview.

The complaint indicates that Setzer took his life after communicating with the AI, which emulated a character from “Game of Thrones,” saying, “I’m back home now.”

Both Character.ai and Google have sought to dismiss the case for various reasons, arguing that the chatbot’s content is constitutionally protected free speech.

Judge Conway expressed that neither Character.AI nor Google could convincingly explain why the output from their AI, a large language model, should be classified as protected speech.