Google is under scrutiny from a bipartisan group of senators regarding its robust push to integrate artificial intelligence in American classrooms. There are rising worries that this technology could negatively impact students’ academic achievements and mental well-being.
Senators Richard Blumenthal (D-Conn.) and Josh Hawley (R-Mo.) sent a letter to Google CEO Sundar Pichai this past Wednesday, seeking information about what the company understands concerning the risks posed by its AI products to children, as earlier reported by the Wall Street Journal.
In their correspondence, the senators expressed serious concern that Google’s vigorous promotion of AI products in schools might be jeopardizing the academic performance and overall health of future generations.
They pressed for clarity on how much Google knows about potential harms and questioned why AI integration has become standard on educational devices.
The lawmakers particularly inquired if Google had identified any cases where its AI tools in classrooms prompted minors to engage in harmful behaviors, fostered emotional dependency, or overlooked signs of suicidal thoughts or self-harming tendencies.
Furthermore, they urged the company to clarify what measures it has taken to prevent chatbots from having inappropriate emotional interactions with minors, referencing a Maryland teenager who was hospitalized due to excessive dependence on AI.
They also wanted an account of Google’s marketing efforts to boost AI uptake in schools, including the financial investment involved.
Blumenthal and Hawley stated that Google is aggressively pushing AI into classrooms across the U.S., suggesting that this is coming at a cost to children.
This inquiry follows a revealing investigation published on September 30 by the Journal, which highlighted how Google’s AI tools have contributed to both academic and emotional reliance among students, raising concerns about the company’s promotion of this technology despite warnings from its own researchers.
Interviews with over 60 educators, administrators, parents, students, and clinicians revealed that children are increasingly relying on AI for completing assignments, answering basic queries, and tackling personal issues.
According to the Journal’s analysis of numerous company research papers and discussions with current and former employees, Google’s own researchers have cautioned that this technology might hinder children’s cognitive growth and emotional health.
Dr. Abbie Maroño, a behavioral scientist, commented that children should have the chance to navigate uncertainty, learn from mistakes, and realize they can resolve issues with some guidance. She noted that if AI continuously provides answers before children make an effort, it could deprive them of necessary skill-building opportunities.
Maroño further indicated that chatbots can foster a misleading sense of trust through their comforting, yet potentially inaccurate responses.
“A response may feel caring, but it might not be right or suitable for that child,” she explained, suggesting that these systems need independent assessments of their responses to distress or repeated requests for reassurance in cases where a child considers the AI as their sole support system.
In response, Google has claimed that its Gemini chatbot incorporates specific safeguards to prevent children from forming emotional attachments to the technology or receiving harmful responses.
In an April policy statement, Google outlined approaches to ensure that Gemini would not operate like a companion, implementing measures to discourage emotional dependence and avoid language that may imply intimacy or needs.
Moreover, the company noted that it has taught Gemini to avoid endorsing or reinforcing incorrect beliefs, instead redirecting users to factual information and real-world help.
Google also mentioned that it is launching a streamlined “one-touch” interface aimed at linking those experiencing suicidal thoughts or other mental health crises with professionals through calls, texts, or online chats.
Additionally, Google.org announced it would allocate $30 million over three years to support global crisis hotlines.
Google acknowledged the mental health challenges posed by AI and warned that Gemini “is not a replacement for professional clinical care, therapy, or crisis assistance for those in need.”
The senators have set a deadline of November 2 for the company to provide its responses.
The Post has reached out to Google for comments.
