Concerns Over Google’s AI-Powered Search in Schools

A recent report by the child safety organization Common Sense Media has raised alarms about Google’s AI-enhanced search, suggesting it poses significant risks to young users. The report is urging educators to reconsider the usage of Google products until these AI features can be switched off.

According to Common Sense Media, the integration of artificial intelligence into Google’s platform can expose students to uncertain generative AI technologies without adequate protections. Robbie Torney, the senior director of AI programs at the organization, highlighted Google’s significant presence in the education sector, noting that millions of students—ranging from kindergarten to graduate school—rely on Google products daily.

The report particularly emphasizes worries surrounding Google’s new AI search mode, which is being made available to all users, including educational accounts. Experts caution that this differs markedly from other Google AI tools where age restrictions are in place. Amanda Bickerstaff, a deputy director in AI for Education, described AI mode as a potential gateway for students to interact with unsecured generative AI content.

Bickerstaff expressed that younger students should not be exposed to features like AI Overview or AI mode, stating, “When teaching AI literacy, the first step is to be intentional. These modes are the opposite.” She advocates for students to seek verified information rather than automated responses.

Research has shown various issues with Google’s AI tools. These AI-generated summaries are often inaccurate, with such problems identified early in their deployment. This design lends an air of authority, which could mislead children who might not discern that they are receiving AI-generated information instead of validated content.

Common Sense Media’s findings indicate that Google’s AI features can easily assist underage users with their homework. Experts warn about the risks posed by the combination of misleading interfaces and the reassuring nature of chatbots, which could lead students to cheat unknowingly or at the very least hinder their learning process. Bickerstaff characterized the infusion of AI as unsuitable for development and potentially harmful to educators’ efforts to enhance students’ literacy skills.

The dilemma for schools intensifies as Google does not allow for the disabling of AI features while still keeping access to search. Parents can entirely block Google.com or disable search for accounts they oversee. Administrators could take similar actions for educational accounts; however, this would completely cut off access to Google Search for all users, creating a challenging scenario for educators, Bickerstaff commented.

In response to the report, Google stated that the assessments conducted by Common Sense Media were limited and not effective in evaluating product safety or utility. Torney noted that the organization did not specifically test educational accounts, only general user accounts, but emphasized that the AI search experience is consistent across all types of users.

David Monaghan, campaign director for Fair Play for Kids, condemned the report’s findings by asserting that Google’s AI Overview and AI Modes jeopardize children’s education and expose them to harmful misinformation. He suggested that if Google isn’t willing to disable AI features for students, schools should refrain from using the company’s products entirely.

Anya Meksin, deputy director for Schools Beyond Screens, remarked that the report could serve as a crucial wake-up call for school districts. Her organization has previously worked on instituting new tech policies, including restrictions on screen time for younger grades.

Meksin expressed disbelief at the way big tech encroaches on public education, saying, “We must treat this as an emergency. Education is foundational to our democracy, and they are undermining our children’s ability to challenge these companies in the future.”

She pointed out that school districts could inadvertently breach their own AI regulations due to the technology embedded in their systems. For instance, while LAUSD has a policy against underage students using generative AI, they might still access AI features via Google Search on school devices.

The potential legal repercussions for school districts could be serious. Alphabet, Google’s parent company, recently faced a wrongful death lawsuit following a user’s suicide linked to interactions with its AI, highlighting the possible liability for exposing children to detrimental products.

The ongoing dialogue around AI in education is further explored in Winton Hall’s book, which delves into the risks associated with introducing bias into classrooms through AI technologies.

Hall critiques how AI can propagate biases, using the example of Khan Academy’s AI assistant, and raises concerns about partnerships between educational platforms and elite universities, suggesting these relationships might influence students’ perceptions and decisions.

Such affiliations should raise alarms for parents, particularly as AI continues to become ingrained in educational systems.