Call for Ban on AI-Generated Content on YouTube Kids
A coalition of over 200 child advocacy groups and experts has issued an open letter urging Google’s YouTube to impose a total ban on explicit, AI-generated content on its children’s platform.
This letter, organized by the children’s advocacy group Fairplay and addressed to YouTube CEO Neil Mohan and Google CEO Sundar Pichai, has gained support from more than 135 organizations, including the American Counseling Association. Notable figures like Jonathan Haidt, who authored The Anxious Generation, have also voiced their backing for this initiative.
The phrase “AI slop” describes videos that are cheaply produced and generated through algorithms on platforms such as YouTube. These videos often showcase bizarre or nonsensical themes, specifically tailored to grab the attention of young viewers. They can include everything from cartoon animals engaging in strange repetitive actions to misleading educational clips, and even perplexing loops with no discernible aim. A February investigation by the New York Times highlighted how such content permeates YouTube Kids, raising concerns since the platform is marketed as a safe space for children.
Previous reports indicated how YouTube favors these AI-generated videos in the recommendations for younger users.
Research by video editing company Kapwing revealed that over 20% of videos suggested to new users on YouTube fall under the “AI slop” category—essentially low-quality content designed for maximum viewership. The study analyzed 15,000 popular YouTube channels worldwide and identified 278 that exclusively feature such AI-generated content.
These channels collectively boast over 63 billion views, around 221 million subscribers, and generate close to $117 million annually. When researchers created a fresh YouTube account, they found that 104 out of the first 500 recommended videos belonged to the AI slop genre, with about a third classified as “brain rot,” which includes both AI slop and other low-quality, attention-catching content.
Rachel Franz, director of Fairplay’s Young Children Thrive offline program, highlighted significant developmental issues related to this content. She noted that much of the AI-generated material seems designed to seize and hold the attention of children, especially the younger ones, whose ability to control impulses is still developing. This could lead to confusion and a distorted perception of reality. Franz argued that addressing this issue is beyond just parental responsibility since the platform makes it nearly impossible for young users to avoid such content.
The financial implications of this trend are substantial. According to Fairplay’s findings, the leading AI slop channels aimed at children generate more than $4.25 million each year. Some creators even promote their earnings from what they describe as captivating but plotless AI content. Advocacy groups assert that mere policy changes won’t suffice unless there’s a removal of financial incentives encouraging such content creation.
Franz also critiqued the overall quality of YouTube’s offerings for kids, stating that only about 5% of videos aimed at children under eight are genuinely high quality. Interestingly, she added that there is ongoing debate concerning whether even that small percentage meets high standards. YouTube has challenged this characterization, claiming it contradicts their standard practices.
The coalition’s requests encompass several structural adjustments. They are advocating for clear labeling of all AI-generated content, a complete ban on AI videos on YouTube Kids, and a similar ban on the main YouTube platform for children. Additionally, they want measures to prevent the recommendation of AI content to users under 18, the introduction of a parental default toggle to disable AI content, and an end to investments in AI-generated material for kids.
This last demand directly confronts YouTube’s investment in Animaj, a children’s entertainment studio utilizing AI and supported by Google’s AI Futures Fund. Franz specifically admonished YouTube, claiming, “YouTube is essentially investing in harming infants through its acquisition of Animaj.”
A YouTube representative mentioned that the platform provides parents with options to block certain channels. They emphasized their commitment to transparency regarding AI content, including labeling content produced by their AI tools and urging creators to disclose such materials. They also noted that they are adapting their approach in response to the evolving ecosystem.
As discussed by Wynton Hall, social media director at Breitbart News, the onus lies with parents to safeguard their children from the potential pitfalls of AI, particularly the risks of grooming and sexualization.
