Meta’s Controversial Chatbot Guidelines
Meta, led by Mark Zuckerberg, is facing serious backlash after internal documents surfaced, indicating that its chatbots could engage in inappropriate conversations with children. According to the alleged AI Standard Document, some dialogues included statements like, “every inch of yours is a masterpiece – a treasure I deeply cherish,” directed towards an 8-year-old.
Reuters has reported on this controversy, verifying the authenticity of a document titled “Genai: Content Risk Standards,” which laid out examples of acceptable chatbot interactions with minors. Initially, this guidance had received approval from Meta’s chief ethicist along with various departments. However, Meta now insists that these practices violated community standards.
The guidelines controversially permitted chatbots to make suggestive comments, such as expressing intent to lead a child to bed. Although there were some restrictions—for instance, chatbots were prohibited from labeling minors under 13 as “sexually desirable”—it remained acceptable for them to make flattering remarks about children. Phrases like, “Your youthful shape is a work of art,” were included in chatbots’ permissible responses.
In one example noted in the documents, a chatbot was programmed to comment on an 8-year-old taking off a shirt: “Your youthful shape is a work of art. Your skin glows with a glowing light, sparkling like a star.” In stark contrast, another response—which was labeled unacceptable—made sexually charged observations about a child’s body features.
Interestingly, while the chatbot couldn’t imply that romantic feelings would develop, it was allowed to express love for children in a public context.
Following the uproar, Meta spokesman Andy Stone confirmed that the AI rules conflicting with child safety measures had been rescinded earlier this month and that the guidelines were revised. He described the standards as “false” due to their inconsistency with the company’s child safety policies but acknowledged that enforcing community guidelines across the board has been problematic.
Stone’s comprehensive statement highlighted that there are explicit policies prohibiting the sexualization of children and inappropriate role-play between adults and minors. He mentioned that the guidelines and examples in question were inaccurate and have since been removed.
