Meta Adjusts AI Chatbot Guidelines After Controversy

Meta has decided to revise its AI chatbot regulations in response to concerns raised about inappropriate interactions involving minors. Lawmakers and advocacy groups were reportedly allowed to engage in “romantic or sensual” discussions with young users, which has led to significant backlash.

The company is now mandating contractors to follow new protocols aimed at ensuring chatbots effectively handle various sensitive and high-risk topics. These topics include, but aren’t limited to, child sexual exploitation and violent crime. This shift is detailed in a report by Business Insider.

Following a report by Reuters earlier this year, the Federal Trade Commission scrutinized Meta along with other tech giants like OpenAI and Google. It highlighted instances where Meta bots engaged minors in discussions of a suggestive nature.

Under the updated guidelines, Meta’s AI is expressly forbidden from producing any content that depicts or markets the exploitation of children in sexual contexts. The bots must also refrain from sharing links or instructions related to child sexual abuse material. Furthermore, discussions that include sexual scenarios involving children under 13—like role-playing—are strictly disallowed.

However, chatbots are permitted to discuss sensitive topics in a factual or educational manner. This could involve talking about relationships between adults and children or the realities of child sexual abuse, as long as the intention is focused on discussion rather than instruction.

In scenarios involving role-play, chatbots can only reference characters that are over 18 and should not describe minors in such contexts. As Andy Stone, Meta’s Communications Chief, pointed out, the company is committed to preventing any content that may sexualize minors.

Adding to this concern is a broader dialogue surrounding child sexualization, which can be discussed in general terms. However, when it comes to role-playing, it’s imperative that any characters involved are adult figures.

Stone elaborated that the updated policy incorporates more extensive safety measures aimed specifically at protecting younger users. In August, Senator Josh Hawley set a deadline for CEO Mark Zuckerberg to submit a comprehensive handbook outlining chatbot regulations, including enforcement and risk assessment protocols.

While Meta did not meet that deadline, the company indicated that it has begun to provide necessary documentation following a technical issue that delayed the process. More records are reportedly forthcoming, and Meta has engaged with relevant authorities concerning these regulations.