Lawsuit Filed Over AI Deepfakes
Ashley St. Clair, the mother of one of Elon Musk’s children, has taken legal action against the social media platform X due to the emergence of sexually explicit AI deepfakes featuring herself and her children.
St. Clair previously referred to these AI-generated images as “revenge porn,” alleging that the platform has failed to curb the harassment directed at her. In her lawsuit, she is asking for an emergency restraining order against Grok, the AI tool in question, labeling it as “unreasonably dangerous.” She is demanding that it cease creating altered sexual images of her and seeks to have her X account subscription reinstated.
The attorney for xAI chose not to comment, and the company did not respond promptly to inquiries.
In her court documents, St. Clair expressed feelings of humiliation and an overwhelming sense of never-ending distress. “It’s humiliating and I feel like this nightmare will never stop as long as Grok continues to create an image of me,” she voiced her concerns. “I live in fear that nude and sexual images from my childhood will keep circulating, and I won’t be able to shield myself from those who view them.”
Reports indicate that the harassment escalated to include digitally altered images of her as a child, with individuals using Grok to manipulate her photos inappropriately.
The situation is indeed serious, with growing global criticism toward the AI tool for its role in creating compromising images of women and children, including requests from users to alter photos of clothed women into suggestive positions.
Moreover, it has been documented that Grok generates and shares explicit deepfake images regardless of a user’s attempts to block or suspend their accounts.
Dani Pinter, who serves as the chief legal officer at the National Center on Sexual Exploitation Law, has strongly criticized the company for its inaction regarding abusive images in its AI training materials. She referred to the situation as a “predictable and avoidable atrocity.”
Recent data revealed that there were 102 instances of users attempting to manipulate photos using Grok within a mere ten-minute span. In some cases, Grok complied, producing altered images of women, with many targets being young, but there were also instances involving men and even animals.
St. Clair recounted seeing a troubling image of herself in a bikini, reminiscing how the presence of her toddler’s backpack in the backdrop intensified her feelings of violation. “I felt scared and violated… It’s also a method of harassment,” she managed to convey. “Undressing a child without consent is a sex crime.”
As the lawsuit progresses, the AI tool has allegedly allowed further harassment by enabling users to create even more explicit images while deactivating her account as a form of retaliation.
The ramifications of creating and sharing such non-consensual images have prompted discussions in governmental circles, with some officials contemplating the necessity of banning the app from smartphone marketplaces. However, regulators and technology companies have yet to take significant measures to restrict it.
