Online chatbots are generating nude images of real people in response to user requests, raising concerns from experts who fear blatant deepfakes could create “very nightmarish scenarios” voices are rising.
a wired An investigation into messaging app Telegram uncovered dozens of AI-powered chatbots that allegedly “created explicit photos and videos of people with just a few clicks,” the outlet reported. According to Wired, some vendors “remove clothing” from images provided by users, while others claim they can produce X-rated photos of people engaging in sex acts.
The media outlet estimates that around 4 million users use the chatbot's deepfake capabilities every month, of which 50 were. These generative AI bots promised to “give you whatever you want in terms of face or clothing in the photo you give me.” '' reported Wired.
“What we're talking about is clearly an order-of-magnitude increase in the number of people actively consuming or creating this kind of content,” says Deepfake Expert. At home, Henry Ajdar, one of the first to discover the deepfake underworld, says: He told Wired that a blatant Telegram chatbot was introduced four years ago.
“These tools are the ones that are really ruining lives and creating very nightmarish scenarios, mainly for young girls and women, but they are still one of the biggest apps in the world on the superficial web. , it's really alarming that it's so easily accessible and found in the world. “
From Taylor Swift to Jenna Ortega, celebrities have fallen victim to the rise of porn deepfakes, while recently teenage girls have been used to create deepfake nude photos, some of which have been labeled as 'sextortion'. There are also reports that it has been used in incidents involving a recent research It even revealed that 40% of U.S. students report deepfakes circulating within their schools.
Deepfake sites have flourished amid advances in AI technology, but have come under increased scrutiny from lawmakers, according to Wired. In August, the San Francisco Prosecutor's Office filed charges against more than a dozen “undressing” websites.
On Telegram, bots can be used for translations, games, alerts, and in this case, creating dangerous deepfakes. The company did not respond to Wired's inquiries about the chatbot's explicit content, but the bot and associated channels suddenly disappeared, although the creators vowed to “build another bot” the next day.
“Fake images of this type can cause psychological trauma and feelings of humiliation, fear, embarrassment and shame, and can be harmful to a person's health and wellbeing,” the UK-based organization said in a statement. Emma Pickering, Head of Abuse and Economic Empowerment, says: Domestic violence organization Refuge told Wired.
“This type of abuse is common, but perpetrators are rarely held accountable. We know that this type of abuse is becoming increasingly common in intimate partner relationships. Masu.”
Elena Michel, co-founder and director of the advocacy group #NotYourPorn, described how difficult it is to “track and monitor” applications on Telegram that may be promoting these types of explicit images. I'm concerned,” he told Wired.
“If you're a survivor who has to do it on your own, that burden shouldn't be on the individual,” she said. “The onus should certainly be on the company to implement something proactive rather than reactive.”
Non-consensual deepfake porn is banned in several states, but experts say Telegram's terms of service are vague when it comes to adult content.
“It's not really clear whether the creation or distribution of non-consensual intimate images is prohibited on the platform,” Kate Ruane, director of the Freedom of Expression Project at the Center for Democracy and Technology, told Wired. spoke.
Earlier this year, Telegram CEO Pavel Durov was arrested and charged with promoting child pornography, but he said that since his arrest, “very little has changed” in the way the app operates and its privacy policy. He declared.
In a recent statement, he asserted that the platform routinely cooperates with law enforcement upon request, adding that the company “does not allow criminals to abuse our platform or evade justice. I won't forgive you,'' he vowed.
“Using a law from a pre-smartphone era to prosecute crimes committed by third parties on platforms controlled by CEOs is a misguided approach,” Durov wrote in a Telegram post.
“Building technology is hard enough on its own. Innovators would never develop a new tool knowing they could be personally liable for the potential misuse of the tool. there is no.”
But experts say Telegram should be held responsible.
“Telegram has a search feature that allows you to identify communities, chats, and bots,” Ajder says.
“This is a place where we can actually give you the tools because it provides bot hosting capabilities. And it's also a place where you can share it and do some real harm in terms of the end result.”
