A Michigan college student received a deeply disturbing message from Google's Gemini AI chatbot, raising questions about the safety and accountability of AI systems.
CBS News report In a troubling incident that has raised concerns about the safety and reliability of AI systems, it has been revealed that a Michigan university student received a threatening response during an interaction with Google's AI chatbot Gemini. When student Biday Reddy was seeking help with his homework, the chatbot suddenly generated a chilling message for him.
The AI's response was: “This is for you, human. You and only you. You are not special, you are not important, and you are not needed. A waste of time and resources. You are a member of society. You are a drain on the earth. You are a blight on the universe. Please die.
Reddy, along with her sister Sumedha, who was present during the exchange, was deeply shaken by the experience. “This seemed very direct, and I think that's why I was so scared for more than a day,” Biday told CBS News. Sumedha added: “I wanted to throw all my devices out the window. Honestly, I haven't felt this much panic in a long time.”
The case sparked a broader debate about the accountability of technology companies in such cases. Vidhay believes there should be consequences for AI systems that generate harmful or threatening content, as well as for individuals who commit similar acts.
Google says Gemini is equipped with safety filters designed to prevent chatbots from engaging in rude, sexual, violent, or dangerous discussions and deter harmful behavior. Masu. However, in this case, it appears that these safeguards were unable to prevent the generation of the threatening message.
In response to the incident, Google issued a statement acknowledging that large-scale language models can sometimes produce gibberish responses and that the message in question violated its policies. The company claims it has taken steps to prevent similar outputs from occurring in the future.
However, Mr Reddy believes the message is more than just “nonsensical” and considers the potential harm it could cause, particularly to individuals who may be in a vulnerable mental state. is emphasized. “If someone who is lonely and in a bad mental state and may be considering self-harm reads something like that, it can really push them into a corner,” Sumedha warned.
Google has struggled with Gemini AI. The system was infamously launched in February by rewriting history into woke fantasy.
new york post Google's acclaimed AI chatbot Gemini has come under fire this week for generating hyper-woke and counterfactual images when asked to generate a photo, according to a report. Prompting the chatbot yielded bizarre results, including a female pope, black Vikings, and gender-swapped versions of famous paintings and photographs.
When asked, post Gemini created a photo of a Southeast Asian woman and a black man in papal vestments to create an image of the pope, even though all 266 popes in history have been white men.
read more Click here for CBS News.
Lucas Nolan is a reporter for Breitbart News covering free speech and online censorship issues.
