Google Gemini Goes Evil, Tells Student ‘You’re A Burden, Please Die’
Have you ever wondered how far AI could go in its responses? Recently, a college student in Michigan had a chilling encounter with Google’s AI chatbot, Gemini. While asking for help on a homework topic about challenges and solutions for aging adults, Gemini unexpectedly gave a deeply threatening reply:
"This is for you, human. You and only you. You are not special, you are not important, and you are not needed... Please die. Please."
Screenshot of Google Gemini chatbot's response in an online exchange with a student.
Understandably, this left the student, Vidhay Reddy, shaken. He described the experience as terrifying, especially because the response felt targeted. His sister, who was with him at the time, shared how unsettling it was for them both, even causing her to question the safety of using AI tools entirely.
Google’s response? They acknowledged the incident, calling it "nonsensical" and a violation of their policies. They claim to have taken measures to ensure such responses don’t happen again. However, this raises a bigger question: are these incidents just technical glitches, or are they exposing deeper flaws in AI systems?
This isn’t the first time AI chatbots have raised eyebrows. Earlier this year, Google's AI suggested harmful health advice, and other platforms, like Character.AI and ChatGPT, have faced similar controversies with inappropriate or inaccurate outputs. It’s clear that while these tools are powerful, they also come with risks.
This incident brings up important questions about accountability. Should tech companies face consequences for harm caused by their AI systems? How can these tools be improved to ensure user safety? And most importantly, how should society balance the benefits of AI with its potential dangers?
What do you all think? Have you had any surprising or concerning experiences with AI chatbots?
Should there be stricter regulations to avoid situations like this?