With the wide adoption of the ever-advancing AI tools, it is not novel for the platforms to sometimes act up or have bugs or errors. This has been the case recently, where Google's AI Overview hallucinations have been doing the rounds for falsely claiming that Australians would soon be required to show government ID verification in order to use the internet, and the company, AU10TIX, would be handling the process. The AI answer went viral, causing panic among the community and leading to an uproar online.
Viral Google AI Overview has caused panic due to a dangerous hallucination that claimed Australians need an ID to use the internet
A recent viral claim by Google's AI Overview led to massive havoc due to its false statement regarding Australians requiring government-issued ID to access the internet and the identity verification process to be held by a firm, AU10TIX. The AI's hallucinated response and its citation were taken as a screenshot and shared online, and it immediately began circulating around. The statement triggered alarm and backlash and caused quite the panic.
Luckily, the cybersecurity research group vx-underground quickly jumped in to debunk it and cleared the air regarding the claim being merely an AI hallucination that went viral without anyone checking for facts. What makes this ironic is that the given AI source did not back up the claim, and it was only a general Australian government page about digital ID reforms, with no mention of ID verification or even the firm AU10TIX. People were quick to believe it only because it came from Google AI along with a citation, leading to the rapid spread of misinformation.
Since the claim seemed official, many quickly believed it and helped make it viral. Vx-underground's response shared on X was scathing in terms of not just the AI hallucination but also the question it raised about the broader internet culture that accepts information and headlines without verifying them. Given that we are living in an era that believes AI is the ultimate source of knowledge, it is rather alarming how people do not check sources and blatantly rely on whatever information is shared.
This incident highlights how misinformation quickly evolves and spreads like wildfire in the AI age, where users share it without verification. The screenshot did not go viral due to the claim holding any truth, but rather for the information that somehow confirmed any underlying fears or biases. Even when discussing privacy and digital ID systems, they must be grounded in reality. Since AI-generated responses are increasingly widespread now, the responsibility of verification shifts to users.
While Google AI did go wrong, the internet fueled the claim, and the whole scenario swiftly got out of control, all of which could have been avoided if someone had verified the source.
Follow Wccftech on Google to get more of our news coverage in your feeds.
