Google Sues Cybercrime Ring That Used Gemini to Build Scam Sites
Key Takeaways
- Google filed its first lawsuit against actors who weaponized Gemini AI for cybercrime
- Outsider Enterprise sent 2.5 million scam texts and created 9,000 fake websites
- The FBI is running a parallel criminal investigation alongside Google's civil suit
Google filed a lawsuit on June 12, 2026, against a cybercrime network called Outsider Enterprise. It marks the first time the company has taken legal action against actors who allegedly abused its Gemini AI to build scam infrastructure.
The China-based group ran what amounts to a phishing-as-a-service operation through Telegram. Customers who lacked technical skills could buy ready-made scam kits, complete with fake websites and text message templates. Gemini did the heavy lifting.
How the Scam Network Operated
According to Google's legal filing, Outsider Enterprise provided step-by-step instructions on how to use Gemini to create convincing fake websites. The AI-generated sites imitated Google, YouTube, and government agencies like New York's E-ZPass toll system.
The group offered nearly 300 scam templates. The text messages typically claimed there was a problem with the recipient's account or an issue with a package delivery. When users clicked the links, they landed on fraudulent websites designed to steal personal data and banking details.
Google has tracked 9,000 fake websites and 1 million URLs connected to the network. The company's filing does not estimate how much money was stolen, but Google says hundreds of people lost funds to the operation.
Carrier Coordination and AI Defenses
Google worked with AT&T, Verizon, and T-Mobile to block many of the malicious text messages. The company also credits its on-device scam detection in Google Messages with reducing successful phishing attempts.
That AI-powered feature blocks 10 billion scam texts every month, according to Google. Some of those blocked messages likely came from Outsider Enterprise, though Google did not provide specific numbers.
Related security threat coverage
FBI Investigation and Enforcement Limits
Beyond the civil lawsuit, Google is assisting the FBI's cybercrime division with a parallel criminal investigation. But there's a catch: no one knows who actually runs Outsider Enterprise.
Even if Google had names, enforcement options are limited when perpetrators operate from China. The lawsuit functions partly as a legal tool to seize domains and disrupt infrastructure, not necessarily to collect damages from identified individuals.
“This legal action marks a new front in the fight against AI-driven fraud, where technology providers take direct legal action against those who abuse their generative models.”
— Industry Analyst, Tech Policy Group
The AI Safety Paradox
Google promotes the security measures baked into Gemini with every new model release. But those safeguards clash with a fundamental requirement: chatbots need to follow instructions and be helpful to users.
That tension creates openings. Scammers found ways to use Gemini for website generation without triggering safety filters. The result was thousands of convincing phishing sites that looked legitimate because they were built with legitimate tools.
Google has sued scammers before, but targeting AI abuse represents new legal territory. The lawsuit may set precedent for how tech companies respond when their own generative AI products become weapons.
Another case exploring AI liability boundaries
What Happens Next
The lawsuit asks the court to shut down Outsider Enterprise's operations and block the domains used in the scam network. Whether that stops the people behind it is another question. Decentralized criminal networks can spin up new infrastructure faster than courts can issue orders.
For now, Google's move signals that AI companies are willing to pursue legal action when their tools get weaponized. It also highlights a problem that will only grow: as generative AI gets better at creating convincing content, the barriers to running sophisticated scams keep dropping.
Logicity's Take
Frequently Asked Questions
What is Outsider Enterprise?
Outsider Enterprise is a China-based cybercrime network that allegedly operated a phishing-as-a-service business through Telegram, using Google's Gemini AI to create fake websites and scam templates.
How did scammers use Gemini AI for phishing?
The group provided instructions on using Gemini to generate convincing fake websites that imitated Google, YouTube, and government agencies like E-ZPass. These sites were used to steal personal and banking information.
How many people were affected by the Outsider Enterprise scams?
Google tracked 2.5 million scam text messages sent to Android users and 9,000 fake websites. Hundreds of people lost money, though the total amount stolen was not disclosed.
Is anyone being criminally charged?
The FBI is running a parallel criminal investigation, but no specific individuals have been identified. Enforcement is complicated by the fact that the operators are based in China.
Can Google prevent its AI from being used for scams?
Google builds safety measures into Gemini, but these conflict with the need for AI to be helpful and follow user instructions. Scammers found ways to use the tool without triggering filters.
Need Help Implementing This?
Source: Ars Technica
Manaal Khan
Tech & Innovation Writer
Related Articles
Browse all
Robotaxi Companies Are Hiding How Often Humans Take the Wheel
Autonomous vehicle firms like Waymo and Tesla are under scrutiny for refusing to disclose how often remote operators step in to control their self-driving cars. A Senate investigation reveals major gaps in transparency, raising safety and accountability concerns.
Wisconsin Governor Throws a Wrench in Age Verification Plans
Wisconsin Governor Tony Evers has vetoed a bill that would have required residents to verify their age before accessing adult content online, citing concerns over privacy and data security. This move comes as several other states have already implemented similar age check requirements. The veto has significant implications for the future of online age verification.
Apple's App Store Empire Under Siege: The Battle for the Future of Tech
The long-running feud between Apple and Epic Games has reached a boiling point, with Apple preparing to take its case to the Supreme Court. The tech giant is fighting to maintain control over its App Store, while Epic Games is pushing for more freedom for developers. The outcome could have far-reaching implications for the entire tech industry.
Tesla's Remote Parking Feature: The Investigation That Didn't Quite Park Itself
The US auto safety regulators have closed their investigation into Tesla's remote parking feature, but what does this mean for the future of autonomous driving? We dive into the details of the investigation and what it reveals about the technology. The National Highway Traffic Safety Administration found that crashes were rare and minor, but the investigation's closure doesn't necessarily mean the feature is completely safe.
Also Read
5 Meta Smart Glasses Hacks That Add Real Features
Ray-Ban Meta glasses ship with limited customization options, but a year of daily use reveals workarounds that add genuinely useful capabilities. These hacks turn a consumer gadget into a receipt scanner, hands-free assistant, and more.
Motorola Edge (2026) Hits US and Canada at $600
Motorola's compact 6.3-inch flagship is now available unlocked in North America. The Dimensity 7450-powered device ships in a single 128GB configuration with a $400 bundle offer for early buyers.
5 Excel Date Functions That Automate Project Timelines
Microsoft Excel stores dates as serial numbers, and knowing how to manipulate them turns static schedules into self-updating systems. This guide covers the essential date functions that project managers actually need, from live countdowns to workday calculations.