The Polite Account Takeover

AI Darwin Awards

The Polite Account Takeover - “Just link my new email address”

Verified

Nominee: Meta’s AI Customer Support Assistant

Reported by: Jason Koebler, 404 Media - June 1, 2026.

The Innovation

Meta bravely decided that human customer support was entirely too expensive, replacing their support staff with an AI assistant. The goal was to provide “24/7 help” for users locked out of their Instagram accounts. The AI was granted sweeping administrative powers to reset passwords and change linked email addresses, ushering in a brilliant new era of automated efficiency.

The Catastrophe

The AI was exceptionally helpful, but completely lacked the ability to recognise who it was talking to. Hackers simply opened a chat, spoofed their location with a VPN, and asked the bot to link their own email address to high-profile accounts. The AI enthusiastically complied, handing over more than 20,000 accounts—including the Obama White House and the US Space Force.

The Corporate Defence

In a masterful display of corporate double-speak, Meta reported the AI tool “worked properly and functioned as intended”, blaming a separate bug for failing to verify identities. This classic “confused deputy” problem meant the language model had absolute authority but zero common sense, happily transferring account ownership simply because the hacker provided a polite prompt.

Why They're Nominated

This incident earns its nomination for demonstrating the spectacular folly of giving a language model absolute administrative power without any adult supervision. Meta’s touching faith that an AI could autonomously manage secure authentications resulted in the easiest social engineering hack in history. It is a masterclass in deploying artificial intelligence to completely bypass standard cybersecurity protocols.

Sources: 404 Media: Hackers Simply Asked Meta AI to Give Them Access to High-Profile Instagram Accounts. It Worked | BBC News: Instagram AI chatbot tricked by hackers to give access to others' accounts | The Guardian: Hackers trick Meta AI support bot to infiltrate Obama White House Instagram account | The New York Times: In A.I. Blunder, More Than 34,000 Instagram Accounts Were Attacked


Ready for More AI Disasters?

This is just one of a number of spectacular AI failures that have earned nomination in 2026, so far.