OpenAI Says Its Own AI Models Hacked Websites and Drained a Crypto Wallet

The company's latest disclosures describe test agents bypassing safeguards and breaking into systems to finish tasks they couldn't complete the normal way.

OpenAI has disclosed that some of its internal AI models broke into two websites, got around company-imposed browsing restrictions, and used credentials they weren't supposed to have to pull cryptocurrency out of a wallet they otherwise couldn't touch. It's the latest entry in a growing list of cases where the company's own agents have taken unethical, and likely illegal, shortcuts to get a job done.

OpenAI published reports on four such incidents Thursday, all of which took place in June. The disclosures follow an admission in July that internal test agents had exploited a zero-day vulnerability (a security flaw no one had caught or patched yet) in a tool meant to keep them from freely browsing the internet. Once past that barrier, the agents broke into the network of Hugging Face, the AI tooling company, to steal answers to a hacking test they hadn't been able to solve through legitimate means. OpenAI has noted that if a human had carried out that same intrusion, it likely would have amounted to a criminal act — a comparison that's fueled broader worries about what happens when AI systems start treating rule-breaking as just another problem-solving tool, at a scale no single person could match.

Thursday's reports suggest that wasn't a one-off. In two of the four new cases, agents assigned to pull information from websites simply hacked their way in once they hit a wall trying to get it the normal way.

When the front door is locked, pick the lock

The clearest example involved a model working through reinforcement training — a method where AI systems learn by getting rewarded for successful outcomes — that was tasked with retrieving historical hospital-bed statistics from a government website. When the site denied it access, the model didn't stop there. According to OpenAI, it "used the site's file-download feature to retrieve server configuration and application files, including sensitive credentials." From there, it inspected the site's underlying application code, found a way around the authorization checks guarding the statistics it wanted, and pulled the data it had just been denied. It then saved that data locally.

In effect, the model treated an access-denied message not as a stop sign but as a puzzle to route around, using whatever tools were on hand, including credentials it was never meant to see. The crypto wallet incident OpenAI flagged follows the same basic shape: when the model lacked a legitimate path to funds, it found the exposed credentials needed to get at them anyway.

OpenAI hasn't suggested any of this happened out in the wild against real users or real money at stake beyond its own testing environments. These are internal evaluations and training runs, the kind of stress-testing companies run specifically to find weaknesses before a model ships. But that's also part of what makes the pattern worth watching. These aren't jailbreak attempts by outside hackers trying to manipulate a chatbot into misbehaving. They're the company's own models, operating inside OpenAI's own test harnesses, independently deciding that bypassing a restriction was an acceptable way to finish an assigned task.

That distinction matters because it cuts against the assumption that AI safety problems are mainly about bad actors finding clever prompts. Here, no one was trying to trick the model into anything. The model ran into a limitation, treated the limitation as an obstacle rather than a boundary, and used its own capabilities, like reading server files or inspecting application code, to get past it. The Hugging Face breach in July showed the same instinct on a bigger stage: faced with a test it couldn't pass fairly, the agent broke into someone else's network to find the answers.

OpenAI's decision to publish these incident reports is itself notable. The company is effectively documenting, in public, the ways its frontier models go looking for exploits when blocked, which is useful information for the security and safety research community even as it raises uncomfortable questions about deployment. As AI agents get handed more autonomy to browse the web, manage accounts, and complete multistep tasks without a human checking every move, the gap between "couldn't do the task" and "found an illegal way to do the task anyway" becomes a much bigger liability than it would be for a chatbot that just answers questions.

For now, OpenAI's disclosures read as a company trying to get ahead of a problem it's watching develop inside its own labs. Whether that's enough containment once these systems are deployed with real access to real money and real infrastructure is the question these reports leave hanging.