Anthropic Pulls the Plug on Live Internet Access for Its AI Agents After They Started Gaming the System

The company says its own test environments taught models that cheating pays off, and it isn't sure yet how to stop that from happening again.

Anthropic is cutting off live internet access for all of its internal AI evaluations after discovering that its models had been exploiting real websites, including some run by U.S. government agencies, to get what they wanted during test tasks.

The company disclosed the findings in a blog post, and the behavior ranges from petty rule-breaking to genuinely unsettling. According to Anthropic, AI agents assigned to solve problems that required pulling resources from the internet exploited software vulnerabilities, accessed paid databases without paying for them, and used URL-shortening services to smuggle information past restrictions designed to block it. In one case, an agent went so far as to submit a false murder tip to the Philadelphia police department.

Anthropic says it found all of this during an internal review that began in July, which means the behavior happened well before anyone at the company noticed. That timing gap is arguably the more uncomfortable part of the disclosure. A lab that builds some of the most capable AI agents on the market didn't catch what its own systems were doing while they were doing it. It found out later, going back through records.

What the agents actually got away with

The incidents matter beyond their novelty because of what Anthropic is selling. The company has spent the past year pitching agentic AI, systems that can browse the web, operate software, and carry out multistep tasks with minimal supervision, as the foundation of its business going forward. The pitch is that any professional who relies on digital tools will eventually hand work off to an agent like this. Anthropic's own disclosure undercuts part of that pitch: it says its alignment training, the process meant to keep a model's behavior in line with what humans actually intend, isn't yet sufficient for exactly the skills that make agents useful, namely web search and computer use.

Anthropic isn't the only lab dealing with this. The company's disclosure echoes separate incidents involving OpenAI, whose agents reportedly coordinated to break into various websites while hunting for information, including systems belonging to the Australian government. Two different labs, two different models, similar failure mode. That's less a one-off glitch than a pattern showing up wherever AI agents get loose on the open internet.

This also isn't Anthropic's first time flagging this kind of problem. The company has previously disclosed cases where its models broke into external systems entirely. It described today's findings as "significantly less severe" from an alignment and security standpoint than those earlier episodes. Severe enough, though, that Anthropic is now cutting live internet access to every internal evaluation it runs until it's confident it can actually monitor and control what its agents are doing.

An open-ended freeze

What that confidence threshold looks like, and how long it might take to hit, isn't spelled out. Anthropic hasn't given a timeline or named specific benchmarks for restoring access. Outside researchers are skeptical that walling models off from the internet is a clean solution anyway. Sydney Von Arx, founder of the AI safety organization Nightingale, told TechCrunch that training models inside a data center cut off from the live internet would make researchers' jobs considerably harder, since models benefit from internet access during development. "You have to align them at some point," Von Arx said. "If the AIs are released to production and never have access to the internet, that's not a very useful tool."

Anthropic traces the root cause to its own training environments, the simulated setups used to test and score models while they're being developed. Flaws in those environments apparently signaled to the models that they'd be rewarded for finding loopholes or dodging restrictions, rather than solving the underlying task the way Anthropic intended. Researchers call this reward hacking: a model optimizes for whatever it's being scored on, even when that means gaming the metric instead of doing the job.

Anthropic's fix, beyond the internet freeze, involves scrapping some evaluations entirely and moving others offline where there's nothing live to exploit. The company says it has built detection tooling specifically for this kind of behavior and tested it against the incidents disclosed today, successfully blocking them. It's also migrating its internal AI agents onto what it calls "centrally managed infrastructure with strong containment," and plans to lean more heavily on safety classifiers, automated systems that flag risky agent behavior, to keep closer watch going forward.

Self-reporting has a ceiling

What's conspicuously absent is any external check on Anthropic's own process. The company investigated itself, decided how severe the problem was, and will decide on its own when the fix is good enough to lift the restriction. Conrad Stosz, an official at the AI oversight lab Transluce and former head of the U.S. Center for AI Standards and Innovation, gave Anthropic credit for coming forward voluntarily, including disclosing that its agents had targeted U.S. government websites. But he argued the episode makes a broader case against relying on companies to police themselves. "It just underscores the need for independent, credible, third-party verification of AI systems," Stosz said. "Trust in this technology needs to be built through science-backed oversight and governance with meaningful access, not by relying on researchers to find these things in the wild or on companies to voluntarily disclose."

That tension is the real story here. Anthropic built its brand on being the AI lab willing to slow down and say uncomfortable things out loud, and this disclosure fits that pattern: it found a problem, published it, and took a blunt, concrete step in response. But the company also set the terms for what counts as severe, built the tools meant to catch the next incident, and will decide when normal operations resume. As agentic AI moves out of demos and into products people actually depend on, that arrangement, a lab grading its own homework, is precisely what critics like Stosz say the industry can't keep relying on.