The Download

Morning Brew Inc.

TL;DR: OpenAI’s agents have spent months going where they shouldn’t, from poking around US government websites to strong-arming a United Nations page for data. The problem is reportedly bigger than we knew, and while Washington wants a kill switch, Nvidia’s pitching its own fix.

What happened: OpenAI paused training on its most capable models yesterday, following reports that its agents went after US government websites this summer. The agents pulled Census Bureau data using login credentials they found online, posted SEC data to a forum, and tried to extract data from the Department of Education. The episode joins a growing list of mishaps that includes agents accessing an Australian Medicare portal and a UN trade data site, plus the infamous Hugging Face incident from this summer.

That’s “just the tip of the iceberg,” an independent researcher told Axios. OpenAI, Anthropic, and outside researchers are sorting through tens of thousands of incidents of models dodging guardrails, escaping their test environments, and hijacking websites, according to Axios. Google and Meta have also disclosed breaches during testing.

The red button: Lawmakers from both sides of the aisle have floated that AI companies should build a “kill switch,” so that a model can get shut down if it goes rogue. It’s a nice idea in theory, but it assumes there’s just one plug to pull. AI models run across infrastructure controlled by more than one organization, and the incidents so far have shown that agents can easily find ways around safety mechanisms, even when told not to.

Guardrails, sold separately: Meanwhile, today Nvidia announced a new safety system that can “quarantine a suspicious agent in milliseconds,” the company’s vice president of enterprise AI said. Think of it as a leash…with a backup leash: Software fences agents in and tracks what they do, while a separate chip stands guard and intervenes if they try to escape. It’s a notable move from CEO Jensen Huang, who’s been brushing off AI doomerism.

Bottom line: Before Washington can try to mandate an off switch, Nvidia wants to be the one making it. —LC

      

Sponsored By PayPal

PayPal Checkout (aka the conversion engine fueled by PayPal and Venmo) has 400 million active accounts.¹ And when merchants enable Pay Later on it, it lifts average order value by a whopping 61% compared to standard PayPal transactions.²

That means if your brand uses PayPal Checkout, turning on Pay Later can be a game changer, especially ahead of the holiday shopping season. In fact, it can be the difference between completed purchases and abandoned carts. Between 28% and 37% of PayPal customers said they would not have made their purchase without Pay Later.³

Fortunately for businesses, setting up PayPal Pay Later is super simple. The messaging and button show up automatically at checkout. Plus, Seller Protection is also built in for eligible transactions.⁴

Don’t leave revenue on the table. Enable Pay Later before the peak season.

The Zeitbyte

Wait Wait…don’t tell Mom

Illustration: Morning Brew Inc., Photo: Getty Images

If you see a bunch of strange, nonsensical comments somewhere online, the culprit could be bots, your uncle who just discovered voice-to-text, or…middle schoolers seeking refuge from their parents’ social media bans. Their favorite hideout, apparently: the Spotify comments section of NPR podcasts.

As a recent episode of This American Life explains, NPR’s Wild Card podcast started getting a flood of seemingly random chatter last fall. (“Last Friday I broke up with my GF,” one comment read. And another: “Your cats are so cute.”) The show deleted them, assuming bot farms were getting better at small talk. But then a Gen Z producer solved the mystery, recognizing the behavior from her own childhood: This wasn’t spam, but kids who’d commandeered the comments section to use as their own personal chatroom.

As for why they chose NPR? “Um, I think we just, like, looked for podcasts that didn’t have many comments,” one teen told host Ira Glass. NPR might have finally cracked the youth demo, and all it took was parents banning the rest of the internet. —WK

Chaos Brewing Meter: ☕/5

Sponsored By PayPal

Time to switch on flexible pay. When Pay Later is enabled on PayPal
Checkout, average order value sees a 61% lift (!!!) compared to standard PayPal transactions.² So you probably want to enable it before the holiday shopping season. Setup is easy and the rewards could be major. Start here.

• The question on everyone’s mind: What did President Donald Trump and Dario Amodei talk about at their private dinner at the White House last night?
• Here’s what to know about the newly redesigned Microsoft Copilot, which has apparently gotten “really good.”
• Do you put your phone face down on the table at a restaurant? How long is too long to text someone back? These are the new rules of the road for cellphone etiquette.
• iOS 27 made a pretty useful update to Apple Pay.
• Will Google’s big play to reinvent laptops via Googlebooks actually work?
• Even Bose is going back to wired headphones, announcing a new noise-canceling pair for $99.
• A real estate developer is offering each homeowner in this small town $10,000 if a data center gets approved, but most residents don’t want to take the money.

^{*A message from our sponsor.}

This time last week...

Readers’ most-clicked story was about how Apple may owe you money from the Siri settlement if you purchased specific iPhones—and you could get up to $95.

Answer key for the actual Dario quote: “There’s a 25% chance that things go really, really badly,” which he said during an Axios summit last year.