Assessing the New Risk Landscape With AI Agents Making Decisions
The promise of mouthwatering AI productivity gains has excited business and IT leaders and stoked organizational ambitions across the board. But there have been some recent examples of AI agents going rogue in ways that should serve as cautionary tales.
“Just think of an agent provisioning access, processing payroll or remediating security incidents — that's pretty private stuff. You may have read recently about the AI failures of PocketOS deleting production databases, customer data, reservations, backups — all gone in nine seconds,” said ServiceNow Chairman and CEO Bill McDermott. “That's what an AI agent can do when no one's watching. That's why businesses require a model that thinks and a workflow that acts, with integration and intelligence.”
And the threats aren’t relegated just to localized AI agents making the wrong decisions. AI agents also represent a global threat as cybercrime increases with the geopolitical environment growing increasingly adversarial.
“Today, agents are being deployed with no identity, audit trail or compliance posture. But look at the world today: Cybercrime is the third-largest economy behind the United States and China. It's a trillion-dollar-a-month problem,” said McDermott. “The more you deploy, the more you expose. Intelligence without rules and rails is a dangerous blind spot.”
These shifting sands of agentic business are a major part of the reason why ServiceNow is so bullish on its new AI Control Tower. The vision for the Control Tower is one that cares about the security of AI as much as the velocity of AI.
“The security landscape has fundamentally changed now that AI agents are working with us every day,” said ServiceNow Chief Product and Operating Officer Amit Zavery, during the conference’s Day 2 keynote titled “The Blueprint for Agentic Business.”
“The companies that are seeing real results — the ones with 2.5 times better outcomes from agentic AI — are the ones running on a unified platform with governance built in. And only ServiceNow brings together data, AI, workflows and security on one platform,” he said.
Failsafes and kill switches are built into the Control Tower, which means that opportunities for AI agents to maximize harm — the “blast zone,” as several ServiceNow leaders called it — are mitigated in the corporate environment.
“Every identity, asset and decision is continuously monitored with AI Control Tower. When something goes wrong, mediation triggers automatically,” said Zavery. “Before access attempts can become breaches, the AI Gateway enforces governance, observability and security at the transaction level for all the MCP servers you might be running.”

