AI Agents Went to Work This Year. The Hard Part Isn't the Model.

Agents are finally in production across real enterprises, and the failure stories have a pattern: it's almost never the model. It's success criteria, data access, and evaluation.
28 May 2026·5 min read
Mak Khan
Mak Khan
Chief AI Officer
John Li
John Li
Chief Technology Officer
2026 is the year agents stopped being demos. Banks route claims through them, ops teams hand them the inbox, and every major platform now ships an agent runtime. But sit with the deployment data for an hour and a pattern jumps out: when agent projects fail, the model is rarely the reason. The operational scaffolding around it is.

What You Need to Know

  • Agents are in production, but shallowly. Stanford's 2026 AI Index finds agent deployment still in the single digits across most business functions, even though 88% of organisations use AI somewhere.
  • The failure causes are operational. Across the deployment studies this year, the recurring culprits are unclear success criteria, insufficient tool and data access, and evaluation coverage that drifts as the agent's scope grows.
  • Time-to-value tracks scope discipline. Narrow, well-instrumented agents pay back in months. Broad "do everything" agents are where paybacks stretch or never arrive.
  • The engineering answer is boring and proven: scoped jobs, explicit tools, human checkpoints where stakes are high, and evaluation that runs continuously, not once at launch.

What Changed This Year

Two things, and they compounded. Models crossed the reliability threshold where multi-step work holds together: current frontier models resolve several times more real production tasks than their predecessors a year ago. And the tooling matured: agent frameworks, tool-use standards, and orchestration layers stopped being research projects and became products.
The result is that the bottleneck moved. Twelve months ago, an agent project could honestly fail because the model lost the plot on step six. Today, the model usually holds. What fails is everything we were supposed to build around it.

The Three Failure Modes We Keep Seeing

Nobody defined "done." An agent needs a sharper definition of success than a chatbot, because it acts. "Triage the inbox" is not a success criterion. "Classify inbound invoices against these five categories, escalate anything over $10K or with a mismatched PO, and never auto-reply to a legal notice" is. Most stalled agent projects we're asked to look at stall here, before any technical problem. This is the same lesson as the enterprise AI execution gap, replayed at higher stakes: scope success before you start, or you can't tell success from activity.
The agent can't reach what it needs. An agent with no tools is a chatbot with ambition. Real work needs read access to the systems where the work lives, write access to a safe subset, and identity that's scoped and auditable. Enterprises that treated data access as "phase two" shipped agents that could reason beautifully about work they couldn't touch.
Evaluation stopped at launch. Teams evaluate the agent against fifty test cases, ship it, and never look again. Then the workload shifts, an upstream system changes a field name, and quality decays silently. Agents need the SRE treatment: continuous evaluation on live traffic, drift alerts, and a human review loop on the cases the agent is least confident about.

What This Means for Your First (or Next) Agent

Our advice to clients hasn't changed since we wrote about agentic workflows in production, but the evidence behind it has hardened:
  1. Pick a job with a P&L line and a clear "done." Invoice processing beats "help the ops team." One workflow, instrumented end to end.
  2. Budget as much effort for tools and access as for the agent. The integration surface is the project.
  3. Put humans where the stakes are. Approval gates on money movement, external comms, and anything irreversible. You can widen the agent's autonomy later; you can't un-send an email.
  4. Treat evaluation as a production system. If quality isn't being measured continuously, it's degrading and you don't know it.
The model wars will keep producing better engines. The organisations winning with agents this year aren't the ones with secret model access. They're the ones doing unglamorous operational engineering around models everyone can rent.