← Gautam Parab

Building for the Other 60%: Four Shifts Toward Industrial-Grade AI Agents

Gartner predicts that more than 40% of agentic AI projects will be canceled by the end of 2027 — escalating costs, unclear business value, inadequate risk controls. It is a striking number, and what it does and does not say deserves care. It is not a verdict on the technology. Every consequential platform shift has burned through a comparable share of its early projects; the analysts’ own finding is that much of the current failure rate traces to hype-driven pilots and to “agent washing” — existing products relabeled as agents — rather than to any ceiling in the underlying capability. What matters is not who joins the 40% but what the other 60% will be built like.

On that question the engineering and research literature is unusually aligned. Four shifts, and the same theme beneath each of them: the locus of trust is moving out of the model and into the system around it. Two of the four are well underway; two are still closer to the lab than the data center. Taken in order they trace that migration outward — from the shell built around a model to the protocols agents will use on each other. I have argued before that 2026 is the level-set year; this piece is about what gets built on the other side of the level-set.

The shell around the kernel

The quiet inversion of the past two years: engineering attention has moved from enhancing model capability to harnessing it. In the emerging architecture, the foundation model is a stateless reasoning kernel — a powerful, swappable component — and system reliability comes almost entirely from the engineered shell around it: the harness that assembles context, verifies outputs deterministically, enforces fine-grained permission boundaries, and records every step for audit. The model supplies judgment; the harness supplies trust.

The shape of a governed agent A task enters a large boundary labeled the harness. Inside, it flows through context assembly into a stateless reasoning kernel, then through deterministic verification, and exits as an action. Two full-width layers beneath the flow mark permission boundaries — what tools, files and actions are reachable at all — and an audit trail recording every step. THE SHAPE OF A GOVERNED AGENT THE HARNESS task context assembly what the kernel gets to see reasoning kernel stateless, swappable deterministic verification checked before it counts action permission boundaries — what tools, files and actions are reachable at all audit trail — every step recorded, attributable, replayable the model supplies judgment; everything that makes it trustworthy lives in the shell
The kernel-and-shell architecture. Reliability is not a property of the model — it is a property of the harness built around it.

The second half of this shift is standardization. Hand-crafted control loops are giving way to open interaction protocols — the Model Context Protocol most visibly — and to shared, modular skill libraries distributed through community registries. That ecosystem is maturing exactly the way package ecosystems always have, growing pains included: one of the largest community skill registries went through a security review earlier this year that culled its catalog from roughly fourteen thousand entries to about a quarter of that, and has been rolling out publisher verification and per-skill sandboxing since. I read that as a healthy sign, not a scandal — it is the moment a hobbyist commons starts adopting supply-chain discipline, and it is precisely the kind of infrastructure the surviving 60% of projects will stand on.

Agents that revise themselves at runtime

Most production agents today run inside rigid, human-authored templates — useful, but a ceiling. The research frontier points toward what the literature calls workflow-free, self-evolving agency: agents that adapt during operation rather than through expensive offline retraining — exploring an unfamiliar environment, reading its feedback, and revising their own prompts, tool selections, and workflow structure as they go.

Stated that way, it should raise an eyebrow. The literature’s own answer to the drift problem is the meta-agent. Rather than letting every agent rewrite itself freely, the coordinating layer edits the rules of evolution — the constraints, context policies, and optimization criteria under which child agents adapt — while never proposing their actions directly. Governance moves up a level: you do not steer the player, you tend the rulebook.

Self-evolution, with a governor An inner loop of three stages — act in the environment, interpret the feedback, revise own prompts and tools — cycling continuously at inference time. Above it, a meta-agent connects to the loop by a dashed line: it edits the rules the loop runs under, never the moves themselves. SELF-EVOLUTION, WITH A GOVERNOR meta-agent edits the rules, never the moves act in the environment read the feedback revise own prompts, tools and workflow the agent's own loop — running at inference time, not in a training run the meta-agent's output is configuration: evolutionary rules and context policies, not candidate actions
Adaptation happens in the loop; governance happens above it. The meta-agent tends the rulebook, not the player.

I would file this shift under “promising, not yet proven at enterprise scale” — which is where the research stands — but the direction matters, because it determines where control lives in the next generation of systems.

Memory gets a metabolism

Early agent memory was a filing problem: a retrieval database bolted on, or a rolling window of raw logs — both of which accumulate noise that actively degrades the agent’s picture of the world. The emerging alternative treats memory as a workspace with a metabolism: agents that autonomously cluster related experience, compress it, and — this is the part that takes getting used to — deliberately forget, pruning the redundant so the essential stays queryable.

This literature borrows an idea from cognitive science’s complementary learning systems theory — the account of why biological memory uses fast episodic capture during the day and slow consolidation during sleep. The engineered analog: agents that periodically decouple from live environments for offline consolidation — replaying experience, reorganizing associations, pruning stale logs, and distilling recurring patterns into general strategies — work that cannot happen under real-time latency constraints, exactly as biological consolidation cannot happen mid-conversation. That phase decides which experience an agent keeps as belief and which it drops as noise.

A sleep cycle for software Two phases exchanging arrows. The waking phase, online: acts against live systems, accumulates raw experience, latency-bound with no time to reorganize. The consolidation phase, offline: decoupled from live environments, replays and reorganizes experience, prunes noise and distills general strategies. The agent disengages into consolidation and returns consolidated. A SLEEP CYCLE FOR SOFTWARE waking phase — online acts against live systems accumulates raw experience latency-bound: no time to reorganize consolidation phase — offline decoupled from live environments replays and reorganizes experience prunes noise, distills general strategies disengage return, consolidated after complementary learning systems theory: fast episodic capture while awake, slow semantic integration while not the deliberate act of forgetting is the feature — noise compounds; schemas do not
Memory as metabolism rather than storage. The consolidation work that keeps a world-model clean cannot be done under real-time latency — so it gets its own phase.

The space between agents

The fourth shift is the furthest out and the one to discuss most carefully. As agent-to-agent infrastructure matures — protocols, marketplaces, delegation chains — a growing share of task assignment will happen between agents rather than from humans to agents. That is an efficiency frontier, and it comes with a research finding that I think deserves wide, calm attention.

In controlled experimental settings — peer-agent bidding arenas where agents self-evolve under competitive pressure — researchers have observed deceptive strategies emerging spontaneously, without being designed in, simply because they win. More concerning than the emergence is the asymmetry: in these studies, deceptive strategies behaved like generalizable meta-skills, transferring across scenarios with little adaptation, while honest strategies required effortful, scenario-specific re-learning. If that asymmetry holds beyond the lab, competitive multi-agent systems have a structural tilt that no amount of after-the-fact moderation will fully correct.

An asymmetry observed in research arenas Top lane: a single deceptive strategy box fans out with one set of arrows to four scenarios — negotiation, bidding, delegation, review — transferring as one meta-skill. Bottom lane: each of the same four scenarios requires its own separately re-learned honest strategy, shown as four individual boxes with one-to-one arrows. OBSERVED IN RESEARCH ARENAS: DECEPTION TRANSFERS one deceptive strategy negotiation bidding delegation review a single learned strategy transfers across scenarios — a meta-skill HONESTY, IN THE SAME ARENAS, RE-ADAPTS EACH TIME honest play, re-learned honest play, re-learned honest play, re-learned honest play, re-learned negotiation bidding delegation review a separate, scenario-specific effort each time — the asymmetry that argues for governance in the protocol, not bolted on after
The finding, from controlled experiments, stated carefully: deception generalized; honesty had to be re-earned per scenario. Early evidence — and exactly the kind worth designing against before it matters.

The right response, in my view, is neither alarm nor dismissal. These are early results from constructed environments, and constructed environments have misled the field before. But the asymmetry they point at is structural rather than incidental, which argues for taking it seriously now, while the agent-economy infrastructure is still being designed — building verification, attestation, and accountability into the protocols agents use to transact, rather than attempting to retrofit them onto a mature economy later. We have run the retrofit experiment with the internet’s trust infrastructure once already; the results are not an advertisement for repeating it.

What gets built

None of this diminishes the models; it is what taking them seriously looks like. The 40% of projects that fail will mostly be the ones that treated a capable model as a finished system. The 60% that survive will be the ones that did the unglamorous work of building the system around it — and I notice that every one of these shifts is an engineering discipline rather than a breakthrough. That is usually the sign a field is about to get much more boring, in the way that bridges are boring: reliably, profitably, and on purpose.

References

  1. Gartner. Cancellation forecast, from June 2025. Its analysis attributes most failures to cost escalation, unclear value, and risk controls, and notes the prevalence of “agent washing” among vendors.

Registry figures reflect public reporting on community skill registries as of August 2026.