Brief

From Roadmap to Reality: Phasing Agentic AI into Production

Enterprises need a phased approach to building agentic architecture—and a leadership mandate to make it stick.

By Eric Sheng, Roger Zhu, Brendan O'Rourke, Dale Pedzinski, and Kevin Zhang

First published on abril 14, 2026
min read


Executive Summary The path to full agentic architecture is phased, not a single leap. Governance and trust must precede orchestration and scale. The transition to agentic AI requires re-platforming the entire enterprise technology stack. This is the final installment in a four-part series on architecting for agentic AI. In this series, we’ve explored why agentic AI demands a new architecture, what the three-layer platform looks like, and why governance and data quality are required to scale. The next question is, how do you get there? A phased path to agentic architecture The desired end state is clear: Enterprises want a cohesive agentic platform that can orchestrate agents across applications and domains. The path to achieving that vision is multistep. It requires a deliberate, phased approach rather than a single transformation effort. Organizations that scale successfully tend to build capabilities in sequence so each layer of investment derisks the next. These phases are not strictly linear. Organizations calibrate sequencing to match their maturity, regulatory environment, and highest-value use cases. However, the guiding principle is consistent. Leading organizations build trust and governance first, then layer orchestration and scale on a secure foundation. Phase 1: building the foundation Start with the infrastructure that everything else depends on: data governance and quality frameworks; centralized policy enforcement and compliance controls; an observability layer for metrics, logs, and tracing across agents and workflows; and a security baseline that includes runtime guardrails, identity management for nonhuman principals, and prompt-level protections. At the end of this phase, organizations can deploy single-agent applications with governed tool access and full auditability via retrieval-augmented generation workflows, guard-railed chatbots, and task-specific agents operating within defined policy boundaries. These are production-ready but scoped to one agent and one workflow at a time. Multi-agent coordination and persistent memory will follow, but not until the orchestration layer. Without a strong governance foundation, orchestration and agent collaboration introduce unmanaged risk. Phase 2: deploying orchestration With governance in place, enterprises can deploy the orchestration layer: multistep workflow engines, Model Context Protocol–based tool abstractions, an agent registry for discovery and life cycle management, agent-to-agent (A2A) communication protocols for controlled collaboration, and memory management for both session-level and long-term context persistence. This phase is where application development accelerates. Teams can build multistep, multi-agent applications that reuse shared platform services and approved tools rather than rebuilding orchestration and policy enforcement application by application. Memory can now be governed, evaluated, and observed within the orchestration flow, without the need to redefine retention policies and consent controls, since these were established in phase 1. Persistent context across sessions introduces managed risk that must be governed. Likewise, A2A is primarily an in-workflow handoff mechanism, with agents passing tasks and context within a coordinated workflow, not an enterprise-wide networking layer. By the end of this phase, agents can move from isolated task execution to coordinated, multi-agent workflows within a single domain. Phase 3: scaling across the enterprise In this phase, organizations extend orchestration across applications and domains, adding federated discovery and routing only where needed to reach agents and tools that reside in other systems. They also enable autonomous multi-agent collaboration with broader decision authority, governed by the trust infrastructure built in phase 1. At this stage, the platform can support cross-domain agentic operations, not just individual applications. Agents in one business unit can discover and collaborate with agents in another, and each new agent or tool added to the platform increases the potential value of every application built on it. This is where organizations begin to realize the compounding returns of a shared, governed agentic platform. Federated discovery and cross-domain routing come last because they add complexity that is only justified when the governance and orchestration layers are mature. Architecture is leadership The move to agentic AI is both a technological evolution and a leadership test. This space is still taking shape, and even the most sophisticated enterprises are learning in real time. That’s not a failure of vision or effort—it’s a reflection of how fundamentally new this shift is. Going from legacy IT to agentic architecture requires re-platforming the enterprise technology stack. It is a shift from deterministic pipelines to nondeterministic, multi-agent systems that require entirely new capabilities for orchestration, memory, identity, and governance. The demands on architecture, governance, and delivery are unlike anything that has come before, but the path is becoming clearer. From underwriting in financial services to triage in healthcare and fulfillment in supply chains, agentic systems are already transforming how work is accomplished. Leaders who act now to invest in scalable use cases, modernize their data layers, and embed governance will shape the next generation of intelligent enterprises. This transformation starts with focus: Identify high-value, high-trust business processes, from compliance automation to customer service transformation. Strengthen the architectural backbone with modern modular design, persistent context, and built-in oversight. Lead with responsibility, making data quality, transparency, and governance the default. The takeaway is simple: Without modern architecture, agentic AI can’t scale. With the right foundation in place, however, it becomes a durable engine for intelligence, agility, and growth. The future isn’t waiting. It’s already in production. Explore this series Why Agentic AI Demands a New Architecture The Three Layers of an Agentic AI Platform Governance, Trust, and the Data Foundation From Roadmap to Reality: Phasing Agentic AI into Production Download the full series PDF

Executive Summary

The path to full agentic architecture is phased, not a single leap.
Governance and trust must precede orchestration and scale.
The transition to agentic AI requires re-platforming the entire enterprise technology stack.

This is the final installment in a four-part series on architecting for agentic AI.

In this series, we’ve explored why agentic AI demands a new architecture, what the three-layer platform looks like, and why governance and data quality are required to scale. The next question is, how do you get there?

A phased path to agentic architecture

The desired end state is clear: Enterprises want a cohesive agentic platform that can orchestrate agents across applications and domains. The path to achieving that vision is multistep. It requires a deliberate, phased approach rather than a single transformation effort. Organizations that scale successfully tend to build capabilities in sequence so each layer of investment derisks the next.

These phases are not strictly linear. Organizations calibrate sequencing to match their maturity, regulatory environment, and highest-value use cases. However, the guiding principle is consistent. Leading organizations build trust and governance first, then layer orchestration and scale on a secure foundation.

Phase 1: building the foundation

Start with the infrastructure that everything else depends on: data governance and quality frameworks; centralized policy enforcement and compliance controls; an observability layer for metrics, logs, and tracing across agents and workflows; and a security baseline that includes runtime guardrails, identity management for nonhuman principals, and prompt-level protections.

At the end of this phase, organizations can deploy single-agent applications with governed tool access and full auditability via retrieval-augmented generation workflows, guard-railed chatbots, and task-specific agents operating within defined policy boundaries. These are production-ready but scoped to one agent and one workflow at a time. Multi-agent coordination and persistent memory will follow, but not until the orchestration layer. Without a strong governance foundation, orchestration and agent collaboration introduce unmanaged risk.

Phase 2: deploying orchestration

With governance in place, enterprises can deploy the orchestration layer: multistep workflow engines, Model Context Protocol–based tool abstractions, an agent registry for discovery and life cycle management, agent-to-agent (A2A) communication protocols for controlled collaboration, and memory management for both session-level and long-term context persistence.

This phase is where application development accelerates. Teams can build multistep, multi-agent applications that reuse shared platform services and approved tools rather than rebuilding orchestration and policy enforcement application by application. Memory can now be governed, evaluated, and observed within the orchestration flow, without the need to redefine retention policies and consent controls, since these were established in phase 1.

Persistent context across sessions introduces managed risk that must be governed. Likewise, A2A is primarily an in-workflow handoff mechanism, with agents passing tasks and context within a coordinated workflow, not an enterprise-wide networking layer. By the end of this phase, agents can move from isolated task execution to coordinated, multi-agent workflows within a single domain.

Phase 3: scaling across the enterprise

In this phase, organizations extend orchestration across applications and domains, adding federated discovery and routing only where needed to reach agents and tools that reside in other systems. They also enable autonomous multi-agent collaboration with broader decision authority, governed by the trust infrastructure built in phase 1.

At this stage, the platform can support cross-domain agentic operations, not just individual applications. Agents in one business unit can discover and collaborate with agents in another, and each new agent or tool added to the platform increases the potential value of every application built on it.

This is where organizations begin to realize the compounding returns of a shared, governed agentic platform. Federated discovery and cross-domain routing come last because they add complexity that is only justified when the governance and orchestration layers are mature.

Architecture is leadership

The move to agentic AI is both a technological evolution and a leadership test. This space is still taking shape, and even the most sophisticated enterprises are learning in real time. That’s not a failure of vision or effort—it’s a reflection of how fundamentally new this shift is.

Going from legacy IT to agentic architecture requires re-platforming the enterprise technology stack. It is a shift from deterministic pipelines to nondeterministic, multi-agent systems that require entirely new capabilities for orchestration, memory, identity, and governance. The demands on architecture, governance, and delivery are unlike anything that has come before, but the path is becoming clearer.

From underwriting in financial services to triage in healthcare and fulfillment in supply chains, agentic systems are already transforming how work is accomplished. Leaders who act now to invest in scalable use cases, modernize their data layers, and embed governance will shape the next generation of intelligent enterprises.

This transformation starts with focus:

Identify high-value, high-trust business processes, from compliance automation to customer service transformation.
Strengthen the architectural backbone with modern modular design, persistent context, and built-in oversight.
Lead with responsibility, making data quality, transparency, and governance the default.

The takeaway is simple: Without modern architecture, agentic AI can’t scale. With the right foundation in place, however, it becomes a durable engine for intelligence, agility, and growth.

The future isn’t waiting. It’s already in production.