In the enterprise IT view of AI agents, three words matter most

Opinion
Aug 26, 20257 mins

When considering how AI should apply to business, there are three distinct categories that enterprises use to classify AI agent applications: embedded, workflow and reactive.

Agentic AI for business workflows
Credit: Rob Schultz / Shutterstock

Research firm Gartner shows generative AI about to fall into the “trough of disillusionment” and AI agents at the “peak of inflated expectations” in its newly published Hype Cycle report. Enterprises offer me a slightly different view. Their IT staff, at least, has never had many expectations for generative AI, and while they agree AI agents are hot, they’ve had that view from the first, and they don’t think they’ll be falling into any troughs of agent disillusionment.

The simple fact that this viewpoint difference exists is important. Why it exists is more important.

Enterprises have always seen AI in agent terms. As I pointed out in a prior blog, enterprise IT professional think most of the valuable AI applications require not some massive, Internet-trained, generalist tool but a kind of AI expert, something that focuses on a single area of business operations, and that thus has much more modest hosting requirements. The compartmentalized agent concept arises out of fitting AI into business practices, which is the only way they believe it can earn a strong business return. As the saying goes, sometimes it’s not the destination but the journey. And in this case, it’s a journey through the real, justifiable, business applications of AI rather than the sort of AI and agents you hear about. That journey is what gives us the three little words.

Embedded, reactive, workflow. Have you heard these words in reference to AI agents? You should have, because these words describe the three groupings that enterprises use to classify AI agent applications. Agents are the real future of AI, and so these three words may be the most important words in the whole space. They may also be a sign of a widening gap between the popular focus on cloud-hosted, enormous, generalist chatbots and enterprise exploitation of the technology.

The journey enterprises have taken to agent AI is what’s led them to recognizing three distinct categories of agent, our “three little words.”

Embedded agents are agents operating within another software element, and this model is popular for both network/IT operations support and some business intelligence missions. Workflow agents are agents that are used like software components, something that another component invokes via an API, and that passes results either back to what called it, or along to another component, one that might also be an AI agent. Reactive AI agents respond to prompts like online chatbots do, but have a very narrow and specialized mission. Coding assistants, spreadsheet assistants, and tools to help lawyers and doctors are examples. To understand where enterprise AI is going, you need to look at all these categories.

Reactive AI agents

Starting with the reactive category is justified, because this category makes up almost half the total number of deployed AI agent applications enterprises report. Most early enterprise AI applications were chatbots aimed at pre- and post-sale support, and some of these have been gradually converting from online AI chatbots to agent applications because of data security and sovereignty concerns. That movement makes this the first type of agent most enterprises deployed, and the applications look on the surface like the online chatbot apps most of us have played with. The applications are trained on specialized data rather than on the broad Internet, to create “foundation models” and enterprises’ own data is then linked to them via Retrieval-Augmented Generation (RAG), making these the agents most likely to drive initial use of this hybrid model. The target workers for reactive agents are professionals; medical, legal, all the engineering disciplines, and some business planners.

Embedded AI agents

Right now, enterprises indicate that roughly a third of their agent applications fall into the “embedded” category, nearly all of which are deployed as third-party software rather than developed. Most of the embedded agents aren’t based on, related to, generative AI at all, but fit into the “machine learning” category, However, enterprises say that small language models are displacing traditional ML because they offer improved results. These agent applications are feature-justified; users are less concerned that they’re state-of-the-art AI than they are that they deliver a specific benefit. There’s no real drive to harmonize the AI across embedded agents; the majority have minimal hosting requirements and thus sharing hosting isn’t seen as an issue.

Workflow agents

Workflow agents are the type that enterprises are the most likely to develop on their own, and seem to be the fastest-growing agent type so far in 2025. Unlike embedded agents where the AI is secondary to application features, workflow agents usually mandate the enterprise select an AI approach, and that they be aware of hosting. Most (about two-thirds) are built on open-source models, and use a small cluster of GPU servers, typically no more than a single rack. Self-hosted AI, where enterprises actually select models and build clusters, is largely concentrated here, and agent-to-agent workflows are most likely to be found in this category; MCP and A2A usage peaks with this group, and exposure to MCP here seems to be helping MCP gain traction in reactive-agent applications.

The separation of agent technology into these three categories demonstrates that enterprises continue to co-opt AI agents to fit their own model of how AI should apply to business. Given that, it’s fair to ask whether there’s further tuning underway, whether there are ongoing changes and refinements that will further impact how AI is used, and what technologies and vendors might win the AI race.

One candidate is the growing importance of APIs. Since enterprises have tended to focus their self-hosted AI missions on the workflow model of agent use, it follows they’re also interested in agent-to-agent flows and APIs. This has raised the importance of the A2A API, to the point where it seems likely the same model will be used for workflow integration of APIs and applications.

Another candidate change is the use of front-end technology to augment the reactive model of agents. Early enterprise development and use of reactive agents has demonstrated not only that most don’t need to understand totally free-form questions, but also that making such understanding a requirement can double the resources needed to run the agents. If agents are specialized, then a simpler vocabulary is not only justified, but improves project ROI. Some enterprises also note that using a front-end application to create prompts can allow the same agent to support all three agent models; you can feed workflows or even real-time events through one front-end and human interaction through another.

Unlike the popular AI-as-a-service tools, AI agents used by enterprises are more likely than not to be self-hosted, and almost always will require continuous access to enterprise data rather than just requiring data access for training. This change in data integration is creating a lot of concerns about data sovereignty, cost, and performance. In fact, the interplay of cloud computing, AI, and enterprise infrastructure is the most-cited emerging issue for AI, and that’s something we’ll cover in the next blog.

tom_nolle

Tom Nolle is founder and principal analyst at Andover Intel, a consulting and analysis firm that looks at evolving technologies and applications first from the perspective of the buyer and the buyer's needs. By background, Nolle is a programmer, software architect, and manager of software and network products, and he has provided consulting services and technology analysis for decades.

He's a regular author of articles on networking, software development and cloud computing, as well as emerging technologies such as IoT, AI and the metaverse. His writing has appeared in No Jitter, IoT World Today, Network World, and multiple Tech Target publications. He publishes a public blog dedicated to the telecom, media, and technology strategy professionals, and also a series of reports on technology, market, and economic conditions.

Tom’s Reality Check blog won AZBEE awards in 2024 and 2025.

More from this author