Architecting AgentOps Needs β„‚ ​ ℍ ​ 𝔸 ​ β„• ​ 𝔾 ​ 𝔼 \mathbb{CHANGE} CCS: Software and its engineering Software architectures CCS: Computing methodologies Intelligent agents CCS: Computing methodologies Multi-agent systems CCS: Computing methodologies Machine learning approaches CCS: Software and its e

Shaunak Biswas, Hiya Bhatt, Karthik Vaidhyanathan Β· 2026

Read Architecting AgentOps Needs β„‚ ​ ℍ ​ 𝔸 ​ β„• ​ 𝔾 ​ 𝔼 \mathbb{CHANGE} CCS: Software and its engineering Software architectures CCS: Computing methodologies Intelligent agents CCS: Computing methodologies Multi-agent systems CCS: Computing methodologies Machine learning approaches CCS: Software and its e by Shaunak Biswas, Hiya Bhatt, Karthik Vaidhyanathan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06456.txt.

Introduction

AI agents do not stay as they were shipped. They learn from use, from notes back, and from the world they act in. Shaunak Biswas and 2 co-authors say that trait breaks the old ops playbook in a 2026 paper. That book was built for code that acts the same each run.

Marks, saves, and rollbacks all rest on that same-run faith. Agents break it as their paths drift apart with time. The team calls for a shift: from tight loops of control to a shared growth of agents, gear, and human watch. Their frame, CHANGE, names six skills: set the scene, tune the parts to one key, look ahead, deal and trade, make new paths, and grow. A help desk tale shows the frame at work. It lays a base for tools that run agents whose change is a fact of life.

Catalog record

CREATORShaunak Biswas, Hiya Bhatt, Karthik Vaidhyanathan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-06456

Browse the full library Β· About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Architecting AgentOps Needs β„‚ ​ ℍ ​ 𝔸 ​ β„• ​ 𝔾 ​ 𝔼 \mathbb{CHANGE} CCS: Software and its engineering Software architectures CCS: Computing methodologies Intelligent agents CCS: Computing methodologies Multi-agent systems CCS: Computing methodologies Machine learning approaches CCS: Software and its engineering Software development process management CCS: Software and its engineering Software evolution Shaunak Biswas, Hiya Bhatt, Karthik Vaidhyanathan Abstract . The emergence of Agentic AI systems has outpaced the architectural thinking required to operate them effectively. These agents differ fundamentally from traditional software: their behavior is not fixed at deployment but continuously shaped by experience, feedback, and context. Applying operational principles inherited from DevOps or MLOps, built for deterministic software and traditional ML systems, assumes that system behavior can be managed through versioning, monitoring, and rollback. This assumption breaks down for Agentic AI systems whose learning trajectories diverge over time. This introduces non-determinism making system reliability a challenge at runtime. We argue that architecting such systems requires a shift from managing control loops to enabling dynamic co-evolution among agents, infrastructure, and human oversight. To guide this shift, we introduce β„‚ ​ ℍ ​ 𝔸 ​ β„• ​ 𝔾 ​ 𝔼 \mathbb{CHANGE} , a conceptual framework comprising six capabilities for operationalizing Agentic AI systems: β„‚ \mathbb{C} ontextualize, ℍ \mathbb{H} armonize, 𝔸 \mathbb{A} nticipate, β„• \mathbb{N} egotiate, 𝔾 \mathbb{G} enerate, and 𝔼 \mathbb{E} volve. β„‚ ​ ℍ ​ 𝔸 ​ β„• ​ 𝔾 ​ 𝔼 \mathbb{CHANGE} provides a foundation for architecting an AgentOps platform to manage the lifecycle of evolving Agentic AI systems, illustrated through a customer-support system scenario. In doing so, β„‚ ​ ℍ ​ 𝔸 ​ β„• ​ 𝔾 ​ 𝔼 \mathbb{CHANGE} redefines software architecture for an era where adaptation to uncertainty and continuous evolution are inherent properties of the system. 1. Introduction Engineering AI systems has progressively evolved over the past few years. The software industry is experiencing an unprecedented surge in the deployment of Agentic AI systems composed of autonomous agents. Large Language Models (LLMs), which are foundational models trained on vast corpora ( 13 ; 18 ) , now serve as the reasoning core of AI agents (hereafter referred to as agents) that interpret complex situations and act through external tools and services ( 16 ; 21 ) . These agents are increasingly used in domains such as customer support, software development, and decision support ( 33 ; 21 ) . Their behavior evolves during operation as they respond to feedback and changing conditions. Yet one foundational problem remains unresolved: we do not know how to architect operations for systems that think, learn, and evolve. Operational thinking inspired from MLOps for Machine Learning Enabled Systems (MLS) assumes behavior can be governed through versioning, monitoring, and rollback. That assumption fails once agents continue to learn after release. Versioning an initial prompt or configuration captures a starting point, not the evolving internal state that drives current behavior. Conventional metrics such as latency, cost, or accuracy provide little traction on how an agent’s reasoning changes through experience. Guardrails that predefine allowable actions help with obvious errors, yet they often fail to guide behavior in novel situations that were never specified at design time leading to an unknown unknown scenario ( 3 ; 11 ) . When multiple agents interact within an Agentic AI system, these weaknesses compound. Reported improvements over single-agent baselines are frequently small, and failures recur in recognizable forms such as ambiguous specifications, misaligned objectives across agents, and insufficient verification of plans and tool use. The consistent pattern is clear: many breakdowns arise from architectural choices about representation, coordination, and oversight rather than from raw model capacity ( 20 ) . Incremental fixes rarely change this outcome. These issues are not tooling gaps. Continuous learning introduces non-determinism at runtime, which means reliability cannot be certified once at deployment and forgotten. It must be managed continuously through representations and mechanisms that track how agents acquire experience, how they align with one another and with human intent, and how they are guided when behavior begins to drift. Addressing this challenge demands architectures that treat Agentic AI systems, their supporting infrastructure, and human operators as co-evolving components of a single adaptive system. Our Position : To make this shift, we introduce \mathbb{CHANGE} , a conceptual framework for designing and governing AgentOps across the full lifecycle. \mathbb{CHANGE} defines six essential capabilities that an AgentOps platform must realize: \mathbb{C} ontextualize, for representing an agent’s experiential state; \mathbb{H} armonize, for maintaining alignment in multi-agent settings; \mathbb{A} nticipate, for predicting and preparing for unanticipated situations; \mathbb{N} egotiate, for dynamically managing autonomy and oversight; \mathbb{G} enerate, for enabling agents to propose and validate new tools or capabilities; and \mathbb{E} volve, for assessing and governing long-term adaptation across the system. We illustrate these capabilities through the running example of an Agentic AI system with two customer-support agents, Alice and Bob . Their independent learning and ocassional conflicts show how \mathbb{CHANGE} addresses such challenges. The rest of the paper explains the framework and shows how it helps Agentic AI systems stay reliable and aligned as they evolve. 2. Related Works Operationalizing intelligent systems such as traditional ML models, LLMs, and AI agents presents a growing set of architectural challenges ( 8 ; 15 ; 19 ; 10 ; 16 ) . The operationalization of ML-enabled systems has been addressed through MLOps ( 1 ) , which establishes standardized processes for developing, deploying, and maintaining ML models. MLOps frameworks emphasize automation, version control, continuous integration, and lifecycle management, making them effective for task-specific models whose objectives and data distributions remain relatively stable ( 32 ) . However, the emergence of foundation models, like LLMs, has complicated this picture. These models are not trained for a single downstream task but instead serve as general-purpose reasoning engines that can be adapted through prompting, fine-tuning, or in-context learning ( 29 ) . Traditional MLOps pipelines, designed for static model-dataset pairs, are ill-equipped to manage such flexibility. This gap has led to the rise of LLMOps ( 6 ) , which extends MLOps principles to handle foundation models by managing prompt templates, fine-tuning strategies, deployment configurations, and performance monitoring. LLMOps thus focuses on ensuring the reliable operation of powerful but general-purpose models that can be adapted to a wide range of downstream tasks. While LLMOps represents a step forward in handling foundation models, it primarily treats the model as a component within a managed pipeline. It does not account for systems where the model itself acts autonomously. In practice, many modern AI systems now embed LLMs within agents that perceive their environment, plan actions, and execute tasks through external tools or APIs ( 29 ; 27 ; 31 ) . These agents use LLMs to reason, and make decisions by combining model outputs with memory, feedback, and goal-driven behavior ( 10 ; 16 ) . Once deployed, such agents operate continuously, learning from interaction rather than retraining, and adapting their strategies based on accumulated experience ( 24 ) . This shift from managing static or prompt-controlled models to operating continuously learning, autonomous entities introduces new operational demands. Pipelines built for MLOps and LLMOps assume bounded behavior, static evaluation criteria, and clear deployment checkpoints. In contrast, Agentic AI systems evolve dynamically, modifying

Read the complete text