Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Units

Ryan Lingo, Rajeev Chhajer, Martin Arroyo, Luka Brkljacic, Ben Davis, Nithin Santhanam · 2025

Read Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Units by Ryan Lingo, Rajeev Chhajer, Martin Arroyo, Luka Brkljacic, Ben Davis, Nithin Santhanam (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08203.txt.

Introduction

Long language model answers become editable building blocks in a 2025 software paper by Ryan Lingo and 5 co-authors. Monolithic responses are hard to revise in parts, slowing collaborative work where a person wants to fix one claim and keep the rest. Their approach, componentization, decomposes model output into modular semantic units that stay linked to their context.

A decomposition method segments responses into coherent components, and a component-based architecture shows one implementation route. The reference prototype uses microservices with state-machine agents doing the splitting, independent of any single model vendor. Editable units could let teams review, reorder, and reuse machine text the way programmers refactor code, instead of regenerating whole answers and hoping the good parts survive.

Catalog record

CREATORRyan Lingo, Rajeev Chhajer, Martin Arroyo, Luka Brkljacic, Ben Davis, Nithin Santhanam
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-08203

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Units Ryan Lingo, Rajeev Chhajer, Martin Arroyo, Luka Brkljacic, Ben Davis, Nithin Santhanam Abstract Large Language Models (LLMs) often produce monolithic text that is hard to edit in parts, which can slow down collaborative workflows. We present componentization , an approach that decomposes model outputs into modular, independently editable units while preserving context. We describe Modular and Adaptable Output Decomposition (MAOD) , which segments responses into coherent components and maintains links among them, and we outline the Component-Based Response Architecture (CBRA) as one way to implement this idea. Our reference prototype, MAODchat, uses a microservices design with state-machine-based decomposition agents, vendor-agnostic model adapters, and real-time component manipulation with recomposition. In an exploratory study with four participants from academic, engineering, and product roles, we observed that component-level editing aligned with several common workflows and enabled iterative refinement and selective reuse. Participants also mentioned possible team workflows. Our contributions are: (1) a definition of componentization for transforming monolithic outputs into manipulable units, (2) CBRA and MAODchat as a prototype architecture, (3) preliminary observations from a small user study, (4) MAOD as an algorithmic sketch for semantic segmentation, and (5) example Agent-to-Agent protocols for automated decomposition. We view componentization as a promising direction for turning passive text consumption into more active, component-level collaboration. K eywords Componentization, Large Language Models, Human-AI Interaction, Modular Output Decomposition, Component-Based Architecture, Explainable AI, Language Agents, Collaborative AI, Interface Design 1 Introduction Large Language Models (LLMs) are now common in knowledge work and creative tasks. People use them to draft prose, explain or synthesize code, sketch multi-step plans, and generate structured text like tables or JSON. Yet across these use cases, collaboration is often hampered by a core architectural limitation: LLMs return a single monolithic block. Whether the output is text, source code, a stepwise plan, or a structured reply, its all-or-nothing form resists targeted edits. This monolithic structure creates friction. To fix a small part, users typically face two inefficient paths, a dilemma we call the Copy–Paste Problem (Figure 1 ). One path is to copy the whole response into an external editor, severing it from the conversational context and foregoing further AI assistance [ 7 ] . The other is iterative re-prompting, which risks overwriting good sections while chasing one local change and can make the conversation unwieldy [ 1 ] . These patterns slow revision and make fine-grained collaboration harder, especially on complex tasks. The Copy–Paste Problem: Typical Workflows Across Output Types Scenario A (email): LLM returns a 5-paragraph update. User needs only to adjust tone in paragraph 3. Current options: 1. Copy everything to an editor, edit paragraph 3, lose the link to the chat context and easy re-use. 2. Re-prompt “make paragraph 3 more formal,” risk unintended changes in paragraphs 1, 2, 4, and 5; repeat several times. Outcome: Manual effort or unwanted global changes. Scenario B (code / plan): LLM returns a Python module or a 7-step plan. User needs to modify one function or step 4. Current options: 1. Paste into an IDE or doc, edit locally, break provenance with the conversation. 2. Re-prompt to change a single function/step, risk regressions elsewhere (imports, tests, later steps). Outcome: Context loss or cascade changes outside the target area. Figure 1: Two common failure paths when users try to adjust one part of a monolithic response. The issue appears across emails, code, plans, reports, and structured outputs. We propose componentization , an output-centric approach that breaks an LLM response into discrete, semantically coherent units, called components . Users can then edit, include or exclude, or regenerate these components in place. Components generalize beyond writing: for code they may be functions, classes, import blocks, or tests; for plans, individual steps or subgoals; for structured text, table rows/columns or JSON subtrees. This framing borrows from modular software principles such as separation of concerns and interchangeability [ 10 , 15 ] . Instead of treating a response as a final artifact, we treat it as a set of manipulable building blocks for user-directed composition. To make this concrete, we outline the Component-Based Response Architecture (CBRA) , which organizes generation, decomposition, manipulation, and recomposition as first-class stages, and we provide a reference prototype, MAODchat , that illustrates the approach. While our prototype focuses on text-like outputs (natural language, code, pseudo-code, and structured text), the architecture is content-type-agnostic when outputs can be represented as typed components with links. Our contributions are: 1. Conceptualization: A definition of componentization for turning monolithic LLM outputs, including prose, code, plans, and structured text, into manipulable units. 2. Architecture: CBRA and a MAODchat prototype that illustrate a microservices-style design with vendor-agnostic model integration. 3. User Study: Preliminary qualitative observations (n=4) suggesting that component-level editing aligns with several real workflows beyond writing. 4. Method: MAOD , an algorithmic sketch for semantic segmentation that preserves relationships among components. 5. Protocols: Example Agent-to-Agent patterns for automated decomposition in multi-agent systems. 2 Related Work LLMs are reshaping the landscape of Human-Computer Interaction (HCI). While these models offer powerful generative capabilities, their integration into human workflows is still an active area of research. This review examines existing literature across four key domains: the nature of human-AI collaboration, the paradigm of prompt engineering, emerging techniques for direct output manipulation, and the future of multi-agent systems. 2.1 Human-AI Interaction and Collaboration Recent HCI research has focused heavily on understanding how humans and AI collaborate, particularly in creative and professional tasks like writing [ 6 , 15 ] . Studies of real-world use have identified various prototypical behaviors in LLM-assisted writing, revealing a complex interplay between the user and the model [ 9 ] . Prior work suggests that effective human–AI collaboration can improve written outputs in some settings [ 7 , 3 ] . However, this potential is often constrained by existing interfaces, which can lack the affordances needed for deep collaboration and unstructured problem-solving [ 13 ] . A primary challenge lies in the design of the interaction itself. Some researchers propose flipping the conventional dynamic, where the LLM asks questions to guide the human writer, thereby enhancing the collaborative experience [ 3 , 4 ] . Others highlight the need for better user feedback mechanisms within the interface to guide the model’s output more effectively [ 15 , 11 ] . The way users conceptualize and anthropomorphize LLMs significantly impacts the nature of the interaction and suggests the need for interfaces that clarify the AI’s role as a tool [ 13 , 11 ] . This body of work points to a need for interfaces that move beyond the simple chat interface to support a richer, more controlled collaborative process [ 7 , 13 ] . While foundational models for human-AI collaboration have been proposed, our work offers a concrete architectural pattern that may help realize these models in practice. 2.2 Prompt Engineering as the Dominant Paradigm Currently, the primary method for controlling and directing LLMs is prompt engineering [ 1 , 13 ] . This input-side paradigm has evolved from simple instructions into a sophisticated discipline [ 1 , 13 ] . The complexity of prompting has grown, leading to taxonomies of prompt modifiers for specialized tasks like image generation and

Read the complete text