Understanding Conversational Patterns in Multi-agent Programming: A Case Study on Fibonacci Game Development DOI: 10.1145/3805760.3814914 ISBN: 979-8-4007-2601-9/2026/07 Conference: Proceedings of the 3rd ACM International Conference on AI-Powered Software; July 6–7, 2026; Montreal, QC, Canada Proceedings of the 3rd ACM International Conference on AI-Powered Software (AIware ’26), July 6–7, 2026, Montreal, QC, Canada fseaiware26main-pp019-p CCS: Software and its engineering Software performance
Srijita Basu, Viktor Kjellberg, Simin Sun, Bengt Haraldsson, Md. Abu Ahammed Babu, Wilhelm Meding, Farnaz Fotrousi, Miroslaw Staron · 2026
Read Understanding Conversational Patterns in Multi-agent Programming: A Case Study on Fibonacci Game Development DOI: 10.1145/3805760.3814914 ISBN: 979-8-4007-2601-9/2026/07 Conference: Proceedings of the 3rd ACM International Conference on AI-Powered Software; July 6–7, 2026; Montreal, QC, Canada Proceedings of the 3rd ACM International Conference on AI-Powered Software (AIware ’26), July 6–7, 2026, Montreal, QC, Canada fseaiware26main-pp019-p CCS: Software and its engineering Software performance by Srijita Basu, Viktor Kjellberg, Simin Sun, Bengt Haraldsson, Md. Abu Ahammed Babu, Wilhelm Meding, Farnaz Fotrousi, Miroslaw Staron (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24138.txt.
Introduction
Basu and seven co-authors study Designer and Programmer agents building a Fibonacci game across twelve pairings from seven open models. They track how fast pairs settle and hold, how well roles align, and how often builds succeed with errors fixed. Only the DeepSeek-R1 pair settled from the first round and held the correct answer to the last. LLaMA 3.2 and Qwen3 pairs held strong role alignment despite drifting from the correct answer. Other pairs drifted off task and never settled, showing loose talk does not yield correct results.
Catalog record
| CREATOR | Srijita Basu, Viktor Kjellberg, Simin Sun, Bengt Haraldsson, Md. Abu Ahammed Babu, Wilhelm Meding, Farnaz Fotrousi, Miroslaw Staron |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46303 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.24138
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Understanding Conversational Patterns in Multi-agent Programming: A Case Study on Fibonacci Game Development DOI: 10.1145/3805760.3814914 ISBN: 979-8-4007-2601-9/2026/07 Conference: Proceedings of the 3rd ACM International Conference on AI-Powered Software; July 6–7, 2026; Montreal, QC, Canada Proceedings of the 3rd ACM International Conference on AI-Powered Software (AIware ’26), July 6–7, 2026, Montreal, QC, Canada fseaiware26main-pp019-p CCS: Software and its engineering Software performance Srijita Basu, Viktor Kjellberg, Simin Sun, Bengt Haraldsson, Md. Abu Ahammed Babu, Wilhelm Meding, Farnaz Fotrousi, Miroslaw Staron Abstract . Large Language Models (LLMs) are increasingly applied to software engineering (SE), yet their potential for autonomous, role-oriented collaboration remains largely underexplored. Understanding how multiple LLM-based agents coordinate, maintain role alignment, and converge on solutions is critical for SE, as naively allowing agents to interact does not reliably lead to correct or stable outcomes. Recent empirical studies show that unstructured or poorly understood interaction dynamics can result in error propagation, premature consensus on incorrect solutions, or prolonged disagreement that prevents convergence, even when correct partial solutions are present early in the interaction. As an initial step towards addressing this underexplored area, we undertake a systematic analysis of conversations between two agents, a Designer and a Programmer across 12 model combinations from 7 open-source LLMs (Gemma 2, Gemma 3, LLaMA 3.2, LLaMA 3.3, DeepSeek-R1, MiniCPM, and Qwen3). Our systematic approach reveals three key dimensions of multi-agent interaction: efficiency (the speed and stability of convergence), consistency (the degree of role alignment visualized by BLEU and ROUGE), and effectiveness (the extent of compilation success and error resolution). Results show that the DeepSeek-R1:DeepSeek-R1 pair was unique in converging to the correct solution from the very first iteration and sustaining it consistently to the final iteration, while LLaMA 3.2:LLaMA 3.2 and Qwen3:Qwen3 demonstrated strong Designer:Programmer role alignment despite of diverging from the correct solution. The other pairs deviated from the task, never to converge to a result. These findings advance understanding of agentic programming and highlight the need for further research on understanding and calibrating convergence and stop conditions essential for future autonomous SE. † † cc-license: by 1. Introduction Recent advances in large language models (LLMs) have significantly influenced the software engineering (SE) landscape. Tools such as GitHub Copilot, ChatGPT, and CodeWhisperer have made LLM-assisted code generation and debugging easily accessible ( Jiang et al. 2024a ) ( Nguyen and Nadi 2022 ) . These tools, often embedded in IDEs and CI/CD workflows ( Chen 2024 ) , have demonstrated strong performance on programming benchmarks such as HumanEval, MBPP, and CodeXGLUE ( Jiang et al. 2024a ) ( Zheng et al. 2023 ) . Additionally, recent studies show the growing potential of multi-agent LLM systems to tackle complex SE tasks through structured collaboration and role specialization ( He et al. 2025 ) . However, existing evaluations of both LLM-assisted tools and role-based multi-agent systems predominantly focus on short, self-contained tasks, offering limited insight into how agents behave over sustained interactions ( Halim et al. 2025 ) . As LLM-based systems evolve toward more autonomous, multi-step problem solving, agents must maintain task focus, preserve role consistency, and coordinate effectively over extended dialogue sequences. Prior work further shows that unconstrained multi-agent interactions can systematically fail due to error propagation, premature consensus, or non-convergent dynamics ( Chun et al. 2025 ) . Together, these findings suggest that simply allowing agents to interact is insufficient and a deeper empirical understanding of how coordination unfolds over time is necessary to build reliable autonomous SE systems. Therefore, we conduct an exploratory use-case based empirical study aimed at characterizing how role-specialized LLM agents interact, coordinate, and converge during iterative programming problem solving. Rather than evaluating task difficulty or benchmark performance, our primary objective is to analyze conversational dynamics, such as role adherence, behavioral drift, convergence patterns, and interaction stagnation over sustained exchanges. To enable controlled observation of these phenomena, we use a single representative programming task, Write a mathematical game of Fibonacci , as a use case. This allows us to isolate interaction behaviors without confounding effects introduced by varying task specifications. We simulate conversations between two role-specialized agents, a Designer and a Programmer instantiated from seven open-source LLMs (Gemma 2, Gemma 3, LLaMA 3.2, LLaMA 3.3, DeepSeek-R1, MiniCPM, and Qwen3), resulting in 12 distinct agent pairs. Although our analysis centers on a single task, the resulting interaction traces reveal measurable coordination patterns, such as iteration thresholds preceding behavioral stagnation and specific agent pairings that demonstrate more stable convergence. These empirical signals provide a basis for formulating hypotheses about multi-agent interaction dynamics and inform the design of future studies involving more complex programming tasks and diversified agent roles. This study was guided by the following research questions, (1) RQ1 : What conversational patterns emerge during agent interaction?, (2) RQ2 : Which topics dominate these conversations?, (3) RQ3 : What do conversation length and alignment metrics reveal about the roles of Designer and Programmer agents in the problem-solving process? and (4) RQ4 : How does compilation success rate varies across agent pairs? Our work makes the following key contributions- (i) Efficiency: We analyze the solution convergence of agent pairs, thereby quantifying how quickly different agent pairs progress toward a correct solution and also observe the different conversational patterns and topics that emerge as a part of the journey (RQ1, RQ2) , ii) Consistency: We measure the semantic alignment between Designer and Programmer roles using BLEU ( Papineni et al. 2002 ) and ROUGE ( Lin 2004 ) scores, capturing how reliably the two agents remain on-task and coherent across turns (RQ3), and iii) Effectiveness: We study the Designer:Programmer model combinations to evaluate how often their interactions lead to a correct and compilable C program (RQ4). In a nutshell, this study establishes an initial empirical foundation for improving multi-agent LLM collaboration in programming contexts. By systematically analyzing role-based interaction patterns, we identify behavioral signals that can inform early stopping conditions and more stable coordination strategies, ultimately paving the way for scalable multi-agent programming systems capable of tackling larger and more complex SE tasks. This offers insight into the feasibility and limitations of agent collaboration in program comprehension and generation. E.g., by noting conversational patterns like repetition, divergence, or stalled convergence, this study helps anticipate failure modes in AI-based code assistants. SE tool developers could use these patterns to trigger early fallback strategies, e.g., model switching, human intervention, or prompt revision. Additionally, it also assists in selecting open-source models in organizations trying to build internal AI programming assistants. Finally, as SE transitions from AI-assisted workflows (SE 3.0) ( Hassan et al. 2024 ) to increasingly autonomous paradigms, the role of collaborative AI agents becomes central. While current tools support developers in specific tasks, future Autonomous SE systems will require agents that can communicate, reason, and coordinate roles without direct human intervention. Finally, we release an open replication package, https://github.com/SriAbir/AgenticAI with conversation datasets, orchestration code, and reproduction instructions, enabling researchers and practitioners to replicate our results, benchmark new LLMs, and experiment with alternative multi-agent configurations 2. Related Work This section situates our study within prior research on LLM-based code generation, reasoning-centric models, and multi-agent systems for SE, with a particular focus on agent collaboration and interaction dynamics. Several surveys have systematically reviewed the use of large