U2F: Encouraging SWE-Agent to Seize Novelty without Losing Feasibility
Wencheng Ye, Yan Liu · 2025
Read U2F: Encouraging SWE-Agent to Seize Novelty without Losing Feasibility by Wencheng Ye, Yan Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-03517.txt.
Introduction
Wencheng Ye and Yan Liu propose U2F, a multi-agent system that pushes software agents to hunt for novel fixes without losing workable ones. Language model agents for coding mostly attack well-defined problems with standard methods, missing fresh paths in open settings. U2F is built to surface unknown unknowns, solution routes absent from the first problem statement.
A discovery, exploration, and integration team uncovers candidate paths and merges the best of them. Cognitive boosts help agents hold onto uncertainty as a resource rather than a flaw. Tests in open software settings check whether novelty survives contact with feasibility demands. The aim is agents that invent when templates run dry, yet still ship code that runs.
Catalog record
| CREATOR | Wencheng Ye, Yan Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-03517
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
U2F: Encouraging SWE-Agent to Seize Novelty without Losing Feasibility Wencheng Ye, Yan Liu Abstract . Large language models (LLMs) have demonstrated considerable capabilities in software engineering tasks, yet existing LLM-based SWE-Agent predominantly address well-defined problems using conventional approaches, potentially overshadowing viable alternative solutions that fall outside their predefined frameworks. This limitation becomes notable in open-world software environments where novel challenges emerge that extend beyond established solution paradigms. Current SWE-Agents, while making initial attempts at addressing such complexities, are constrained by ad-hoc methodologies and tend to operate within narrow scopes—targeting localized problems such as individual bug remediation—rather than engaging in comprehensive solution space exploration. In this work, we present U2F (Unknown Unknowns to Functional solutions), a cognitive-inspired and uncertainty-embracing multi-agent architecture tailored to systematically surface “Unknown Unknowns”—solution pathways absent from initial problem formulations but possessing innovative potential. Our scaffolding comprises two core components. First, we develop a Discovery-Exploration-Integration agent system that enables Unknown Unknowns identification at problem deconstruction, creative exploration, and feasible synthesis levels. Second, we implement cognitive enhancement mechanisms along three axes—cross-domain analogical reasoning, reverse thinking, and external validation—that observe, analyze, and transform conventional solution boundaries through strategic reframing and knowledge integration. We demonstrate our framework’s effectiveness by applying it to 218 real-world software enabler stories, which were curated from authentic engineering tasks , with the resulting solution quality assessed by 15 domain experts and an LLM judge. Human assessments show improvements: novelty scores increased by 14%, semantic novelty improved by 51%, while feasibility remained stable at 4.02/5.0, with consistent findings from the LLM judge. These results suggest a promising direction for leveraging uncertainty as a source of innovation in software engineering. 1. Introduction While modern software engineering agents powered by large language models (LLMs) excel at fixing known problems, their ability to innovate—to discover solutions no one thought to ask for—remains underdeveloped. This leaves substantial potential for innovation, grounded in extensive knowledge repositories, largely untapped. Though LLMs possess vast pre-trained knowledge, existing systems face limitations in leveraging this knowledge for creative problem-solving in open-world environments ( 1 ; 11 ) , where dynamic, loosely-bounded ecosystems introduce substantial uncertainty and risk ( 4 ; 23 ) , requiring solutions that extend beyond conventional approaches. Figure 1. Progressive discovery of Unknown Unknowns. The dialogue demonstrates how systematic exploration reveals solution pathways absent from the initial requirement. Classic software engineering practice excels at addressing structured problems within established frameworks—what Rumsfeld’s taxonomy categorizes as "Known Knowns" (familiar problems with established solutions) and "Known Unknowns" (recognized challenges requiring investigation) ( 9 ) . However, this conventional focus may overlook opportunities beyond established problem framings, forming "Unknowns Unknowns" (UUs) ( 6 ; 9 ; 21 ) : solution paths, technical approaches, or system capabilities absent from initial problem descriptions but potentially influencing project outcomes. Rumsfeld’s framework also identifies "Unknown Knowns"— knowledge residing in team members’ expertise yet unarticulated or unrecognized ( 9 ) . Eliciting such implicit knowledge requires probing unarticulated human expertise through interactive methods, a process fundamentally distinct from our framework’s automated analysis of documented artifacts. The potential for such paradigm-shifting insights has also not gone unnoticed by software engineering practitioners, leading to the development of specialized frameworks for technical discovery. While frameworks like SAFe Agile acknowledge this challenge through "Enabler Stories" for exploratory technical work ( 26 ) , their solution design remains heavily dependent on individual engineer expertise, lacking formal approaches for UUs discovery. Recently, the emergence of LLMs with their vast, interconnected knowledge repositories has sparked exploration into requirement engineering. Consider the development of a night surveillance system, as illustrated in Figure 1 . Traditional approaches focus on optimizing detection algorithms or developing sophisticated alarm systems within the established problem frame. However, an Unknowns Unknowns emerges through interacting with LLM: proactive illumination systems can simultaneously serve surveillance needs while providing psychological deterrent effects—a solution pathway absent from the initial technical requirement. This reveals a glimpse of what’s possible, yet such ’aha moments’ are rare and unpredictable. Advances in LLM-based SWE agents further offer promising tools for solution generation ( 8 ; 25 ) . However, directly applying these agents to technical exploration faces critical limitations: technology stacking without clear rationale, requirement drift from original objectives, and generation of non-existent or contextually inappropriate solutions ( 14 ; 22 ) . Addressing these limitations requires more than prompt engineering ( 17 ) —it demands cognitive-level problem reframing to unlock the innovative potential embedded in LLMs’ vast knowledge repositories. This study explores how LLM can navigate open-world software environments to surface Unknowns Unknowns through a three-dimensional cognitive approach: cross-domain analogical reasoning that transfers insights from diverse fields to reveal unexpected solution pathways; reverse thinking that employs backward reasoning from desired outcomes to uncover hidden prerequisites and alternative approaches; and external validation that systematically identifies feasibility constraints before they become implementation barriers. These cognitive pathways lay the foundation of U2F (Unknowns Unknowns to Functional solutions), our framework features a design thinking inspired collaborative architecture: a Discovery Agent that identifies project constraints and exploration opportunities; an Exploration Agent that applies the cognitive strategies above to uncover Unknowns Unknowns; and an Integration Agent that synthesizes discoveries into actionable technical plans while maintaining feasibility. By incorporating external search capabilities and human-in-the-loop interfaces to ground exploration in real-world constraints, we developed a proof-of-concept prototype. Through evaluation by 15 domain experts and an LLM judge on 218 carefully curated scenarios, results show that U2F enhances solution innovativeness (14% improvement in novelty scores, a 51% increase in semantic novelty) while maintaining engineering feasibility, supporting the viability of systematic Unknowns Unknowns discovery in software engineering contexts. Our contributions include: (1) Problem Formulation and Initial Exploration: As far as we know, this is the first work to investigate Unknowns Unknowns discovery in the context of LLM-based SWE-Agents. We establish operational definitions, taxonomies, and exploration methodologies, providing a foundation for future research in this emerging area. (2) Cognitive-Level Innovation Mechanisms: We introduce and validate three complementary cognitive strategies that operate at the cognitive level rather than merely the prompt level, transforming how LLMs approach open-ended technical requirements. (3) Validation via a Multi-Agent Prototype: We craft U2F, a rigorous prototype that instantiates these cognitive strategies and agents orchestration. The system demonstrates how coordinated agent architectures can transcend individual cognitive limitations, achieving measurable improvements in solution innovativeness (14% novelty increase, 1.5× semantic novelty) while maintaining engineering feasibility (4.02/5.0). 2. Related Work 2.1. Unknowns Unknowns in Software Engineering Contexts The concept of "Unknowns Unknowns," introduced by Rumsfeld, refers to “things we don’t know we don’t know” ( 6 ; 9 ) —the deepest form of uncertainty. These unknowns involve solution paths or system capabilities that decision-makers may not even recognize ( 9 ; 21 ) . Systematically addressing them is crucial in strategic planning, security, and intelligence for improving decisions and reducing systemic risks ( 9 ; 21 ) . Applying this concept to software engineering is useful, as development occurs in complex ecosystems with vast solution spaces, interdependencies, and rapidly evolving technologies. Prior work in requirements engineering has proposed creative elicitation methods, e.g., analogical reasoning, counter-examples ( 28 ; 27 ) and building prototypes to tackle unknowns unknowns ( 13 ; 15 ) , but these remain largely manual, expensive and expertise-dependent. This paper introduces