From Intent to AI Pipelines: A Controlled Agentic Framework for Non-AI Expert Scientists DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Volume: 37 4 111 8 CCS: Software and its engineering Integrated and visual development environments
Hyacinth Ali, Jessie Galasso-Carbonnel, Houari Sahraoui · 2026
Read From Intent to AI Pipelines: A Controlled Agentic Framework for Non-AI Expert Scientists DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Volume: 37 4 111 8 CCS: Software and its engineering Integrated and visual development environments by Hyacinth Ali, Jessie Galasso-Carbonnel, Houari Sahraoui (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18764.txt.
Introduction
Hyacinth Ali, Jessie Galasso-Carbonnel, and Houari Sahraoui present DDAP, a 2026 guided framework helping non-experts to build AI pipelines. Many lack the expertise to design AI systems, though pipelines now serve medicine, agriculture, and social science. DDAP runs four stages: problem scope, environment setup, pipeline building, and code building. It adapts to domain context, user skill, and resource limits while keeping user control. Tested across business, biology, and health data against expert models, DDAP reaches competitive results in several tasks, though performance varies for text clustering.
Catalog record
| CREATOR | Hyacinth Ali, Jessie Galasso-Carbonnel, Houari Sahraoui |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50859 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18764
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Intent to AI Pipelines: A Controlled Agentic Framework for Non-AI Expert Scientists DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Volume: 37 4 111 8 CCS: Software and its engineering Integrated and visual development environments Hyacinth Ali, Jessie Galasso-Carbonnel, Houari Sahraoui Abstract . Artificial Intelligence (AI) pipelines have become integral to modern research, supporting fields such as Medical Sciences, Agriculture, and Social Sciences, and enabling large-scale data analysis, predictive modeling, and the automation of complex tasks. However, designing and implementing AI solutions remains challenging for many researchers due to the expertise required in the design and development of end-to-end AI systems. To address this gap, we present Domain-Driven Adaptable AI Pipelines (DDAP), a controlled, human-in-the-loop, agentic framework that leverages large language models to guide users in a systematic construction of AI pipelines and their corresponding implementation code. DDAP structures the development process into four stages: problem definition, compute environment specification, pipeline generation, and code generation. Through this staged interaction, the framework adapts to domain context, user expertise, and resource constraints, while maintaining user control over key decisions. We evaluate DDAP across multiple datasets spanning business, biology, and health science domains by comparing its AI models against expert-developed models. The experimental results show that DDAP achieves competitive results in several tasks compared to expert baselines, although performance varies across problem types, particularly for text-based clustering tasks. By combining guided interaction, adaptability, and reproducibility, DDAP demonstrates that a controlled agentic framework can generate competitive AI pipelines for non-expert users. 1. Introduction Artificial Intelligence (AI) has become a cornerstone of modern scientific research, with applications spanning healthcare ( 31 ) , natural sciences ( 28 ) , and social sciences ( 21 ) . Increasingly, scientists leverage AI pipelines to analyze complex datasets, automate experimentation, and accelerate discovery. This widespread adoption signals a transformative shift in how research is conducted across disciplines. Despite these advances, scientists face significant challenges when attempting to design and implement AI pipelines independently. Developing an effective AI solution requires expertise at multiple levels: formulating a research question as an AI task, preparing data, selecting and training/aligning models, and finally deploying solutions in real-world environments. Each of these stages presents non-trivial barriers, particularly for researchers with limited backgrounds in machine learning or software engineering ( 39 ; 45 ) . Consequently, many scientists remain dependent on collaborations with AI specialists, a dependency that can slow down research progress and limit accessibility ( 21 ) . A variety of low-code and no-code frameworks have been proposed to address these barriers ( 50 ; 34 ) . While such frameworks lower the technical entry point, they often lack sufficient flexibility, adaptability to domain-specific constraints, or support for the entire pipeline lifecycle. More recently, large language models (LLMs) have been used directly by scientists to generate pipeline code from natural language descriptions. Although promising, this approach faces important limitations. First, LLM outputs can be unreliable, producing incomplete, non-reproducible, or suboptimal pipelines. Second, LLMs frequently overlook domain-specific constraints, such as regulatory requirements in healthcare or experimental reproducibility in the natural sciences. Third, effective use of LLMs still demands significant technical skills: crafting appropriate prompts, validating generated code, and debugging errors all place a high cognitive load on non-experts. Finally, the opaque decision-making of LLMs introduces challenges for transparency and reproducibility ( 8 ; 9 ) . These issues point to a broader methodological gap: while frameworks exist for conceptualizing the transition from problem descriptions to machine learning workflows ( 40 ) , existing tools do not sufficiently operationalize this process in a way that is accessible to non-experts. This gap motivates the need for a more guided and domain-sensitive approach to AI pipeline design, one that integrates domain expertise directly into pipeline construction while lowering technical barriers. To address these challenges, we frame AI pipeline construction as a software engineering problem of synthesizing executable workflows from high-level domain intent under uncertainty. The key difficulty lies not only in model selection, but in systematically transforming incomplete, domain-specific problem descriptions into consistent, reproducible, and executable software artifacts. We propose Domain-Driven Adaptable AI Pipelines (DDAP), a controlled, human-in-the-loop, agentic framework that operationalizes this process as an artifact-driven workflow. Rather than treating large language models as fully autonomous generators, DDAP organizes them as coordinated agents within a staged orchestration process that incrementally refines problem specifications into structured pipeline designs and implementation code. This design explicitly emphasizes artifact generation, traceability, and reuse, aligning AI pipeline construction with established software engineering principles such as modularity, separation of concerns, and reproducibility. Contributions. This paper makes the following contributions: • An artifact-driven formulation of AI pipeline generation as a software engineering problem. We model pipeline construction as a staged synthesis process that transforms high-level domain intent into executable artifacts, moving beyond AutoML approaches that rely on search over predefined components. • A controlled agentic framework for end-to-end pipeline synthesis. Unlike low-code/no-code platforms based on static templates, DDAP dynamically adapts to domain context, user expertise, and resource constraints through guided interaction and staged refinement. • An orchestrated multi-stage workflow for reliable LLM-based generation. In contrast to single-step LLM prompting, DDAP decomposes pipeline generation into coordinated stages with explicit artifact reuse and control logic, improving reproducibility and user control. • An empirical evaluation demonstrating competitive performance without iterative optimization. Across multiple domains, DDAP generates pipelines in a single pass that achieve performance comparable to expert-designed models, while exposing limitations in complex tasks such as textual clustering. The remainder of this paper is structured as follows. Section 2 presents the background of the study. Section 3 introduces the DDAP framework and its components. Section 4 presents several experiments, illustrating the applicability of the DDAP framework across different domains. Section 5 discusses related work, and Section 6 concludes the paper. 2. Background The section presents the background necessary to support the proposed controlled agentic framework. We first review Large Language Models (LLMs) and discuss techniques for improving their reliability, controllability, and task performance. These techniques are central to the orchestration mechanisms used in the DDAP framework. We then introduce the evaluation metrics employed in this work to assess the effectiveness of the generated AI pipelines across classification, regression, and clustering tasks. 2.1. Large Language Model Large Language Models (LLMs) are foundation models ( 12 ) based on deep neural networks and Transformer architecture. LLMs have demonstrated outstanding capabilities across a wide range of Natural Language Processing (NLP) tasks ( 38 ) , as well as code generation ( 27 ) . These capabilities position LLMs as foundational components for building intelligent systems that can assist users in problem formulation, reasoning, and solution generation ( 22 ) . Despite these strengths, LLMs possess several limitations, particularly, training and deployment of LLMs require substantial computational resources, which limits accessibility for many users and organizations. Moreover, LLMs are prone to generating plausible yet incorrect outputs, which raises concerns about reliability in high-stakes and safety-critical systems. These challenges highlight the need for structured frameworks that can harness the capabilities of LLMs while mitigating their limitations, an objective that motivates their guided integration within the proposed DDAP framework. 2.2. LLM Adaptation and Prompt Techniques