Structuring Human-AI Productive Interdependence by Strategic Level of Automation Selection for Qualitative Inquiry Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Co-Data Workshop at the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain CCS: Human-centered computing User studies CCS: Human-centered computing Empirical studies in HCI
Feng Zhou, Jacqueline Meijer-Irons, Ambar Murillo · 2026
Read Structuring Human-AI Productive Interdependence by Strategic Level of Automation Selection for Qualitative Inquiry Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Co-Data Workshop at the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain CCS: Human-centered computing User studies CCS: Human-centered computing Empirical studies in HCI by Feng Zhou, Jacqueline Meijer-Irons, Ambar Murillo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27634.txt.
Introduction
Feng Zhou, Jacqueline Meijer-Irons, and Ambar Murillo reframe human-AI teamwork in qualitative analysis as interdependence, not automation. Their framework picks a level of automation per analysis stage by weighing task risk against checking cost, guiding a deliberately joint workflow. A case study shows the approach builds steady trust while preserving the researcher's unique role in making meaning.
Catalog record
| CREATOR | Feng Zhou, Jacqueline Meijer-Irons, Ambar Murillo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16965 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27634
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Structuring Human-AI Productive Interdependence by Strategic Level of Automation Selection for Qualitative Inquiry Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Co-Data Workshop at the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain CCS: Human-centered computing User studies CCS: Human-centered computing Empirical studies in HCI Feng Zhou, Jacqueline Meijer-Irons, Ambar Murillo Abstract . While Large Language Models (LLMs) offer a solution to the scale-versus-depth dilemma in qualitative analysis, the paradigm of maximizing automation is fundamentally at odds with the interpretive nature of qualitative inquiry. We argue that effective Human-AI collaboration is not an automation problem, but an interdependence problem. This paper reframes the design of "co-data" systems through the lens of Interdependence Theory, proposing a formal framework to structure human-AI productive interdependence. The framework guides the selection of an appropriate Level of Automation (LoA) for different stages of the qualitative analysis process by assessing task risk and the cost of validation. We present a case study where this framework led to a deliberately interdependent workflow, fostering the calibrated trust necessary for rigorous analysis. We conclude by presenting three design principles that instantiate this framework, demonstrating how to leverage AI as a powerful partner while preserving the human researcher’s irreplaceable role in the transformation process of meaning-making. 1. Introduction Qualitative analysis is an interpretive craft. It is an iterative, reflexive process of deep reading, memoing, and meaning-making where the researcher is the primary analytical instrument ( 7 ) . The goal is not merely to count codes, but to construct a nuanced understanding of a human phenomenon. This craft, however, faces a crisis of scale, as the volume of qualitative data from surveys, interviews, and feedback platforms may overwhelm traditional manual methods ( 13 ) . Large Language Models (LLMs) present a tempting solution, where automation can help address the problem of scale ( 3 ) . However, this automation can threaten the very nature of qualitative work. A push for full automation risks de-contextualizing data, “flattening” rich meaning into pre-defined categories, and sidelining the researcher’s indispensable interpretive lens ( 2 ; 10 ) . To avoid this, we must ask a different question: not “How much can we automate?” but rather “How should we structure the interdependence between AI and the human researcher to aid researchers in leveraging the scaling capabilities of AI, while maintaining the nuance that is unique to qualitative analysis.” We posit that effective and rigorous AI-assisted qualitative analysis is a direct function of how this interdependence between AI and researchers is managed. This paper offers a framework for structuring this productive interdependence by strategically selecting an appropriate Level of Automation (LoA) ( 8 ) . This choice is a calculated decision based on the risk of interpretative failure and the cost of validation for each distinct task within the qualitative workflow. We ground this framework in an industry case study, showing how we evolved a productive interdependent partnership; as well as raising questions for future research. 2. A Framework for Structuring Productive Interdependence in Qualitative Inquiry We consider the nature of qualitative inquiry, following guides like Nicmanis & Spurrier ( 7 ) , we acknowledge that AI cannot replace the human’s role in interpretive tasks like thematic development and narrative construction. Therefore, we must necessarily move to consider how a human-AI collaboration can be effectively built for the use case of large-scale qualitative data analysis. Drawing from Interdependence Theory ( 12 ) , we argue that the researcher’s primary role is a collaboration architect who structures the productive interdependence: the rules, the tasks, and how outcomes are linked. The human researcher then engages in a transformation process, interpreting the outputs of this collaboration through their own goals, values, and contextual knowledge to create meaning. Key dimensions in this productive interdependence include complementarity of each role ( 4 ) , capability asymmetry ( 4 ) , causal communications ( 5 ) , and the correspondence of interests (the degree to which partners’ goals align). To architect a productive and well-calibrated interdependence that harnesses these dimensions for cooperative transformation, we must address specific tactical questions concerning the structure of human-AI collaboration in qualitative data analysis. Recognizing that the various phases of qualitative analysis necessitate distinct levels of AI engagement, we refer to the Levels of Automation (LoA) ( 8 ) research. Our decision regarding the appropriate LoA for each analytical phase is guided by two critical factors: (1) Risk of Interpretive Failure: What is the cost of an AI error to the final analysis? • High risk tasks demand a low LoA. Data analysis tasks that are central to meaning-making (e.g., final thematic synthesis, framing the narrative) are high risk, as errors here may invalidate the entire study. • Low risk tasks can accommodate a higher LoA. Repetitive, low-level tasks (e.g., open coding of a single comment) are typically lower risk and more tolerant of errors. (2) Validation cost: How difficult is it to validate the AI’s work? • High cost of validation tasks require a low LoA. For example, tasks that require deep, tacit knowledge to evaluate (e.g., “Is this the right recommendation based on the user pain points?”) • Low cost of validation tasks can accommodate a higher LoA. For example, analysis tasks that can be easily checked against source text (e.g., “Does this quote support this insight?”) 3. Case Study: A Human-AI Workflow for Qualitative Analysis DataSat is a large-scale internal survey program at Google designed to collect feedback from thousands of employees on their experience with over 100 internal tools. Each survey run generated about 10,000 qualitative data points—a rich but overwhelming source of user sentiment. Our challenge was to scale our data analysis, while keeping the depth of analysis, to go from data to insight in a more efficient manner. We implemented a three-phase workflow, where the human researcher and AI took complementary roles ( 4 ) across different stages with task dependent agency and causal communications to maximize the joint performance, thus creating a productive interdependence. Phase 1: Structuring the Foundation. From an Interdependence Theory perspective, this initial phase was a deliberate act of collaboration architecture. The researcher first exercised unilateral control by defining the codebook and 100 seed examples, establishing the foundational “rules of the world” for the AI. We then introduced asymmetrical interdependence, tasking the AI with coding the next 900 comments. In this step, the AI depended on our expert examples, while we depended on its speed. However, we identified this as high-risk because the AI’s goal (pattern-matching) does not perfectly correspond with the researcher’s goal (interpretive accuracy). Therefore, the final, crucial step was an act of human behavior control: we manually verified all 900 AI-coded comments. This transformation of the AI’s raw output into the final “golden dataset” was the necessary upfront investment. It ensured the interdependence for the rest of the project was aligned with our goals, creating a trustworthy foundation for the partnership that followed. Phase 2: AI-Assisted Open Coding (AI as Tactical Analyst). The AI performed high-volume open coding. This collaboration was defined by high mutual dependence with causal communication: AI depended on the human’s golden dataset,