Flight Testing an Optionally Piloted Aircraft: a Case Study on Trust Dynamics in Human-Autonomy Teaming
1 st Jeremy C.-H. Wang, 2 nd Ming Hou, 3 rd David Dunwoody, 4 th Marko Ilievski, 5 th Justin Tomasi, 6 th Edward Chao, 7 th Carl Pigeon · 2025
Read Flight Testing an Optionally Piloted Aircraft: a Case Study on Trust Dynamics in Human-Autonomy Teaming by 1 st Jeremy C.-H. Wang, 2 nd Ming Hou, 3 rd David Dunwoody, 4 th Marko Ilievski, 5 th Justin Tomasi, 6 th Edward Chao, 7 th Carl Pigeon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16227.txt.
Introduction
Wang and co-authors study trust between people and an aircraft that can fly with or without a pilot in a 2025 case study. Trust in such teaming is often modeled as a fixed trait, yet in real flights it rises and falls as events unfold. The team reviewed more than 200 hours of flight test data from a campaign that ran from 2021 to 2023.
They applied three trust models to the data, each stressing a different side of trust, from habits and context to process and purpose. The models helped trace how trust, trust thresholds, and crew behavior shifted during normal autonomous flights. The authors point to design lessons for building trust in such teams.
Catalog record
| CREATOR | 1 st Jeremy C.-H. Wang, 2 nd Ming Hou, 3 rd David Dunwoody, 4 th Marko Ilievski, 5 th Justin Tomasi, 6 th Edward Chao, 7 th Carl Pigeon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-16227
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Flight Testing an Optionally Piloted Aircraft: a Case Study on Trust Dynamics in Human-Autonomy Teaming 1 st Jeremy C.-H. Wang, 2 nd Ming Hou, 3 rd David Dunwoody, 4 th Marko Ilievski, 5 th Justin Tomasi, 6 th Edward Chao, 7 th Carl Pigeon Abstract This paper examines how trust is formed, maintained, or diminished over time in the context of human-autonomy teaming with an optionally piloted aircraft. Whereas traditional factor-based trust models offer a static representation of human confidence in technology, here we discuss how variations in the underlying factors lead to variations in trust, trust thresholds, and human behaviours. Over 200 hours of flight test data collected over a multi-year test campaign from 2021 to 2023 were reviewed. The dispositional-situational-learned, process-performance-purpose, and IMPACTS homeostasis trust models are applied to illuminate trust trends during nominal autonomous flight operations. The results offer promising directions for future studies on trust dynamics and design-for-trust in human-autonomy teaming. [ ] I Introduction How do humans develop the confidence to use emerging technologies—that is, how do we learn to trust that which is new? Studies show that a myriad of factors produce statistically significant empirical effects on the degree to which humans are willing to depend on technology, such as the expertise and demographics of the trustor, the reliability and anthropomorphism of the trustee, and the difficulty and risk of the task at hand [ 1 , 2 , 3 , 4 ] . These factors are often grouped into categories for the purpose of analysis, yielding various trust models such as the performance-process-purpose (3P) model [ 5 ] and dispositional-situational-learned (DSL) model [ 6 ] . Safety is arguably the most important factor that affects human trust in emerging aviation technologies, especially in the case of aircraft automation. Regulators set safety requirements across the entire aircraft life cycle from design through to production, operation, and maintenance [ 7 , 8 , 9 ] . When regulators deem these requirements satisfied, they issue certificates, permits, or other formal approvals that help instil public confidence [ 10 ] . Garmin Autoland, which can automatically land an aircraft if it determines the pilot is unable to fly, offers a contemporary example of celebrated automation [ 11 ] . Conversely, major incidents such as the Boeing 737 MAX [ 12 ] crashes can significantly damage confidence in specific technologies, not to mention the organizations charged with their development and regulation. The highly dynamic and contextual nature of trust also manifests in other safety-critical contexts, for instance, the Cruise robo-taxi incident [ 13 ] . Trust can thus be earned, maintained, or lost in response to underlying factors. Although trust factors have been established in the literature, the continuously varying nature of trust over time is not well-studied. In an era of increasingly complex and automated aircraft [ 14 , 15 ] , human factors engineering would benefit from research that investigates the highly dynamic relationship between humans and their willingness to depend on emerging technologies. Indeed, the study of trust variation and evolution has been proposed as one of the key enablers for effective Human-Autonomy Teaming (HAT) [ 16 , 17 , 18 ] . Hou et al. ’s recent IMPACTS Homeostasis (IMPACTS-H) trust model offers a promising conceptual framework that considers trust as a changing quantity whose distance from some threshold influences how human operators interact with intelligent systems [ 16 , 4 ] . This working paper seeks to narrow the knowledge gap in dynamic trust by studying human behaviours observed during flight testing of an optionally piloted aircraft (OPA). OPAs are aircraft that may be flown in an uncrewed or crewed fashion, thus offering the flexibility to assess autonomous capabilities with onboard or remote human supervision. The 3P and DSL and IMPACTS-H trust models are used to analyze flight test crew behaviours, shedding light on the variable nature of human confidence in HAT. II Experimental Design Modern autopilots are no longer ”dumb and dutiful”, nor are they limited to the simplistic designs used in small recreational or commercial drones [ 19 ] . Instead, contemporary autopilots act evermore as a partner that complements their human operator counterparts. Historical data of numerous flight tests were analyzed to reveal the time evolution of trust by personnel involved in this emerging technology. The original purpose of these flight tests was the development, performance evaluation, and demonstration of autonomous flight capabilities—for the purpose of this paper, the same flight test data was re-analyzed in the context of trust in HAT. II-A Equipment The Ribbit autonomy stack was integrated aboard a two-seat Quad City Challenger 2 airplane (Fig. 1 ), resulting in an OPA capable of automated gate-to-gate flight operations from runway-based airports. This technology is being developed for the purpose of improving access to transportation in hard-to-reach areas, e.g. for civil air freight [ 20 ] , food resupply [ 21 ] , as well as force projection and sustainment. Aircraft state was measured and recorded through several onboard sensors, such as an air data boom, inertial measurement unit, and cockpit camera. A Ground Control Station (GCS) also permitted remote pilots and/or flight test engineers to monitor aircraft state live from afar (Fig. 2 ). All designs, modifications, and flight tests were conducted within the framework of the Canadian Aviation Regulations [ 8 ] . When operated with an onboard safety pilot, the pilot was capable of monitoring various aircraft state variables as well as engaging or disengaging the autonomous autopilot to restore stick-and-rudder control. When operated in a remotely piloted fashion, the pilot was able to assume manual control via fly-by-wire inceptors on the GCS. Fig. 1: The OPA used in this study, shown during remotely supervised autonomous flight tests near Canadian Forces Base Cold Lake. Fig. 2: The GCS used by remote pilots and flight test engineers to monitor and interact with the OPA from a ground-based setting. II-B Test Procedures Flight tests were conducted over a three-year period from 2021 to 2023, accumulating some 200 hours of aircraft-in-motion data spanning autonomous taxi, takeoff, enroute, and landing test sequences. Significant variation in environmental conditions was included by design, including summer and winter operations, and flight tests up to the baseline aircraft’s maximum demonstration crosswind. For safety and efficiency, all tests were planned in advance and flown in simulation prior to execution on the physical aircraft. The purpose of flight tests were generally for benchmarking ( e.g. establishing a human performance baseline), system identification ( i.e. generating a physics model of aircraft dynamics and stability), system tuning ( e.g. refining controller and navigation parameters to achieve desired performance), verification of design requirements, and demonstration to third-party observers. II-C Data Generation, Analysis, & Interpretation The trust levels and thresholds of three (3) different test engineers and two (2) different test pilots are considered in this study. These participants were asked to review historical time-series data consisting of time-synchronized cockpit videos, flight displays, and flight test engineering graphs of key aircraft state variables ( i.e. setpoint and process values for outer loop and inner loop control variables) from the aforementioned test campaign. It is important to note that while these participants are the same individuals who conducted the original