A Framing and Analysis of Applicative Tangible Interfaces CCS: Human-centered computing HCI theory, concepts and models Conference: arXiv.org, Cornell University; 2025; Ithaca, NY, USA
Guillaume Rivière · 2025
Read A Framing and Analysis of Applicative Tangible Interfaces CCS: Human-centered computing HCI theory, concepts and models Conference: arXiv.org, Cornell University; 2025; Ithaca, NY, USA by Guillaume Rivière (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-24237.txt.
Introduction
Guillaume Riviere surveys tangible user interfaces, systems you operate by handling physical objects. The field began about thirty years ago. Its commercial potential now presses as a question. Graphical interfaces reached the market through reusable components. Riviere suggests tangible interfaces could split into components the same way.
He defines four roles that such components can play. A new interaction model describes their interplay. Physical items aggregate, combine, or couple to fill the roles. The test uses a representative collection of thirty-five applications. Their hundred fifty-nine physical items all distribute among the four roles. Further analysis ties the interfaces to four research phases in the field. Three main paths for future work emerge from that history. The article maps how a research field might turn into products.
Catalog record
| CREATOR | Guillaume Rivière |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-24237
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Framing and Analysis of Applicative Tangible Interfaces CCS: Human-centered computing HCI theory, concepts and models Conference: arXiv.org, Cornell University; 2025; Ithaca, NY, USA Guillaume Rivière Abstract . The investigation of tangible user interfaces commenced approximately thirty years ago. Questions on its commercial potential become more pressing as the field becomes mature. To take the field one step further—as the emergence of components contributed to the commercial development of graphical user interfaces—this article suggests that applicative tangible user interfaces could also be split into components. These components are composed of the aggregation, combination, or coupling of physical items and fulfil four roles that are described through a new interaction model. This article successfully distributed among these four components’ roles all of the 159 physical items from a representative collection of 35 applications. Further examination of these applicative tangible interfaces coincides with four research phases in the field and identifies three main paths for future research to fully realize the potential of tangible user interfaces. 1. Introduction Since the conceptualization of tangible user interfaces (TUIs) in 1997 ( 50 ) , researchers have produced several hundred specimens over the past few decades. For instance, the Tangible Media Group at the MIT Media Lab alone generated an impressive 218 specimens 1 1 1 See the project page of the Tangible Media Group: https://tangible.media.mit.edu/projects/ (last accessed on August 31, 2023). between 1997 and 2023 (i.e., an average of eight specimens yearly across twenty-six years). This landscape of tangible interfaces comprises prototypes showcasing new technologies (e.g., The Actuated Workbench ( 66 ) ), and others exhibiting concrete applications of the concept (e.g., Computational Optimization ( 67 ) ). While the number of prototypes grew yearly, taxonomies, paradigms, and frameworks emerged to facilitate a better understanding of tangible user interfaces 42 , 64 , 85 : Ch. 5 , 97 : Ch. 3 . In 2010 and, more recently, in 2022, an extensive review ( 85 ) and a thorough book ( 97 ) provided comprehensive overviews of the field. With increasing maturity, there is growing scrutiny of the market viability and realism of tangible interfaces ( 39 ; 40 ) . When examining the history of graphical user interfaces (GUIs), the process of standardization and industrialization began with the imagination of the WIMP (Windows, Icons, Menus, Pointer) components 2 2 2 The origins of WIMP components date back to as early as 1968 or possibly even 1945 ( 35 ) (as cited in ( 40 ) ). ( 40 ; 89 ; 88 ) and their simplification ( 40 ) in the early 1980s, which took advantage of the mouse invention over a decade earlier ( 23 ) . Stimulated by this history, this article suggests studying the components found in the applicative tangible interfaces that have been proposed in the literature by raising the following questions. Could we split applicative tangible user interfaces into components? Are all these components required to develop applicative tangible user interfaces? Are there blind spots in tangible components that require further investigation before tangible interfaces could become ready for industrial development? Previous work have framed the landscape of tangible user interfaces to better understand the degrees of tangibility and revealed trends in three same applicative domains to reach higher degrees of tangibility ( 25 ) . This work frames applicative tangible user interfaces at the level of their tangible components, which are revealed from the aggregation of physical items into roles that are articulated through a new interaction model. Describing a collection of 35 applicative tangible user interfaces (that deal with different application domains, or deal with same application domains differently) enables retrieving and confirming four development phases of the field, as well as scrutinizing underexplored opportunities of components for richer interaction and more complete applications, and providing insights for further exploring the components required for applicative tangible interfaces. Furthermore, these analyses are refined through four classes of bodiness that are defined for applicative tangible user interfaces according to the physical items involved in the implementation of their tangible data components. First, this article provides an overview of the roles imagined in earlier models, notations, and toolkits, along with a summary of taxonomies and classifications regarding tangible interfaces. Subsequently, it establishes a novel taxonomy of physical items by relying on a new interaction model and constructs a classification of applicative tangible interfaces based on this taxonomy. It then showcases the taxonomy and the classification by detailing a collection of 35 applications from the literature and examining interfaces’ designs and the field’s evolution. Finally, it concludes by addressing some future directions for the field and outlining some limitations of the work. 2. Related Work Models of interaction and interfaces abstract the entities involved in interaction by assigning them roles. Then, interaction and interfaces can be described, understood, and compared across paradigms. Efforts to better understand tangible interfaces also call for taxonomies and classifications of these user interfaces. This section reviews (1) the roles described in some previous models, notations, and toolkits and (2) some taxonomies and classifications of tangible interfaces. 2.1. Roles in Models, Notations, and Toolkits Instrumental interaction ( 4 ) is an interaction model in which “instruments” are used to edit “domain objects” (i.e., data role) attributes. These instruments consist of a physical part (an input device) and a logical part (a graphical representation of the instrument) that translate user actions into commands that edit domain objects. Instruments provide the user with reactions from the instrument on its actions and feedback from edited object responses. In time-multiplexed conditions, activating the instrument entails associating the physical and logical parts ( 4 ) . For example, the instrument may be activated by directly pointing at it or clicking a button in a tool palette ( 4 ) . Instrumental interaction permits the description and comparison of WIMP interaction and interaction with graspable user interfaces ( 26 ) within a unified interaction model ( 4 ) . In the mixed interaction model ( 15 ) , instruments are refined as “mixed tools” (i.e., tools role), and domain objects become “task objects” (i.e., data role), both of which are categorized as “mixed objects.” Mixed objects possess physical and logical properties that are interconnected through “linking modalities” ( 15 ) . Input linking modalities sense physical proprieties using input devices and convert them into digital properties through input languages ( 15 ) . Conversely, output linking modalities utilize output languages and devices to translate digital properties into physical properties ( 15 ) . Hence, where instrumental interaction deals only with domain objects shown graphically (on monitors or tabletops), mixed interaction extends to “bodied task objects” (i.e., bodied data) that can provide input and output at the same time. ASUR++ ( 20 ; 21 ) is an extension of the ASUR notation ( 22 ) that characterizes the physical and digital entities of mobile mixed systems (i.e., Adapter, System, User, and Real object). The notation is also suitable for tangible user interfaces ( 21 ) . The notation distinguishes between two digital roles for physical objects by defining terms for tools (“R tool ”) that aid in a task (i.e., tools role) and targeted objects (“R object ”) that are altered by a