GUT-IS: A Data-Driven Approach to Integrating Constructs and Their Relations in Information Systems

Maximilian Reinhardt, Jonas Scharfenberger, Burkhardt Funk · 2026

Read GUT-IS: A Data-Driven Approach to Integrating Constructs and Their Relations in Information Systems by Maximilian Reinhardt, Jonas Scharfenberger, Burkhardt Funk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18567.txt.

Introduction

Maximilian Reinhardt and two co-authors present GUT-IS, a 2026 data-driven approach to merging constructs and links in information systems research. Task-tuned text vectors plus clustering yield candidate construct groups, and a loss rule trading meaning purity against parsimony picks the best. Making the trade-off plain shows how groups and links shift as priority moves from purity to parsimony. Tests on two information-systems datasets explore the method's behavior.

Catalog record

CREATORMaximilian Reinhardt, Jonas Scharfenberger, Burkhardt Funk
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28201
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18567

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GUT-IS: A Data-Driven Approach to Integrating Constructs and Their Relations in Information Systems Thanks: Accepted at the 34th European Conference on Information Systems (ECIS 2026), Milan, Italy. Maximilian Reinhardt, Jonas Scharfenberger, Burkhardt Funk Abstract Structural equation modeling is widely used in IS research. However, inconsistent construct definitions impede the cumulative development of knowledge. In this work, we present an approach that aims at the integration of structural equation models into a unified model: We use a combination of task-adapted text embeddings and clustering to produce a candidate set of construct groupings. Subsequently, we select the optimal solution using a loss function that explicitly trades off semantic purity and parsimony in the number of clusters. By making this trade-off explicit, our approach allows to analyze how construct groupings and their relations change as one shifts the priority from purity to parsimony. Empirically, we evaluate and explore the proposed methodology on two datasets from the IS domain. Keywords Structural equation modeling, Construct clustering, Semantic similarity, Text embeddings 1 Introduction Structural equation modeling (SEM) is one of the dominant empirical methods in IS research ( 21 ) . SEM-based studies have introduced and refined latent constructs to explain technology adoption, system success, digital work practices, and organizational transformation. Classic IS work has emphasized careful construct development and validation (see for instance 15 , 15 ). Yet, many reviews conclude that inconsistent construct definitions and measurement threaten validity and make it difficult to build a genuine cumulative tradition in IS ( 10 ) . This tension is visible in what 8 term the construct jingle-jangle fallacy where conceptually similar constructs are labelled differently, or identical labels are used for distinct concepts, complicating literature reviews and meta-analysis. Despite sophisticated guidance on measurement models and construct specification (e.g. 16 , 16 ), much of the consolidation work around constructs is still performed ad hoc by individual reviewers. As a result, researchers face a large but fragmented landscape of constructs and relations that is difficult to synthesize. At the same time, IS has started to develop knowledge infrastructures that encode theoretical content in machine-readable form. Platforms such as DISKNET ( 2 ) , Promethis ( https://promethis.org ), and theorizeit ( https://theorizeit.org ) capture constructs, definitions, and estimated relations from SEM studies, and recent ontology-based frameworks propose semantic annotation and knowledge-synthesis pipelines to support large-scale, semi-automated literature reviews in IS ( 5 ) . Parallel work on LLM-based extraction shows that constructs and relationships can be harvested from research articles at scale, albeit with non-trivial cleaning and validation effort ( 17 ) . We introduce GUT-IS – loosely inspired by Grand Unified Theories in physics ( 7 ) – as a data-driven pipeline that aims to integrate semantically similar constructs and reconcile their relations. In essence, we (1) start from existing IS knowledge repositories, (2) enrich construct names and definitions using LLM-based retrieval augmented generation, (3) learn a projection of domain-adapted embeddings, and (4) apply graph-based clustering governed by a loss function that trades off semantic purity against parsimony in the number of construct groups. This turns construct consolidation from a hidden, manual step into an explicit, tunable design decision and provides a unifying layer that can feed into meta-analytic preprocessing, ontology refinement, and ontology-based knowledge synthesis in IS. 2 Related work Related work in this field encompasses construct and causal model identity detectors and tools that allow researchers to validate constructs against a set of existing constructs in the field of IS research. 8 propose a construct identity detection model that leverages latent semantic analysis (LSA) and algorithms that preserve word-order information to calculate text similarities between the items with which the constructs are measured. They evaluate their model on a dataset of 1,004 constructs which they manually assigned into clusters and report an ROC-AUC of 0.814. 12 extend this work by considering the GloVe word embedding model. They also evaluate their model based on the ROC-AUC score on 8 ’s ( 8 ) dataset and report the best score (0.827) for using a weighted sum of GloVe embeddings of the words describing the construct items. 19 extend the construct identity problem to identifying similar causal models. They decompose the similarity measure into a structural component based on the graph edit distance and a semantic component which uses Wordnet to calculate similarities between construct names. 9 pursue a different goal and develop a tool that enables researchers to investigate how constructs load against each other and against a set of constructs published in IS research that are represented through 550 latent dimensions. To obtain this information, the user must provide their construct’s name, definition and items. The tool is built by combining fine-tuned word embeddings and principal component analysis; hyperparameters are determined using a human-in-the-loop approach. In summary, related work presents useful tools to determine whether two constructs are identical and to enable researchers to compare constructs against a set of established ones. Thereby, 8 as well as 12 rely solely on construct items, whereas 9 additionally utilize names and definitions. Causal relations between constructs are only used by 19 to calculate graph edit distances. In contrast, GUT-IS goes beyond the calculation of pairwise similarities and aims at the integration of constructs and their relations into a unified model. Further, we argue that there is not a single optimal grouping of constructs but that different groupings prioritize the parsimony and semantic purity of the resulting model differently. Our approach makes this trade-off explicit and allows to explore cluster solutions for different choices. 3 Data and material We use two datasets to evaluate and explore our approach. First, we utilize the structural equation models stored in DISKNET ( 2 ) and include 5,290 constructs from 578 publications for which full texts are available, as well as the 8,809 relations between these constructs. The information on constructs comprises names and definitions, however, with approximately 3,500 definitions missing. Relations are characterized by path coefficients and their statistical significance. The DISKNET data lacks ground truth on construct similarities, which is why we additionally use the data from 8 comprising 1,004 constructs. While this dataset does not contain relations, construct information includes manually determined assignments into 347 clusters. The cluster assignments imply pairwise similarities, from which 5,851 are positives and 497,655 negatives. Moreover, constructs are characterized by names, items, and definitions, with approximately 140 definitions missing. We clean and enrich the construct names and definitions from both datasets using the LLM llama-3.3-70b-instruct 1 1 1 We gratefully acknowledge the use of the KISSKI API service SAIA ( 3 ) , which provided access to llama-3.3-70b-instruct and e5-mistral-7b-instruct. , which we choose as it is available as open source and competitive on common benchmarks ( 14 ) . For the names, this includes expanding abbreviations to full English words and correcting spelling mistakes. Regarding definitions, the model is additionally prompted to ensure that they are meaningful and concise. Missing definitions are generated from scratch. To provide context for these tasks, we use a retrieval augmented generation approach on DISKNET ( 2 ) : Besides the original name, definition, and publication title, the model is provided with chunks of the full texts which are retrieved using the original construct names as queries. For this

Read the complete text