Identifying nonlinear relations among random variables: A network analytic approach
Lindley R. Slipetz 1, Jiaxing Qiu 2, Siqi Sun 1, Teague R. Henry 1,2 1 Department of Psychology, University of Virginia 2 School of Data Science, University of Virginia · 2024
Read Identifying nonlinear relations among random variables: A network analytic approach by Lindley R. Slipetz 1, Jiaxing Qiu 2, Siqi Sun 1, Teague R. Henry 1,2 1 Department of Psychology, University of Virginia 2 School of Data Science, University of Virginia (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02763.txt.
Description
Abstract Nonlinear relations, such as the curvilinear relationship between childhood trauma and resilience in patients with schizophrenia and the moderation relationship between mentalizing, and internalizing/externalizing symptoms and quality of life in youths, are more prevalent than our current methods have been able to detect.
Catalog record
| CREATOR | Lindley R. Slipetz 1, Jiaxing Qiu 2, Siqi Sun 1, Teague R. Henry 1,2 1 Department of Psychology, University of Virginia 2 School of Data Science, University of Virginia |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-02763
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Identifying nonlinear relations among random variables: A network analytic approach Lindley R. Slipetz 1, Jiaxing Qiu 2, Siqi Sun 1, Teague R. Henry 1,2 1 Department of Psychology, University of Virginia 2 School of Data Science, University of Virginia Abstract Nonlinear relations, such as the curvilinear relationship between childhood trauma and resilience in patients with schizophrenia and the moderation relationship between mentalizing, and internalizing/externalizing symptoms and quality of life in youths, are more prevalent than our current methods have been able to detect. Although the use of network models has risen, network construction for the standard Gaussian graphical model depends solely upon linearity. While nonlinear models are an active field of study in psychological methodology, many models require the analyst to specify the functional form of the relation. When performing more exploratory modeling, such as with cross-sectional network psychometrics, specifying the functional form a nonlinear relation might take becomes infeasible given the number of possible relations modeled. Here, we apply a novel nonparametric approach to identifying nonlinear relations using a residualization procedure with distance correlations. We found that distance correlations excel overall at identifying nonlinear relations regardless of functional form when compared with Pearson’s and Spearman’s partial correlations and conditional mutual information. Through simulation studies and an empirical example, we show that distance correlations with residualization as a novel method can be used to identify possible nonlinear relations in psychometric networks, enabling researchers to then explore the shape of these relations with more confirmatory models. keywords network construction, nonlinear relations, distance correlations † † articletype: ORIGINAL ARTICLE 1 Introduction “Using a term like nonlinear science is like referring to the bulk of zoology as the study of non-elephant animals” - Stanislaw Ulam The statistical methods underlying psychological science are almost entirely built around the assumption of linear relationships between variables, from ANOVA to linear regression, to more specialized methods like structural equation modeling and even network psychometric modeling. This proliferation of linear techniques is due to efficacy, convenience and convention: linear methods capture an important aspect of any relationship between variables, the assumption of linearity makes estimation significantly simpler, and has been used effectively for well over 100+ years. While there are a suite of methods that have been developed for testing nonlinear relationships, the previous quote attributed to the mathematician Stanislaw Ulam demonstrates an issue with the use of nonlinear methods: there are an infinity of ways variables can be related nonlinearly. Yet, as psychological science moves towards the modeling of dynamical causal systems, the importance of being able to accurately detect and model nonlinear relationships, as the miss-specification of those effects in complex systems models can have much more drastic impacts on inference and interpretation than the misspecification of an effect for an associative model. In this manuscript we present a novel approach to detecting conditional nonlinear relationships in networks of psychological variables, while controlling for the presence of confounding linear relationships. This method provides a turn-key screening method for identifying relationships that need to be further probed for nonlinear relationships, as it does not assume a specific functional form of the nonlinearity. To support the use of this method, we take a network psychometric approach to the modeling of psychological data. Network psychometrics is a departure from the traditional “common cause” approach to modeling psychological phenomena ( Schmittmann et al., (2013) ) . In this latter framework, symptoms of psychological disorders are caused by some unitary underlying cause, akin to how symptoms of an infectious disease are caused by the infectious agent. Due to the theoretical issues with common cause modeling, the network psychometric approach was proposed ( Epskamp et al., (2018) ; Marsman et al., (2018) ) , where a mental health condition is described as a causally interacting system of symptoms. Consider a psychological disorder like depression. In the common cause view, the symptoms of depression are ‘‘caused’’ by a latent variable that corresponds with depression severity 1 1 1 The issue here is, what is the causal mechanism by which this latent variable that represents depression causes symptoms? Outside of a causal explanation, the common cause model of depression is a unidimensional representation of severity, but this definition is less useful in understanding the why of depression. , while, in the network psychometric view, depression is the whole of the causally interacting parts (e.g., having trouble sleeping causing lack of energy causing irritability ( Borsboom & Cramer, (2013) ; Schmittmann et al., (2013) ; Cramer & Borsboom, (2015) ; Bringmann & Eronen, (2018) ; Fried, (2020) ) . These differing viewpoints on disorders and how we model them has further implications on the requirements of independence within a model (i.e., local independence in the case of the common cause approach and conditional partial independence in the case of network psychometrics). Instead of latent variable models like confirmatory factor analysis or structural equation modeling, network psychometrics seeks to understand the relations between observed variables. The most common general analytic framework for continuous measurements is the Gaussian graphical model. In a Gaussian graphical model (which is based on partial correlations between the variables of the network, see Hallquist et al. ((2019)) ), independence between symptoms is conditional: two variables are said to be independent after conditioning on all other variables when the partial correlation equals zero. While the Gaussian graphical model has been used productively to capture the general relationships between psychological variables, there is a core, inescapable, methodological issue to the use of partial correlation methods: these methods assume that all relationships between the observed variables are linear, which means that the the zero partial correlation is not truly statistical independence but, rather no linear relation. With the current state of the field, psychometric networks struggle to represent nonlinear relations, though some recent work has proposed a number of approaches for explicitly modeling these relations. The importance of being able to find nonlinear relations can be seen by the commonness of them occurring in psychological phenomena: diminishing returns for social interactions ( Ren et al., (2021) ) , a curvilinear effect between age and gratitude ( Chopik et al., (2022) ) , nonlinear effects of neighborhood environments on mental health ( Zhang et al., (2022) ) , and the nonlinear relationship between income and mental health ( Li et al., (2022) ) , among others. Furthermore, quantitative techniques have yet to catch up to these potential relations, so they are likely more prevalent than have been recorded thus far. Hence, it is vital to have an adequate method of detecting these relations. The purpose of this paper is to develop a general testing approach for the presence/absence of conditional nonlinear relationships above and beyond any linear relationship among random variables in a network psychometric setting. Our method is inspired by Generalized Covariance Modeling ( A. Shah & Chatterjee, (2008) ) , and uses a dual nonlinear/linear residualization step followed by a test of nonlinearity. The ultimate goal is to offer a novel, broad methodology to further the applicability of network analytic methods in the psychometric context that can identify both linear and nonlinear relations using correlations that have yet to see application within psychology. The main benefit of this approach is that this nonlinearity can