Functional Multidimensional Scaling

Liting Li · 2025

Read Functional Multidimensional Scaling by Liting Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00253.txt.

Introduction

Liting Li introduces a statistics method in 2025 for drawing maps of how objects differ, when those gaps change over time. Classic scaling methods place objects on a flat map so that map distances match measured gaps. Real gaps often drift with time, though, and flat maps cannot show that drift.

The new method builds smooth curves for each object's map path, using flexible curve pieces. An update routine nudges the curves until map gaps nearly match the true gaps. Because the math can get heavy, a fast random-step training method handles the cost. The paper sets out the model, the fast solver, and the keywords of the field for readers new to the topic.

Catalog record

CREATORLiting Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-00253

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Functional Multidimensional Scaling Liting Li Abstract This article introduces a functional method for lower-dimensional smooth representations in terms of time-varying dissimilarities. The method incorporates dissimilarity representation in multidimensional scaling and smoothness approach of functional data analysis by using cubic B-spline basis functions. The model is designed to arrive at optimal representations with an iterative procedure such that dissimilarities evaluated by estimated representations are almost the same as original dissimilarities of objects in a low dimension which is easier for people to recognize. To solve expensive computation in optimization, we propose a computationally efficient method by taking gradient steps with respect to individual sub-functions of target functions using a Stochastic Gradient Descent algorithm. Keywords: Multidimensional Scaling, Functional Data Analysis, Statistical Modeling, Quasi-Newton Method, Stochastic Gradient Descent 1 Introduction The development of analyzing positions of objects has been prevalent in cluster analysis and dimensionality reduction with complicated data. Multidimensional scaling (MDS) is one of the critical methods that provides a visual representation of proximities (similarities, dissimilarities, or distances) among a set of objects. For simplicity, in this work we only focus on dissimilarities. The main goal of MDS is to represent objects in a low-dimensional space without changing their original dissimilarities. MDS starts with dissimilarities instead of a feature representation. It rearranges objects and induces a space from dissimilarities. Constructing a low-dimensional space for objects is a major difference between MDS and many other dimensional reduction methods (for example, Principal Components Analysis). In addition to representing relationships between objects, MDS is also used to create a low-dimensional space (usually one, two, or three dimensions) for objects to avoid intractable computation and complex visual perception. However, dissimilarities are not always static in real situations. For example, the dissimilarities of closing prices on the S&P 500 stocks can be different over time due to the change in closing prices. To date, there has been some research investigating the feasibility of temporal MDS methods. Ambrosi and Hansohm, 1987 designed a dynamic MDS method regarding dissimilarities measured in consecutive time periods. As one of the applications of time-varying MDS in the real world, Machado et al., 2011 conducted MDS analysis in 15 stock markets over the world with their time-varying correlations. Most recent research also includes the work studied by Jäckle et al., 2016 , which is a temporal MDS visualization technique that creates one-dimensional MDS plots for multivariate time series data in network security. While temporal MDS is a growing field, far too little attention has been paid to smoothness of MDS representations if dissimilarities of objects are considered to change over time. Considering smooth MDS representations are worth to be analyzed, we take advantage of the techniques in Functional Data Analysis (FDA). FDA refers to an important field of statistics that studies samples of functions that are usually determined by smoothing raw data. It enables us to analyze data over a continuum, such as time, age, height, weight, wavelength, etc. Thus, objects in FDA are functions instead of numbers. Recent core studies on FDA are done by Ramsay and Silverman, 2002 and Ramsay and Silverman, 2005 . In order to study the smoothness of time-varying dissimilarities between objects, we produce a functional multidimensional scaling model with the B-spline basis to construct optimal low-dimensional configuration for objects. This paper is mainly composed of four sections. Firstly, we briefly review FDA (Section 2). Then we introduce the definition of dissimilarity and a detailed mathematical background in Classical MDS (CMDS), and we make a variant of CMDS with the closing prices of the S&P 500 stocks from the first two weeks of the year 2018 to better understand the application of CMDS (Section 3). To extend CMDS by considering smoothness, we propose the functional multidimensional scaling (FMDS) method for time-varying data. Under the modified Adam Stochastic Gradient Descent that reduces the computation burden, the optimal smooth and low-dimensional representations can be estimated (Section 4). We illustrate the difference between FMDS and the existing MDS methods, and study its limitations and future work (Section 5). 2 Background on Functional Data Analysis Functional data consists of independent and identically distributed curves (functions) over a continuous interval. According to the description made by Ramsay and Silverman, 2002 , we observe a set of n objects consisting of the raw data (y_{ij},t_{j}) for i=1,...,n and j=1,...,m , where y_{ij} represents the value of the i^{\text{th}} object at the time point t_{j} , assuming that the continuous interval mentioned previously is a time grid. In practice, the observed data is usually contaminated by random noise, resulting from random fluctuations around a smooth trajectory. Ramsay and Silverman, 2002 also pointed out that smoothness is the significant assumption in functional data analysis (FDA) so that the consecutive points (y_{ij},t_{j}) and (y_{i,j+1},t_{j+1}) are related to some extent and do not differ much from each other. There are two main types of functional data, dense functional data and sparse functional data. In this work, we focus on the dense functional data and start from the spine functions. Dense functional data is recorded on the same dense time grid of ordered times \{t_{1},...,t_{m}\} and the time grid is equally spaced, that is, t_{j}-t_{j-1}=t_{j+1}-t_{j} . When m goes to infinity, t_{j+1}-t_{j} tends to zero. 2.1 Overview of Spline Functions Suppose that there is a grid ( Atkinson, 1989 ) a=t_{0}<t_{1}<...<t_{L+1}=b . f(t) is a spline function of order s\geq 1 if it satisfies the following two properties: (Property 1) f(t) is a polynomial of degree <s on each subinterval [t_{i-1},t_{i}] , for i=1,...,L+1 . (Property 2) The d^{\text{th}} derivative f^{\text{d}}(t) is continuous on [a,b] , for 0\leq d\leq s-2 . A spline divides into L+1 subintervals separated by values t_{l} , l=1,...,L which are called knots. The order of a polynomial is the number of constants. Order 2, 3, and 4 are the most common situations in polynomials. The relation between the number of parameters q in a spline function (the number of degrees of freedom), the order of the polynomials s and the number of knots L that was described by Ramsay and Silverman, 2005 indicates q=s+L . For instance, the total number of parameters in the linear spline function is q=2+3=5 . A spline function f(t) can be written as f(t)=\sum_{k=1}^{q}c_{k}\phi_{k}(t), where \phi_{k}(t) ’s are basis functions chosen from different basis systems, and c_{k} ’s are coefficients which can be obtained by the least squares method in Section 2.2. B-spline basis system developed by de Boor, 2001 is one of the most powerful basis systems. Suppose that there exists a knot sequence \{t_{l}\} , the B-spline of order 1 for this knot sequence is defined as B_{l1}(t)=\begin{cases}1,&\text{if }t_{l}\leq t<t_{l+1}\\ 0,&\text{otherwise}\end{cases} with a constraint \sum_{l}B_{l1}(t)=1, for all t . When t_{l}=t_{l+1} , we have B_{l1}=0 . Based on the first-order B-splines, we obtain s^{\text{th}} -order (s>1) B-splines by recurrence B_{ls}=w_{ls}B_{l,s-1}+(1-w_{l+1,s})B_{l+1,s-1} , where w_{ls}(t)=\begin{cases}\frac{t-t_{l}}{t_{s+l-1}-t_{l}},&\text{if }t_{l}\neq t_{l+s-1}\\ 0,&\text{otherwise}\end{cases} The cubic B-spline function (with order s=4 ) is commonly used as the basis functions \phi_{k}(t) . 2.2 Smoothing Functional Data Suppose that there is an observation of the sample functions containing the raw data \{(y_{j},t_{j})\} , for j=1,...,m , where y_{j} represents the value observed at the time point t_{j} that belongs to a compact interval \tau . In practice,

Read the complete text