Recovering manifold structure in LLM responses through a joint Euclidean mirror
Maximilian Baum, Aranyak Acharyya, Tianyi Chen, Avanti Athreya, Youngser Park, Francesco Sanna Passino, Carey E. Priebe, Zachary Lubberts · 2026
Read Recovering manifold structure in LLM responses through a joint Euclidean mirror by Maximilian Baum, Aranyak Acharyya, Tianyi Chen, Avanti Athreya, Youngser Park, Francesco Sanna Passino, Carey E. Priebe, Zachary Lubberts (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-07011.txt.
Introduction
Baum and seven colleagues ask how the replies of a large language model shift as its tuning knobs change, and how those shifts can be drawn on a map. They treat each knob setting as giving a spread of possible replies, then build a joint flat mirror that places like spreads near each other. The paper proves this map can be guessed from reply samples, and that an unknown knob value can be read back from fresh replies. In trials, distinct knob changes pointed in distinct map directions.
Catalog record
| CREATOR | Maximilian Baum, Aranyak Acharyya, Tianyi Chen, Avanti Athreya, Youngser Park, Francesco Sanna Passino, Carey E. Priebe, Zachary Lubberts |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60617 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.07011
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Recovering manifold structure in LLM responses through a joint Euclidean mirror Maximilian Baum, Aranyak Acharyya, Tianyi Chen, Avanti Athreya, Youngser Park, Francesco Sanna Passino, Carey E. Priebe, Zachary Lubberts Abstract Abstract Understanding the behavior of black-box large language models and determining effective means of comparing their performance is a key task in modern machine learning. We consider how large language models respond to a specific query by analyzing how the distributions of responses vary over different values of tuning parameters. We frame this problem in a general mathematical setting, treating the mapping from model parameters to response distributions as a structured family of probability measures, endowed with a geometry via a dissimilarity measure. We show how dissimilarities between response distributions can be represented in low-dimensional Euclidean space through a joint Euclidean mirror surface encoding the underlying geometry, which permits both qualitative and quantitative analysis of large language models and provides insight into predicting response distributions for different values of tuning parameters. We propose an estimation procedure for the underlying joint Euclidean mirror based on observed samples from the response distributions, and we prove its asymptotic properties. Additionally, we propose a statistically consistent procedure to infer the value of an unknown model parameter based on samples from the corresponding response distribution and the estimated joint Euclidean mirror. In an experimental setting with large language models, we find that changes in different tuning parameter values correspond to distinct directions in the embedding space, making it possible to estimate the tuning parameters that were used to generate a given response. Keywords — embedding methods, Euclidean mirror, large language models, parameter recovery. 1 Introduction There is an increasing appetite for personalized AI large language models (LLMs) tailored to particular users and tasks ( Tan et al. 2024 ; Woźniak et al. 2024 ; Zhang et al. 2025 , see, for example,) . As these models become more specialized through differences in model architecture, training methods and training data, the ability to compare these models in a structured way takes on increasing relevance ( Kahng et al. 2025 ) . Due to fundamental differences in model architectures and the fact that many model weights are not open source, comparing models based on differences in weights is not possible. It is therefore more tractable and interpretable to compare models based on the responses they generate ( Zheng et al. 2023 , see, for example, the LLM-as-a-judge framework;) . In this work, we introduce a method to quantify differences between language models via their responses and demonstrate that it is possible to recover fundamental details about a language model using the representation of such differences. This methodology also provides a framework to understand the sensitivity of model output to changes in tuning parameters (such as, for example, temperature), architecture, inference time or access to specialized data sources. We present this approach as a general mathematical framework in which responses from LLMs are considered as realizations from high-dimensional probability distributions, indexed by parameters, and we equip the underlying space of distributions with a dissimilarity measure which introduces a latent geometry. We then introduce the concept of a joint Euclidean mirror to represent differences between distributions within a low-dimensional Euclidean space, and we propose a statistically consistent estimation procedure to estimate this object when samples from these probability distributions are available. The proposed procedure is visualized in Figure 1 in an example on responses from LLMs; a more detailed description about each of the steps involved in the algorithm will be given in Section 3 . We further show that the proposed joint Euclidean mirror framework could be used to recover latent generative conditions from unlabelled samples using the learned representation of distributions. To the best of our knowledge, this is the first work to formalize the problem of recovering latent generative parameters from LLM responses within a principled mathematical framework. Figure 1 : Visualization of the joint Euclidean mirror estimation for from LLMs, for a given prompt, and two-dimensional parameters. The rest of this paper is organized as follows: Section 2 discusses the required background and methodological setup for this work, followed by a description of the proposed methods in Section 3 . Theoretical results about our method are proved in Section 4 . Section 5 demonstrates the proposed algorithms and their properties on simulated data, followed by an example with responses from LLMs in Section 6 . 2 Background and setup Given the limited understanding of the internal functioning of LLMs, one approach to study these models is to treat them as a black-box in which one inputs a query and is returned a random response. In this way, each response from an LLM provides a single realization of a random process ( Helm et al. 2025 , see, for example,) . By treating each query of an LLM as a random sample from an unknown text distribution and utilizing a text embedding which can embed any length text into a fixed q\in\mathbb{N} dimensional vector, the problem of comparing different LLMs can be viewed as analogous to the problem of comparing different probability distributions in \mathbb{R}^{q} . The methods that we consider combine key ideas based on the concepts of the Euclidean mirror ( Athreya et al. 2025 ) as well as the study of large language models in terms of the Data Kernel Perspective Space (DKPS) ( Helm et al. 2025 ) . The central idea of a Euclidean mirror is to define a function that maps from a non-Euclidean space into Euclidean space in such a way that a specific notion of distance between objects in the original space is preserved. In the case of dynamic graphs presented in Athreya et al. 2025 , this structure is used to encode the distance between time-varying latent position distributions in terms of the maximum variation distance metric, under a random dot product graph modeling framework. In the setting proposed in Athreya et al. 2025 , the evolution of latent positions for nodes in the graph is parameterized with respect to time, and the Euclidean mirror is defined as a function \psi:[0,T]\to\mathbb{R}^{c} with c\in\mathbb{N} such that for all t,t^{\prime}\in[0,T] , the Euclidean distance between \psi(t) and \psi(t^{\prime}) provides a representation for the amount of change of the latent position distributions between times t and t^{\prime} . In our setting, we extend the notion of the mirror beyond the maximum variation distance metric to accommodate general notions of distance and to a multivariate setting where the distances in question are parameterized by two or more features. In this paper, the non-Euclidean space that we study is the space of distributions. Consider a set of distributions \mathcal{F} parameterized by a vector x\in\mathcal{X}\subset\mathbb{R}^{d} for d\in\mathbb{N} . In the case of a large language model, F_{x} could represent the distribution of responses to a given query, embedded in \mathbb{R}^{q} , when the model is equipped with parameters x\in\mathcal{X} . For example, in OpenAI’s ChatGPT, temperature and logit_bias are parameters that could be varied to control the randomness of the output and specific token probabilities in the response. If we specify a distance metric \mathcal{D} on the space \mathcal{F} , then the idea of a joint Euclidean mirror is to specify a function