Beyond Coordinates: Meta-Equivariance in Statistical Inference

William Cook · 2025

Read Beyond Coordinates: Meta-Equivariance in Statistical Inference by William Cook (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10667.txt.

Introduction

William Cook writes alone in a 2025 statistics paper on coordinate free decisions. A good statistical choice should not hinge on the language used to state the problem. Cook asks how to be sure a change of coordinates does not quietly change the answer. He starts with the best blend of two well behaved estimators under a strict risk rule.

The best blend, he proves, stays the same under straight rescaling of the weights. That case points to a wider rule he names meta equivariance: the unique best point of a smooth, strictly curved objective over matrices shifts in step with any invertible rescaling. The principle gives method builders a test for whether their recipes respect the problem or just its wording.

Catalog record

CREATORWilliam Cook
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-10667

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Coordinates: Meta-Equivariance in Statistical Inference William Cook Abstract Optimal statistical decisions should transcend the language used to describe them. Yet, how do we guarantee that the choice of coordinates—the parameterisation of an optimisation problem—does not subtly dictate the solution? This paper reveals a fundamental geometric invariance principle. We first analyse the optimal combination of two asymptotically normal estimators ( θ ^ 1 , θ ^ 2 \hat{\theta}_{1},\hat{\theta}_{2} ) under a strictly convex trace-AMSE risk ( Boyd and Vandenberghe,, 2004 ) . While methods for finding optimal weights W W are known ( Hjort and Claeskens,, 2003 ; Judge and Mittelhammer,, 2004 ) , we prove (Theorem 2.2 ) that the resulting optimal estimator ( θ ^ ∗ \hat{\theta}^{*} ) is invariant under direct affine reparameterisations of the weighting scheme. This exemplifies a broader principle we term meta-equivariance : the unique minimiser of any strictly convex, differentiable scalar objective over a matrix space transforms covariantly under any invertible affine reparameterisation of that space (Theorem 3.1 ). Distinct from classical statistical equivariance tied to data symmetries ( Lehmann and Casella,, 1998 ) , meta-equivariance arises from the immutable geometry of convex optimisation itself, demonstrated via matrix calculus ( Magnus and Neudecker,, 1999 ) . It guarantees that optimality, in these settings, is not an artefact of representation but an intrinsic, coordinate-free truth. “A statistical law that depends on the coordinate system is not a true law of nature.” Shun-ichi Amari, Information Geometry and Its Applications (2016) , ( Amari,, 2016 ) Keywords: Estimator Combination, Parameterisation Invariance, Meta-Equivariance, Convex Optimisation, Asymptotic Mean Squared Error, Matrix Calculus, Statistical Decision Theory, Coordinate Invariance, Information Geometry, Convex Geometry, Affine Transformation. 1 Optimality Beyond Coordinates Statistical inference often thrives on synthesising diverse information sources or methodological perspectives. Optimal combination of estimators is a cornerstone strategy, driving systematic enhancements in efficiency and robustness across disciplines, from seminal work in forecast combination ( Bates and Granger,, 1969 ) to modern model averaging techniques ( Hjort and Claeskens,, 2003 ; Hoeting et al.,, 1999 ) . Formalising combination through optimisation, typically by minimising a risk function, provides a principled framework. However, this formalisation introduces a subtle but critical question: does the mathematical representation chosen—the parameterisation—influence the final optimal solution, or does the same optimal decision emerge regardless of the chosen coordinate system? This paper confronts this question directly. Consider combining two asymptotically normal estimators \hat{\theta}_{1},\hat{\theta}_{2} ( Hansen,, 1982 ) . A natural approach forms an affine combination \hat{\theta}(W)=(I-W)\hat{\theta}_{1}+W\hat{\theta}_{2} , selecting the weight matrix W to minimise a strictly convex risk, such as the trace-AMSE ( Judge and Mittelhammer,, 2004 ) . Yet, an algebraically equivalent representation is \hat{\theta}(W^{\prime})=W^{\prime}\hat{\theta}_{1}+(I-W^{\prime})\hat{\theta}_{2} . Does this choice of parameterisation—effectively choosing a specific coordinate chart on the affine manifold of possible combined estimators—affect the final optimal point \hat{\theta}^{*} on that manifold? Is optimality an intrinsic property, or an artefact of coordinates? This inquiry into coordinate independence resonates with fundamental ideas across statistical theory. It aligns with the pursuit of coordinate-free descriptions in information geometry ( Amari,, 2000 ) , a field rooted in foundational work on statistical metrics ( Rao,, 1945 ) . Our analysis suggests a complementary perspective, exploring the geometry not just of the statistical model space, but of the decision space associated with optimal inference. We reveal that under the geometric constraint of strict convexity, optimality transcends coordinates. This paper is structured as follows. Section 2 formally defines the estimator combination problem and proves Theorem 2.2 , demonstrating the invariance of the optimal estimator under direct reparameterisation. Section 3 introduces the general principle of meta-equivariance (Theorem 3.1 ), proving the covariance of optimal solutions under general affine maps, and explores its connections and extensions, including the concept of a dual geometry of inference. Section 4 provides numerical validation and visualisations illustrating these geometric principles in action. We conclude by reflecting on inference as a geometric construction. Appendices contain technical derivations supporting the main results. Meta-equivariance sits at the intersection of statistical decision theory, convex geometry, and information geometry. While its mathematical roots lie in classical results about optimisation under affine maps, we reinterpret this structure as a coordinate-invariance principle for statistical decision-making . Unlike classical equivariance—which reflects symmetries of the data—meta-equivariance reflects the internal geometry of the decision problem itself. Estimator combination under AMSE is our initial proving ground, but the principle applies more broadly across convex inference problems, from penalised estimation to Bayesian model averaging. As such, meta-equivariance opens a new frontier in understanding what makes a statistical decision intrinsically optimal , beyond the coordinate systems we use to describe it. 1.1 The Geometry of Invariance: A Conceptual Bridge Before presenting the formal theorems, we establish the geometric intuition underpinning the paper’s core results. The central insight is that while the parameters used to describe an optimal statistical decision might change depending on the chosen mathematical representation, the decision itself —the optimal estimator—remains invariant. This principle, which we term meta-equivariance , arises not from symmetries in the data, but from the intrinsic geometry of the optimisation problem, specifically its convexity and behaviour under coordinate transformations. Parameterisations as Coordinate Charts Our analysis fundamentally involves two distinct spaces: 1. Parameter Space ( \mathcal{W}=\mathbb{R}^{K\times K} ): The space inhabited by the weight matrices W (such as W_{A} or W_{B} ). Optimisation algorithms operate within this space. 2. Estimator Space ( \mathcal{E}\subset\mathbb{R}^{K} ): The affine subspace containing the combined estimators \hat{\theta}(W) that result from applying a weight matrix W to the base estimators \hat{\theta}_{1},\hat{\theta}_{2} . The final optimal decision, \hat{\theta}^{*} , is a point in this space. As detailed in the setup ( Subsection 2.1 ), we consider estimators formed via different parameterisations, notably: \displaystyle\hat{\theta}_{A}(W_{A}) \displaystyle=(I-W_{A})\hat{\theta}_{1}+W_{A}\hat{\theta}_{2} (Parameterisation A) \displaystyle\hat{\theta}_{B}(W_{B}) \displaystyle=W_{B}\hat{\theta}_{1}+(I-W_{B})\hat{\theta}_{2} (Parameterisation B) These parameterisations represent different coordinate charts on the same underlying affine manifold \mathcal{E} , which is defined by the constraint that the combining matrices sum to the identity ( A_{1}+A_{2}=I ). The invertible affine map T(W)=I-W provides the transformation between these coordinate systems, relating W_{A} and W_{B} via W_{B}=T(W_{A}) . This aligns with the Remark "Affine Structure and Coordinate Charts" in Subsection 2.1 . Strict Convexity Creates Uniqueness The invariance of the optimal estimator \hat{\theta}^{*} is guaranteed by the geometric shape of the objective function. We minimise the trace-AMSE risk R(W) defined in Equation ( 2.2 ) : R(W)=\tr(\Omega^{-1}\AMSE(W)). The structure of the AMSE matrix is derived in Appendix B (see Eq. ( 2.3 ) for the simplified case). Crucially, Appendix C proves that R(W) is strictly convex provided the joint asymptotic covariance matrix \Sigma is positive definite ( Assumption (A2) ) and the risk weighting matrix \Omega\succ 0 . Geometric Implication: Strict convexity ensures that the risk function R(W) possesses a unique global minimum . This minimum corresponds to a single, unambiguous point \hat{\theta}^{*} in the estimator space \mathcal{E} . Regardless of the coordinate chart (Parameterisation A or B) used for optimisation, the algorithm must converge to this same invariant point. This is the core mechanism explained in the Remarks "Coordinate-Free Optimality" and "The Geometric Engine: Strict Convexity" following Theorem 2.2 . Optimisation Dynamics Under Coordinate Change How does the optimisation process itself behave when we switch coordinates? Theorem 3.1 addresses this via the gradient transformation rule derived in Appendix D and

Read the complete text