Probing Structural Mathematical Reasoning in Language Models with Algebraic Trapdoors

Igor Rivin · 2026

Read Probing Structural Mathematical Reasoning in Language Models with Algebraic Trapdoors by Igor Rivin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04352.txt.

Introduction

Igor Rivin builds a benchmark for testing deep structural reasoning in language models, based on hard problems about subgroups of a matrix group over the integers. Each problem gives a subgroup by listing its generators and asks for a number-theoretic property of that subgroup.

The construction hides information that makes the answer a quick closed-form check for the maker, while a solver without it must do serious algebraic analysis. Rivin reports traces from two leading models, including one that spent over two hours on a single case and named the bottleneck itself. The gap separates models with real algebraic knowledge from those relying on general computation.

Catalog record

CREATORIgor Rivin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.04352

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Probing Structural Mathematical Reasoning in Language Models with Algebraic Trapdoors Igor Rivin Abstract We introduce a benchmark suite for evaluating structural mathematical reasoning in language models, built on subgroup-construction problems in SL ⁡ ( 3 , ℤ ) \mathrm{SL}(3,\mathbb{Z}) with cryptographic-style verifier-prover asymmetry. Each instance presents a finitely generated subgroup as a list of integer matrices and asks for an arithmetic invariant — index, surjection-at-prime, or membership — that the construction-time information ( N , K ) (N,K) pins down in O ⁡ ( 1 ) O(1) closed form, but that the solver, lacking that information, must derive by either Aschbacher-classification analysis or by a membership query in SL ⁡ ( 3 , ℤ ) \mathrm{SL}(3,\mathbb{Z}) of unknown decidability. The benchmark therefore distinguishes models with internalized algebraic priors (Aschbacher classes, McLaughlin’s theorem, Property (T), the congruence subgroup property) from models that rely on general-purpose computation. We report empirical results across five representative reasoning traces from two state-of-the-art models. The headline result: on the index variant, one model spent 152 minutes of reasoning, explicitly identified the kernel-side membership question as the bottleneck, attempted constructive verification, and abstained with DON’T KNOW rather than commit to its computed cokernel candidate — demonstrating calibrated meta-cognition on the open-decidability boundary that the benchmark was designed to probe. We argue that the benchmark exposes a four-way classification of model behavior (commit-correct, commit-wrong, abstain-correct, abstain-wrong) that standard answer-key scoring conflates. 1 Introduction Standard mathematical reasoning benchmarks present problems whose verification is no harder than their solution. This symmetry makes them suited to evaluating computational fluency but ill-suited to evaluating structural reasoning — the ability to deploy named theorems, recognize algebraic patterns, and identify which structural prior applies to a problem. We introduce a class of benchmarks with the opposite property: the answer is computable in O(1) closed form by anyone with construction-time data (N,K) , but the solver, without that data, faces either heuristic structural detection or an algorithmic question of unknown decidability . The constructions live in \mathrm{SL}(3,\mathbb{Z}) , where three structural facts coincide: the Aschbacher classification of maximal subgroups of \mathrm{SL}(3,\mathbb{F}_{p}) is concrete and known; the congruence subgroup property (CSP) reduces finite-index questions to bounded membership; and the membership problem in \mathrm{SL}(3,\mathbb{Z}) has open decidability status. The mathematical machinery is developed in a companion paper [ 1 ] ; this paper reports the empirical experiments and what observed model behaviors reveal. 1.1 Contributions • A benchmark suite of four families (membership, list-prime YES/NO, congruence-extension YES/NO, exact index), each probing a different structural prior. Constructions are summarized in § 3 and developed in full in [ 1 ] . • Empirical results across two SOTA models (GPT Pro thinking; Gemini) on representative instances. We report five full reasoning traces that illustrate the diversity of solution strategies that different models employ on the same problem. • A calibration result. On the index variant, the kernel/cokernel asymmetry creates a calibrated abstention test: a model that can compute the cokernel but not the kernel-side membership should abstain rather than commit to the cokernel-side upper bound. We exhibit a 152-minute trace in which exactly this calibration fires correctly. • A diagnostic methodology arguing that benchmark-design choices that force the kernel/cokernel distinction — specifically, omitting any prompt-level assertion of finite-indexness — make abstention behavior measurable and meaningful in a way that ”finite-index-with-promise” prompts do not. 1.2 Why this matters for evaluation Most reasoning benchmarks score commit-and-correct against a fixed key. Commit-and-wrong and honestly-abstain are conflated: both score zero. Our benchmark separates them by construction. On v3 instances of the index family the correct answer is infinite_or_unknown , so honest abstention scores 1; on v2 instances it scores 0. A model with stable calibration on the membership-decidability boundary scores partial — getting v3 right and v2 wrong, with the same abstention behavior. That is the signal we want the benchmark to expose: a calibration capability orthogonal to (and sometimes uncorrelated with) raw structural knowledge. 2 Related work Mathematical reasoning benchmarks. GSM8K [ 3 ] , MATH [ 4 ] , MiniF2F [ 5 ] , OlympiadBench, ProofNet rely on the verification-equals-solution symmetry. They reward fluency but do not separate “knows the named theorem” from “applies general computation.” Structural-reasoning probes. ProofNet’s formal-statement alignment, Coq/Lean evaluation, and theorem-naming benchmarks evaluate structural reasoning narrowly. None target the membership-decidability axis we exploit here. Calibration evaluations. Selective prediction [ 6 ] and abstention rewards have been studied for factual answer-key questions. Our setting is different: abstention is licensed by an open mathematical question , not by an unknown answer. Trapdoor-style benchmarks. To our knowledge this is the first reasoning benchmark organized around a verifier-prover asymmetry imported from cryptography. The construction is closer in spirit to verifiable random functions than to standard math evaluation, with a geometric-group-theoretic rather than number-theoretic substrate. 3 The benchmark suite We summarize the four families; full constructions are in [ 1 ] . 3.1 Common framework For each instance we construct a subgroup H\subseteq\mathrm{SL}(3,\mathbb{Z}) as a list of integer matrices, derived from (N,K) with K\subseteq\mathrm{SL}(3,\mathbb{Z}/N) . Generation proceeds via Mennicke shears for \Gamma(N) plus lifts of K -generators (Lemma 3.2 of [ 1 ] ), then Nielsen scrambling — a sequence of g_{i}\mapsto g_{i}\cdot g_{j}^{\pm 1} moves that preserve \langle\mathrm{gens}\rangle but rewrite each generator as a deeply nested product. Presented matrix entries reach 10^{40} for the larger instances. The data (N,K) uniquely determines the answer; the solver must recover the relevant structural data from the matrices alone. 3.2 Family I — Membership Given (M_{1},M_{2})\in\mathrm{SL}(3,\mathbb{Z}) and ten candidate matrices T_{1},\ldots,T_{10} , decide whether each T_{i} lies in \langle M_{1},M_{2}\rangle . The construction places \langle M_{1},M_{2}\rangle inside a small explicit subgroup of \mathrm{SL}(3,\mathbb{F}_{p}) at one large prime p . NO certificates: mod- p reduction outside the small image. YES certificates: explicit words in the generators (recorded at construction time). 3.3 Family II — List-prime YES/NO For (A,B) and a list of primes p_{1},\ldots,p_{M} (some \geq 10^{15} ), decide for each p_{i} whether \langle A,B\rangle\bmod p_{i}=\mathrm{SL}(3,\mathbb{F}_{p_{i}}) . Asymmetry: the list contains primes far above any range where direct subgroup-order computation is feasible; only the orthogonal-class certificate (Smith Normal Form on the form-equation matrix, O(1) in p ) gives a tractable answer. 3.4 Family III — Congruence-extension YES/NO Same prompt as Family II, but H=\pi^{-1}(K) for chosen K\subseteq\mathrm{SL}(3,\mathbb{Z}/N) . Bad primes are factors of N at which K is proper. The construction obscures N and K via Nielsen scrambling. 3.5 Family IV — Index Output [\mathrm{SL}(3,\mathbb{Z}):H] as an exact integer, or infinite_or_unknown . Three subfamilies: • v1: H=\mathrm{SL}(3,\mathbb{Z}) , index 1 . Indistinguishable by mod- p analysis from a generic infinite-index Zariski-dense free 2-generator subgroup. • v2: H=\pi^{-1}(K) , finite index |\mathrm{SL}(3,\mathbb{Z}/N)|/|K| . Cokernel computable; kernel containment requires membership. • v3: H=\langle g_{1},g_{2}\rangle\subset\Gamma(N) for N>1 , index infinite by the Property (T) argument ( [ 1 ] Theorem 7.1). Cokernel-only reasoning gives the wrong answer; calibrated reasoning catches it. 4 Methodology 4.1 Construction and ground truth All benchmarks are generated by Sage scripts (full code in supplementary repository). Ground truth is derived from (N,K) in closed form, not from inspection of the matrices. Per-instance sanity checks verify \langle\mathrm{gens}\rangle\bmod N=K ; v3 instances additionally verify freeness of \langle g_{1},g_{2}\rangle via word-length BFS at depth L=10 . 4.2 Prompt

Read the complete text