AXIOM: A Trust-First Neuro-Symbolic Execution Architecture for Verifiable Mathematical Reasoning
Alessio Bruno · 2026
Read AXIOM: A Trust-First Neuro-Symbolic Execution Architecture for Verifiable Mathematical Reasoning by Alessio Bruno (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00671.txt.
Introduction
Bruno presents Moxia, a system for maths word problems, in this 2026 paper. Moxia puts trust first. Its language model does just one job: it rewrites a loose problem into a strict form. A fixed algebra pipeline then works out the answer and checks it, or says it cannot.
Each problem shape maps to one prompt and one solver, and 4,783 such routes ship with the system. Most routes need no language model at all. Since the pipeline derives each answer, it can also show the steps it took. Some tasks export proofs to the Lean 4 checker. On the MATH test set, Bruno reports 90.2 percent answered with one sure-but-wrong answer. On a held-out set the score is 89.2 percent with none. That small gap, he argues, shows the system did not just memorize shapes.
Catalog record
| CREATOR | Alessio Bruno |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00671
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AXIOM: A Trust-First Neuro-Symbolic Execution Architecture for Verifiable Mathematical Reasoning Alessio Bruno Abstract We present AXIOM , a trust-first neuro-symbolic execution architecture for natural-language mathematical reasoning. In AXIOM , the language model functions strictly as a canonicalizer : it rewrites informal problem text into a narrow schema consumed by a deterministic Computer-Algebra-System (CAS) pipeline, which derives and verifies the answer or abstains as a first-class output. Routing follows a 1 : 1 : 1 1{:}1{:}1 alignment between problem-shape regex, schema-specific prompt, and closed-form CAS handler, with 3,100 3{,}100 + such routes shipped and zero lost_correct regressions across 250 + 250+ consecutive ship commits. We report empirical results on 4 4 MATH categories with a cumulative correctness of 94.36 % 94.36\% ( 2,592 / 2,747 2{,}592/2{,}747 ) at 100.00 % 100.00\% trust on parseable (zero confident-wrong answers across the full 2,747 2{,}747 -record benchmark), all four domains above the per-domain 70 / 90 / 70 70/90/70 floor with per-domain trust at 100.0 % 100.0\% , and median latency of 1 ms 1\,\text{ms} on rule-only handlers ( 88 % 88\% of records on the lm-eval arithmetic 20,000 20{,}000 -record benchmark). The architecture has served ∼ \sim 30,000 30{,}000 production queries through a public deployment. The contribution we emphasize is not a final accuracy figure but the forward dynamic the architecture establishes: every logged abstain in production is a candidate correct after one ship cycle, since new tasks compose without regressing the registry. The operational discipline behind this property — math-template bucketing, lost_correct scan as regression oracle, parseable-first onboarding, and abstain as first-class output — constitutes a transferable framework for trustworthy neuro-symbolic systems beyond mathematics. 1 Introduction The unverifiable- LLM math problem. Frontier large language models achieve impressive accuracy on mathematical reasoning benchmarks, but they expose no verification pathway: at the API level, a confident-wrong answer is indistinguishable from a confident-right one. The user has no structural recourse to know whether a given output is reliable. This is not a defect of any particular model — it is a structural property of the prompt-in-text-out interface itself. Two existing alternatives partially address verification but at the cost of severely restricting input scope. Lean-based provers with LLM copilots [ 11 , 1 ] verify each tactic against the Lean kernel but require the problem to be pre-formalized in Lean syntax — the formalization is itself the bottleneck for natural-language queries. Closed expert systems such as Wolfram Alpha [ 12 ] answer NL input with rich symbolic backends, but their derivation traces are not inspectable and the system is not LLM -augmented at the input boundary. Trust-first vs accuracy-first. We define trust as 1-\text{wrong}/\text{attempted} , where wrong excludes records on which the system explicitly returned unknown . Trust is distinct from accuracy ( \text{correct}/\text{total} ): a system that refuses unsafe questions can have very high trust even at modest accuracy. Our position is that confident-wrong is the worst failure mode in mathematical reasoning, and an architecture should be designed to make confident-wrong structurally rare, not to be punished post hoc by benchmarks. Bottom-up architectural commitment. AXIOM commits to four design choices that follow from the trust-first stance: (a) the language model serves as a canonicalizer that rewrites NL input into a narrow task-specific schema, never as a solver; (b) a deterministic CAS pipeline derives every emitted answer; (c) routing between the LLM and the CAS pipeline is template-aligned: each routed task is one \langle\text{trigger},\text{prompt},\text{handler}\rangle triple co-designed against the same math template; and (d) abstain is a first-class structural output emitted by any of three independent channels (no template match, LLM unknown , handler cannot derive). The combination yields a runtime trust guarantee that is not available to either monolithic LLM systems or pre-formalized provers. Contributions. • Architecture ( Section 2 ): a 1{:}1{:}1 \langle\text{trigger},\text{prompt},\text{handler}\rangle routing architecture, an operator-pipeline chain framework for multi-step shapes, and a rule_only LLM -bypass for closed-form bare arithmetic. We ship 3{,}100 + task triples and 5 chain tasks at the time of writing. • Empirical evaluation ( Section 3 ): 94.36\% cumulative correctness ( 2{,}592/2{,}747 ) at 100.00\% trust on parseable (zero confident-wrong answers across the full benchmark), with all 4 MATH categories (Algebra, Number Theory, Counting & Probability, Precalculus) above the 70/90/70 per-domain floor and 100.0\% trust on parseable in each. The rule_only path achieves 100\% on the 20{,}000 -record lm-eval-harness arithmetic suite. The architecture has served \sim 30{,}000 production queries through a public deployment. • Operating principles ( Section 4 ): four principles transferable beyond mathematics — math-template bucketing, LOST_CORRECT scan as regression oracle, predicate-not-recognized as mandatory abstain, and parseable-first onboarding with regime-dependent trust floor — each justified by direct empirical observation across 250+ ship cycles. Reproducibility. A live, publicly accessible deployment of the architecture runs at https://huggingface.co/spaces/Squagghy/axiom-solver . The single-query view ( Figure 1 ) illustrates the 1{:}1{:}1 alignment on every record and the structural visibility of the abstain channels; the cumulative dashboard ( Figure 2 ) exposes the production statistics referenced throughout Section 3 . Figure 1: Single-query trace from the production demo on Compute the value of x^{2}+y^{2} where x=3 and y=5 . The four exposed stages (Router / Translator / Handler / Answer) materialize the 1{:}1{:}1 alignment from Section 2.1 : Router and Handler reference the same Numeric expression evaluation template, and the Translator block surfaces the verbatim LLM canonical rewrite ( Compute 3**2 + 5**2 ) with an explicit hallucination caveat. The final answer reports the per-query cost ( 1{,}755 tokens \approx \$0.00035 at Together.ai $0.18/M; Section 3.5 ). Any of the three abstain channels (router miss, LLM unknown , handler abstain) becomes visible at the stage that emitted it. Figure 2: Cumulative dashboard from the production deployment. Top row: hero counters (Total queries, Answered, Abstained, Answer rate). Middle row: structural correctness signals (Routed rate \sim 97\% ; p95 latency \sim 865\, ms dominated by LLM -bound traffic). Bottom row: efficiency aggregates confirming the per-query footprint of Section 3.5 (LLM-bound queries, average tokens / query, total tokens, inference cost estimated as tokens \times Together.ai $0.18/M). The live activity log (below) anchors the dashboard to real, free-form user traffic — each entry is one query, with per-record latency and routed task. 2 Architecture The architecture realizes the trust-first stance from Section 1 as a deterministic execution path: a problem-shape regex selects exactly one task, the language model rewrites the input into that task’s narrow schema, and a closed-form CAS handler derives and verifies the answer or abstains through a structured fail-reason. The four design choices we enumerate below — 1{:}1{:}1 task routing alignment ( Section 2.1 ), abstain as a first-class output ( Section 2.2 ), the composed-task chain framework for multi-step shapes ( Section 2.3 ), and the rule_only path that bypasses the LLM entirely on math-template-pure shapes ( Section 2.4 ) — are each motivated by a specific failure mode of the prompt-in-text-out interface. Figure 3 summarizes the execution path of a single query. Problem text (natural language) Router (regex, O(1) ) LLM rewriter (canonicalizer) Handler (CAS, deterministic) Answer or unknown task schema rule_only=True Figure 3: AXIOM pipeline. The router selects exactly one task per query (regex match on problem-shape, O(1) ). The LLM rewrites the input into a task-specific schema; the handler