HyperGuide: Hyperbolic Guidance for Efficient Multi-Step Reasoning in Large Language Models

Yuyu Liu, Haotian Xu, Yanan He, Sarang Rajendra Patil, Mengjia Xu, Tengfei Ma · 2026

Read HyperGuide: Hyperbolic Guidance for Efficient Multi-Step Reasoning in Large Language Models by Yuyu Liu, Haotian Xu, Yanan He, Sarang Rajendra Patil, Mengjia Xu, Tengfei Ma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24140.txt.

Introduction

Liu and five co-authors introduce HyperGuide, steering multi-step reasoning without expanding and ranking branches at inference time. Reasoning becomes motion through a tree of states in hyperbolic space. A state encoder on the Poincare ball feeds a guidance head that predicts the cheapest next move. That direction reaches the decoder as a virtual token after every step. Training ranks moves, favouring continuations that are sound and short. On contest maths and code tasks, HyperGuide matches or beats search-based rivals while using fewer tokens.

Catalog record

CREATORYuyu Liu, Haotian Xu, Yanan He, Sarang Rajendra Patil, Mengjia Xu, Tengfei Ma
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70927
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.24140

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HyperGuide: Hyperbolic Guidance for Efficient Multi-Step Reasoning in Large Language Models Yuyu Liu, Haotian Xu, Yanan He, Sarang Rajendra Patil, Mengjia Xu, Tengfei Ma Abstract Multi-step reasoning remains a central challenge for large language models: single-pass generation is efficient but lacks accuracy; tree-search methods explore multiple paths but are computation-heavy. We address this gap by distilling reasoning progress into a hyperbolic geometric signal that guides step-by-step generation. Our approach is motivated by a structural observation: in combinatorial reasoning trees, solution-bearing states are few while dead ends are exponentially numerous. The hyperbolic space matches this asymmetry, with compact volume near the origin and exponentially expanding capacity toward the boundary, so that distance-to-origin naturally encodes solution proximity while angular separation distinguishes branches requiring different next operations. We train a lightweight head to project LLM hidden states into this space, then fine-tune a low-rank adapter interactively on its own reasoning attempts to act on the injected signal. Across multiple benchmarks, the geometric signal yields consistent gains, with larger improvements on deeper reasoning chains. Our code is publicly available at https://github.com/yuyuliu11037/HyperGuide . K eywords Hyperbolic Embeddings \cdot LLM Reasoning \cdot Imitation Learning 1 Introduction Large language models (LLMs) have emerged as general-purpose problem solvers, demonstrating broad competence on tasks ranging from mathematical reasoning to code synthesis and long-horizon planning 3 ; 13 ; 11 ; 35 . A common thread underlying many of these advances is multi-step reasoning : composing sequences of intermediate inferences to reach conclusions that no single forward pass could produce. Reliably and efficiently producing such chains remains a central challenge. Single-pass methods such as chain-of-thought prompting 39 are cheap but yield low accuracy; tree search methods such as Tree of Thoughts 42 and Reasoning via Planning 8 improve performance by exploring multiple reasoning paths, but require many LLM forward passes. This tradeoff, however, is not intrinsic. The accuracy advantage of tree search can be largely attributed to one kind of information that single-pass generation typically lacks: estimation of distance from reasoning state to the correct solution. Here, a state denotes a node in the reasoning tree, i.e., a partial reasoning trajectory. The key question is whether this proximity signal can be injected directly into single-pass generation, sparing the cost of explicit search. We argue that it can, because the state distribution possesses an asymmetric structure that makes proximity information geometrically easy to encode: a small number of productive states lie on paths leading to correct solutions, and each typically branches into multiple solution paths. The vast majority of states are dead ends from which no sequence of operations reaches the goal. For example, 99.4\% of terminal leaves in Game-of-24 search trees are dead ends, and 70.9\% of ProntoQA rule applications fail to advance toward the target conclusion. 1 1 1 Per-task statistics for all benchmarks are reported in Appendix Table 7 . Hyperbolic space is a natural fit for this asymmetry. In this geometry, volume grows exponentially toward the boundary 16 ; 17 : the region near the origin is compact while the periphery provides exponentially expanding capacity. This matches the cardinality structure of the reachable states: the few solution-bearing states need only the small central region, while the exponentially many dead ends require the boundary volume for adequate separation. Distance-to-origin then serves directly as a continuous proxy for solution proximity. At the same time, the exponential surface area at each radius provides angular capacity to separate structurally distinct branches, so states with similar proximity but different next-step requirements remain distinguishable. Building on this observation, we propose a pipeline that separates learning the geometric signal from learning to act on it. In the first stage, we train a lightweight projection head that maps the frozen LLM’s hidden states into hyperbolic space, so that the geometric signal is meaningful. In the second stage, we fine-tune a low-rank adapter to select next-step operations conditioned on the injected signal, training interactively on the adapter’s own reasoning attempts, so that it learns to use the signal at the states it will actually encounter during generation. At inference time, each step boundary incurs only the cost of one forward pass through the small projection head. We evaluate on a suite of reasoning benchmarks spanning arithmetic, classical planning, constraint satisfaction, and multi-hop deductive logic. Because the LoRA adapter is task-agnostic, a single adapter transfers across related tasks when paired with a cheaply retrained task-specific head. The main contributions of our paper are threefold: 1. We identify a structural correspondence between the solution-proximity and hyperbolic geometry, and show that both can be encoded as a single geometric primitive injected directly into the language model’s generation stream at each reasoning step. 2. We propose a two-stage pipeline that teaches the model to act on the injected geometric signal during single-pass generation without invoking search at inference time. 3. Across multiple benchmarks and three open-weight backbones, our method delivers consistent accuracy gains at substantially lower inference cost than search-based baselines, with larger improvements on deeper reasoning chains. 2 Related Work 2.1 LLM Reasoning Single-pass prompting methods such as Chain-of-Thought 39 , Self-Consistency 38 , and Least-to-Most 45 cannot revise early mistakes, while search-based methods such as Tree of Thoughts 42 and Graph of Thoughts 2 recover lookahead at substantial inference cost. A parallel line scores intermediate steps with learned verifiers 13 ; 36 ; 34 to guide beam or best-of- n decoding, still requiring a separate scoring head and multiple candidate expansions, while reasoning-tuned models such as DeepSeek-R1 6 instead internalise long reasoning traces via reinforcement learning. A separate line bypasses discrete decoding and reasons in a continuous latent space: Coconut 9 feeds the last hidden state back as the next input embedding, CODI 27 compresses explicit CoT into continuous thoughts via self-distillation, and SoftCoT 40 injects soft thought tokens from a fixed assistant model into the LLM’s representation space. We target the same bottleneck but distil the search tree’s state distribution as a geometric signal the model consults in-line, with no separate reward model or multi-candidate expansion at inference. 2.2 Search Distillation Distilling planning into a reactive policy has a long history in reinforcement learning: the AlphaGo family 29 ; 30 ; 31 ; 26 trains policy and value networks to mimic Monte Carlo tree search, with Expert Iteration 1 and policy distillation 23 formalising the iterative recipe; we adopt DAgger 22 in Stage 2 for its statistical guarantees under the distilled policy’s own state distribution. In the LLM setting, value-guided MCTS variants 14 ; 33 ; 44 distil rollouts via SFT or RL using a separate value head or preference model. Our distilled signal is not a learned scalar but a geometric quantity read off a hyperbolic embedding of the backbone’s own hidden state, providing a principled geometric prior for the asymmetric reward structure of reasoning trees. 2.3 Hyperbolic Representations Hyperbolic space embeds hierarchical or tree-like data with low distortion because ball volume grows exponentially with radius, matching tree branching, as demonstrated by Poincaré 16 and Lorentz 17 embeddings with theoretical guarantees in 24 . A line of work generalises standard neural-network layers to the Poincaré ball and other Riemannian manifolds 18 ; 28 ; 4 ; 5 , with applications spanning vision 12 , language 7

Read the complete text