Generative Recursive Reasoning
Junyeob Baek Mingyu Jo Minsu Kim, Mengye Ren Yoshua Bengio Sungjin Ahn, KAIST Mila -- Québec AI Institute, New York University Université de Montréal · 2026
Read Generative Recursive Reasoning by Junyeob Baek Mingyu Jo Minsu Kim, Mengye Ren Yoshua Bengio Sungjin Ahn, KAIST Mila -- Québec AI Institute, New York University Université de Montréal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19376.txt.
Introduction
Baek and team turn recursive thought into a chance-based process. Earlier models of this kind follow one fixed hidden path to one answer, which limits search. Their GRAM design treats thought as a random hidden path, so a system can hold several guesses, try other plans, and scale compute by depth and by parallel runs. Trained with a variational method, it beats fixed-path recurrent and recursive baselines on set reasoning tasks and multi-answer constraint tasks, and it can also generate with no input at all.
Catalog record
| CREATOR | Junyeob Baek Mingyu Jo Minsu Kim, Mengye Ren Yoshua Bengio Sungjin Ahn, KAIST Mila -- Québec AI Institute, New York University Université de Montréal |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74339 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.19376
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Generative Recursive Reasoning Junyeob Baek Mingyu Jo Minsu Kim, Mengye Ren Yoshua Bengio Sungjin Ahn, KAIST Mila -- Québec AI Institute, New York University Université de Montréal Abstract How should future neural reasoning systems implement extended computation? Recursive Reasoning Models (RRMs) offer a promising alternative to autoregressive sequence extension by performing iterative latent-state refinement with shared transition functions. Yet existing RRMs are largely deterministic, following a single latent trajectory and converging to a single prediction. We introduce Generative Recursive reAsoning Models (GRAM) , a framework that turns recursive latent reasoning into probabilistic multi-trajectory computation. GRAM models reasoning as a stochastic latent trajectory, enabling multiple hypotheses, alternative solution strategies, and inference-time scaling through both recursive depth and parallel trajectory sampling. This yields a latent-variable generative model supporting conditional reasoning via p θ ( y ∣ x ) p_{\theta}(y\mid x) and, with fixed or absent inputs, unconditional generation via p θ ( x ) p_{\theta}(x) . Trained with amortized variational inference, GRAM improves over deterministic recurrent and recursive baselines on structured reasoning and multi-solution constraint satisfaction tasks, while demonstrating an unconditional generation capability. https://ahn-ml.github.io/gram-website 1 Introduction A central question for future neural reasoning systems is how extended computation should be implemented. Large autoregressive models typically scale reasoning by extending a sequence-generation process, whether intermediate computation is expressed explicitly as chain-of-thought tokens or implicitly in hidden or latent representations [ 1 , 2 , 3 , 4 , 5 , 6 ] . A complementary direction is explored by Recursive Reasoning Models (RRMs), which use repeated computation to refine a persistent latent state rather than to append new elements to an output or reasoning sequence [ 7 , 8 , 9 ] . This approach is appealing because it decouples reasoning depth from both parameter scale and output length: a compact model can perform many steps of internal computation by repeatedly applying shared transition functions over time. Recent recursive reasoning models such as HRM [ 8 ] and TRM [ 9 ] provide early evidence for the potential of this approach in structured reasoning. Rather than producing a solution in a single feedforward pass, they perform extended computation through iterative latent-state refinement, deep supervision across refinement steps, and reasoning-oriented recurrent designs such as hierarchical latent dynamics. These features make them well suited to problems requiring constraint propagation, state tracking, iterative correction, and multi-step inference. More broadly, they build on a principle also explored in recurrent Transformer architectures such as Universal Transformers [ 10 ] and Looped Transformers [ 7 ] : shared Transformer blocks can be repeatedly applied to increase computational depth without increasing parameter count. Together, these models suggest that reasoning capability can emerge not only from scaling model size or generating longer traces, but also from the organization of computation itself. Figure 1 : Comparison of Latent Reasoning Trajectories. Left: N-Queens Example with two valid solutions. Right: Given three independent runs for latent reasoning ( \tau_{1},\tau_{2},\tau_{3} ): (a) Prior RRMs (e.g. HRM, TRM) are deterministic—all runs collapse to an identical trajectory, converging to a single solution and failing to explore alternatives, while (b) GRAM explores diverse trajectories, producing diverse trajectories that reach multiple valid solutions y_{1} and y_{2} , while naturally enabling parallel inference-time scaling. While recurrent latent-state refinement provides an appealing mechanism for efficiently increasing reasoning depth, depth alone is not sufficient for many reasoning problems. A capable reasoning system should also be able to maintain uncertainty, consider alternative hypotheses, and explore multiple possible solution strategies [ 11 , 12 ] . This is especially important in settings where ambiguity or multiple valid solutions are intrinsic, and more generally in problems where a single refinement path may become trapped in a suboptimal reasoning trajectory. In this sense, future RRMs should be not only deep, in the sense of repeated refinement, but also wide, in the sense of maintaining and exploring multiple latent trajectories in parallel. Existing RRMs [ 7 , 8 , 9 , 10 ] , however, remain fundamentally deterministic: given the same input and initialization, they follow a single latent trajectory and converge to a single prediction. This deterministic recursion collapses the space of plausible reasoning paths into a single attractor, leaving probabilistic multi-hypothesis latent reasoning largely unexplored within the RRM paradigm. This motivates the central question of our work: can recursive latent computation support probabilistic, generative, multi-hypothesis reasoning while preserving the efficiency of compact recurrent models? In this paper, we propose Generative Recursive reAsoning Models (GRAM), a framework that turns recursive latent reasoning into probabilistic multi-trajectory computation. GRAM treats the reasoning process itself as a stochastic latent trajectory: at each recursion step, the model samples a transition conditioned on the input and the current reasoning state, rather than deterministically updating to a single next state. Repeating this process defines a distribution over possible reasoning trajectories, allowing the model to maintain multiple hypotheses, explore alternative solution strategies, and scale inference not only by increasing recursive depth but also by sampling trajectories in parallel. From a probabilistic perspective, GRAM is a latent-variable generative model: it models p_{\theta}(y\mid x) by marginalizing over latent reasoning trajectories, while the same recursive process can also define an unconditional generative model p_{\theta}(x) when the input is fixed or absent. We evaluate GRAM on controlled reasoning and generation tasks that serve as probes of the architectural properties targeted by our formulation: recursive refinement, stochastic exploration, multi-solution coverage, and inference-time scaling. Given this goal, our experiments focus on comparisons with the most relevant deterministic recurrent and recursive latent reasoning baselines, including Looped Transformers, HRM, and TRM, rather than frontier-scale general-purpose LLMs whose training data, inference budgets, and external scaffolding are not directly comparable. Sudoku-Extreme [ 8 ] and ARC-AGI [ 13 , 14 ] test structured reasoning under hard constraints and abstract transformations; N-Queens and Graph Coloring evaluate multi-solution recovery; and binarized MNIST [ 15 ] probes the unconditional generative interpretation. Our main contribution is to establish probabilistic multi-trajectory recursion as a design principle for future recurrent and recursive reasoning architectures. Concretely, we make three contributions. First, we formulate recursive reasoning as a latent-variable generative process, where solutions are obtained by marginalizing over stochastic reasoning trajectories. Second, we introduce width-based inference-time scaling, enabling inference to scale not only with recursive depth but also with the number of sampled latent trajectories. Third, we provide empirical evidence that this formulation yields the intended architectural advantages over deterministic recurrent and recursive baselines, improving structured reasoning, multi-solution constraint satisfaction, and unconditional generation. 2 Generative Recursive Reasoning Models In this section, we introduce Generative Recursive reAsoning Models (GRAM), an instantiation of probabilistic recursive reasoning. We describe the architecture in Section 2.1 and the training procedure in Section 2.2 , with an architecture schematic shown in Figure 2 . 2.1 Architecture Figure 2 : GRAM Architecture. A single stochastic latent transition in the hierarchical instantiation z=(h,l) . After K low-level refinements via f_{\mathrm{L}} , the high-level update f_{\mathrm{H}} produces a deterministic proposal u_{t} , to which stochastic guidance \epsilon_{t} is added: h_{t}=u_{t}+\epsilon_{t} . Overview. GRAM models the conditional distribution p_{\theta}(y\mid x) by marginalizing over stochastic latent reasoning trajectories. Given an input x , GRAM first computes an embedding \displaystyle e_{x}=f_{\mathrm{enc}}(x;\theta), (1) which is reused throughout the entire recursive computation. Starting