SliceGraph: Mapping Process Isomers in Multi-Run Chain-of-Thought Reasoning

Kang Chen 1*, Junjie Nian 1*, Yixin Cao 1,2 † \dagger, Yugang Jiang 1 · 2026

Read SliceGraph: Mapping Process Isomers in Multi-Run Chain-of-Thought Reasoning by Kang Chen 1*, Junjie Nian 1*, Yixin Cao 1,2 † \dagger, Yugang Jiang 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14619.txt.

Introduction

Chen, Nian, Cao and Jiang map how multi-run chain-of-thought reasoning splits and rejoins, instead of collapsing runs to final answers. Their SliceGraph links reasoning slices by sparse activation-key similarity into a problem-model-cell graph. Across math and science runs from three models, most cells split correct chains with the same answer into several process families, dubbed process isomers. Success-linked regions also split into separate high-value cores, with route families specialising over them.

Catalog record

CREATORKang Chen 1*, Junjie Nian 1*, Yixin Cao 1,2 † \dagger, Yugang Jiang 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81505
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14619

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SliceGraph: Mapping Process Isomers in Multi-Run Chain-of-Thought Reasoning Kang Chen 1*, Junjie Nian 1*, Yixin Cao 1,2 † \dagger, Yugang Jiang 1 Abstract Multi-run chain-of-thought reasoning is usually collapsed to final-answer aggregates, which discard how sampled trajectories share, split, and rejoin through intermediate computation. We propose SliceGraph , a post-hoc problem-model-cell graph built by mutual- k k NN over sparse activation-key Jaccard similarity between CoT slices, and treat it as a measurement object for process geometry rather than as a decoding program. Across sampled CoT ensembles from three primary 4B/8B models on math and science benchmarks, blinded annotation supports SliceGraph biconnected components as shared reasoning-state units and process families as within-family strategy-coherent route units. In 85.5 % 85.5\% of 954 954 problem-model cells, correct CoTs sharing the same normalized answer split into multiple process families; among cells with at least two such runs, 76.6 % 76.6\% of run pairs are cross-family on average. We call such same-answer, family-divergent correct trajectories process isomers . A label-seeded reward field provides a separate value-landscape layer: success-associated regions often split into disconnected high-value cores, and route families specialize over these core footprints rather than merely duplicating one another. A typed-state transition analysis further shows that process families navigate the same atlas with distinct transition kernels under matched null controls. Representation ablations, a cross-architecture replication, and two cross-scale replications support the robustness of the route-family scaffold, showing that final-answer aggregation overlooks this structured multi-route process geometry. 1] Fudan University 2] Shanghai Innovation Institute \correspondence \checkdata [Code] https://github.com/JunjieNian/SliceGraph † † footnotetext: * Contributed equally. † † footnotetext: \dagger Corresponding author. 1 Introduction Test-time sampling now routinely draws many CoT trajectories per problem [ 11 , 14 , 2 , 8 ] , while self-consistency aggregates them only by final string. But the N runs of one problem-model cell are not a bag of independent samples: they share intermediate computation, fork at decision points, and rejoin through common subroutines. Once internal states are connected by similarity, consistency can be lifted from final answers to processes , and two correct runs are consistent when they reach overlapping computation. Most internal analyses so far remain within-run, studying semantic convergence, step-specific geometry, or late correctness signals [ 12 , 9 ] rather than the joint structure across runs. Building such a graph requires slice-level similarity, for whole-run is too coarse: two runs can share a long trunk and diverge at one fork, or reach the same answer by different routes. Once the graph is built, the substantive question shifts from selection to geometry. When many CoTs solve the same problem, do correct solutions converge to one process route, or do they form several distinct process isomers that share the same final answer through different intermediate routes? Figure 1 : Same-answer runs can follow distinct process families. Prior graph and topology pipelines on traces [ 13 , 18 , 10 ] compress each slice via PCA, UMAP, or sentence transformers before reading similarities. In our fixed mutual- k NN scaffold, however, projection- or text-based slice representations distort the route geometry: PCA compresses correct-only family counts and slice-text embeddings nearly collapse the atlas (Section 4.3 ). Unprojected sparse activation-key Jaccard similarity preserves the multi-route structure across all three primary models. We therefore build directly on top- k activation key sets. Each slice is a bounded binary key set, and per-problem edges are mutual- k NN under Jaccard distance. We call this object SliceGraph and treat it as a measurement target, not a decoding program. Biconnected components, articulation points, and process families are structural units read from this fixed graph. Reward diffusion and typed-state transition diagnostics then add label and temporal information on top of the same scaffold. Two blinded annotation studies validate the structural object before any geometric claim is made, and matched null controls test which claims survive after graph structure, family labels, answer labels, or temporal order are perturbed. Informally, two correct runs that reach the same answer through different process families are process isomers : same problem, same normalized answer, different route scaffold. Process isomerism is a route relation, not a value relation: high-value cores can refine, explain, or separate route families, but they do not define whether two same-answer traces are isomers. High-value cores then show whether those routes traverse shared or disjoint value basins. Contributions. • A process atlas for mapping same-answer route diversity. We introduce SliceGraph, a post-hoc per-problem-model-cell graph built directly from sparse activation-key overlap between CoT slices. Unlike decoding graphs, SliceGraph is a measurement object: it exposes shared trunks, forks, partial rejoin points, and route-level structure after sampling. • Validated structural units. We decompose SliceGraph into biconnected components, articulation points, process families, and label-seeded high-value cores. Blinded annotation supports BCCs as shared reasoning-state units and process families as within-family strategy-coherent route units; robustness checks test representation choice, graph perturbations, family-label shuffles, answer-label shuffles, and temporal-order perturbations. • Process isomers behind the same answer. On the validated atlas, sampled correct CoTs often reach the same normalized answer through different correct-only process families. We define these family-divergent same-answer traces as process isomers. High-value cores provide a separate value-landscape layer, showing that success-associated regions are often multi-basin and that route families specialize over those basins. • Route dynamics, not just route labels. We lift block trajectories to a typed-state transition model and show that family-specific transition kernels differ significantly under matched null controls. 2 Related Work Graphs as inference programs versus measurement objects. Self-consistency [ 11 ] , Tree-of-Thoughts [ 14 ] , and Graph-of-Thoughts [ 2 ] use graphs as decoding strategies built before or during sampling. Our graph is instead a measurement object: it is built after sampling from local activation similarity across many runs, and is used to characterise process geometry rather than to drive decoding. Within-run trajectory analysis. A line of work analyses LLM reasoning as structured motion in representation space, including semantic convergence from truncated trajectories [ 12 ] , step-specific geometry [ 9 ] , layer-wise displacement of the truth signal [ 6 ] , hidden-state DAG probes [ 17 ] , and shared decision pivots [ 5 ] . These analyses stay within a single trajectory; we study the joint neighbourhood structure across runs for one problem. Graph and topology pipelines. The graph and topology pipelines we compare against rely on intermediate projection: Mapping the Minds [ 13 ] clusters CoT paragraphs into NLI dependency graphs, Landscape of Thoughts [ 18 ] projects answer-distance vectors with t -SNE, and The Shape of Reasoning [ 10 ] runs persistent homology on step embeddings. Activation-set similarity has been used as a best-of- N selector in Neuron Agreement Decoding [ 4 ] ; the same sparse-cache infrastructure supports temporal explore–exploit phase detection for label-free CoT scoring [ 3 ] . Building on these, we construct the graph directly on unprojected sparse activation-key Jaccard with no projection or sentence embedding and then analyse its combinatorial topology; Section 4.3 shows that PCA and sentence-embedding pipelines on the same scaffold compress the multi-route family geometry that SliceGraph captures. 3 Method The method has five layers. The first three build the route scaffold on which process isomerism is measured without the label-seeded reward field; the last two

Read the complete text