ModeX: Evaluator-Free Best-of-N Selection for Open-Ended Generation

Hyeong Kyu Choi, Sharon Li · 2026

Read ModeX: Evaluator-Free Best-of-N Selection for Open-Ended Generation by Hyeong Kyu Choi, Sharon Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-02535.txt.

Introduction

Hyeong Kyu Choi and Sharon Li solve a selection problem for open ended generation. Where a language model produces several candidate answers and one must be picked, yet no exact correct answer exists to vote on. Best of N methods usually need an external scorer or reward model, and self consistency voting needs answers that match as strings, which free text rarely does.

Their method, ModeX, generalizes majority voting to meaning. It builds a similarity graph over the candidates and repeatedly applies spectral clustering to find the modal output. The answer at the center of the dominant cluster of similar texts, with no extra model and no added inference pass. A lighter version, ModeX-Lite, carries the same principle further. The approach aims to make multi sample generation usable for open tasks such as writing and explanation.

Catalog record

CREATORHyeong Kyu Choi, Sharon Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-02535

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ModeX: Evaluator-Free Best-of-N Selection for Open-Ended Generation Hyeong Kyu Choi, Sharon Li Abstract Selecting a single high-quality output from multiple stochastic generations remains a fundamental challenge for large language models (LLMs), particularly in open-ended tasks where no canonical answer exists. While Best-of- N N and self-consistency methods show that aggregating multiple generations can improve performance, existing approaches typically rely on external evaluators, reward models, or exact string-match voting, limiting their applicability and efficiency. We propose Mode Extraction ( ModeX ), an evaluator-free Best-of- N N selection framework that generalizes majority voting to open-ended text generation by identifying the modal output representing the dominant semantic consensus among generated texts. ModeX constructs a similarity graph over candidate generations and recursively applies spectral clustering to select a representative centroid, without requiring additional inference or auxiliary models. We further instantiate this selection principle as ModeX–Lite , an improved version of ModeX with early pruning for efficiency. Across open-ended tasks—including text summarization, code generation, and mathematical reasoning—our approaches consistently outperform standard single- and multi-path baselines, providing a computationally efficient solution for robust open-ended text generation. Code is released in https://github.com/deeplearning-wisc/ModeX . 1 Introduction Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, from code generation to creative writing [ 1 , 35 , 12 , 40 , 17 ] . Despite this progress, reliably sampling a high-quality output from the model’s inherently stochastic generation process remains a fundamental challenge, particularly for open-ended tasks where no canonical answer exists. Most LLM applications rely on single-path generation , in which the model commits to a single output trajectory token by token. This paradigm is inherently brittle: due to stochastic sampling, a single unfavorable token choice can trigger hallucinations or error propagation, even when the model’s underlying distribution assigns substantial probability mass to correct or coherent outputs [ 38 , 39 ] . A natural solution is therefore to sample multiple generation paths and select the best candidate. Figure 1 : Single Path Generation vs. Mode Extraction (ModeX). While single-path text generation commits to a single trajectory, ModeX leverages the structural information across multiple generation paths to select a “modal” output. Methods such as self-consistency and Best-of- N sampling demonstrate that aggregating multiple outputs can substantially improve performance, particularly on reasoning tasks [ 38 , 14 , 33 ] . However, existing approaches typically rely on either (i) external evaluators such as reward models [ 8 , 22 ] or (ii) exact string-match–based voting schemes. Consequently, these methods are largely confined to closed-ended settings ( e.g. , multiple-choice or short-answer tasks) and do not generalize naturally to open-ended text generation, where outputs may differ lexically yet remain semantically equivalent. These limitations motivate a central question: Can we select a single high-quality output from multiple generation paths without external evaluators or significant computational overhead? To address this question, we propose Mode Extraction (ModeX) , a Best-of- N selection framework that generalizes the principle of majority voting and self-consistency [ 38 ] to open-ended text generation. Rather than relying on an external evaluator, ModeX operates directly within the set of generated texts to identify a representative, high-quality solution. Concretely, ModeX builds a graph in which nodes correspond to generated sequences and edges encode pairwise lexical similarity. We then apply spectral clustering—leveraging the Fiedler vector [ 11 ] of the graph Laplacian—to isolate the dominant semantic cluster, and select its centroid as the final output. Unlike standard voting schemes based on self-consistency, this procedure does not require exact string matches, predefined answer choices, or auxiliary scoring models. Our key insight is that high-quality generations may vary lexically yet tend to form coherent clusters in the semantic space, whereas hallucinations and erroneous outputs are more likely to manifest as sparse outliers [ 23 ] . Consequently, the most reliable output is often not the most extreme or longest response, but the modal one: the generation that best represents the dominant semantic consensus among samples (Figure 1 ). Additionally, we show that the efficiency of ModeX can be further improved through early pruning of generation paths. We introduce ModeX–Lite , a practical extension that periodically applies modal selection and pruning during generation. By identifying non-representative trajectories at early stages, ModeX–Lite retains the robustness benefits of multi-path aggregation while incurring minimal computational overhead, enabling efficient and reliable generation in practice. Through extensive experiments on text summarization, code generation, and mathematical reasoning, we demonstrate that our methods consistently outperform standard single- and multi-path baselines in both reliability and efficiency. We summarize our contributions as follows: • We propose ModeX , an evaluator-free Best-of- N selection framework that generalizes majority voting to open-ended generation without requiring external evaluators or expensive computation . • We further introduce ModeX–Lite , an efficiency-improved variant that remains effective across a wide range of any open-ended generation tasks. • We conduct extensive experiments on three open-ended generation tasks, showing state-of-the-art performance among evaluator-free approaches. We provide theoretical justifications of our approach, offering a principled Best-of- N selection framework for modern LLMs. Figure 2 : Overview of the ModeX framework. In standard ModeX, (1) adjacency matrix construction and (2) spectral graph clustering are iterated recursively as long as \phi\leq\tau . Then (3) centroid selection is performed. In the ModeX–Lite variant, (1) \rightarrow (2) is performed only once without recursion for each pruning interval. 2 Discovering the Mode of Text Can a single high-quality output be selected from multiple text generation paths without relying on reward models or external verifiers? To address this question, we draw inspiration from the principles of majority voting and self-consistency , which have been widely adopted in multi-agent LLM frameworks for question answering [ 38 , 10 , 2 ] . These approaches rest on the premise that, as the number of sampled agents or generation trajectories increases, the aggregated response more faithfully reflects the underlying modal belief of the LLM [ 6 ] . In tasks with a finite answer space ( e.g. multiple-choice question answering), simple voting schemes can therefore reliably recover the modal answer. Extending this idea to open-ended text generation, however, introduces a fundamental challenge: when the output space becomes infinitely large, the notion of majority or mode is no longer directly countable. In this section, we tackle the problem of identifying the modal generation in such open-ended tasks. Specifically, we first introduce Mode Extraction (ModeX), a graphical framework that enables principled mode approximation over multiple generated trajectories (Section 2.1 ), and then qualitatively verify the effectiveness of this approach (Section 2.2 ). 2.1 Mode Extraction (ModeX) ModeX’s approach to selecting the “mode” of the generated responses proceeds in three steps: (1) adjacency matrix construction, (2) graph spectral clustering, and (3) centroid selection. A visual overview is provided in Figure 2 , and the corresponding pseudocode is presented in Algorithm 1 of Appendix F . (1) Adjacency matrix construction. In closed-ended tasks ( e.g. , multiple-choice question answering), majority voting can be viewed as the problem of identifying the largest cluster of identical responses. This perspective naturally admits a graph-theoretic formulation. Specifically, consider a graph \mathcal{G}=(V,E) , where each node v\in V represents a generated response, and an edge e\in E connects nodes that correspond to the same answer.

Read the complete text