Coherence Maximization Improves Pluralistic Alignment

Taslim Mahbub, Yiding Pei, Shi Feng · 2026

Read Coherence Maximization Improves Pluralistic Alignment by Taslim Mahbub, Yiding Pei, Shi Feng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03110.txt.

Introduction

Mahbub, Pei, and Feng study how to align AI systems with the varied values of human groups. Good alignment needs value specs grounded in concrete cases. The team tests a method called Internal Coherence Maximization, or ICM. It infers labels by making them as mutually predictable as it can.

ICM-made examples, tuned to a persona, steer a model toward that group's values with no human labels. Across four benchmarks, they matched the effect of gold labels. The team also shows that coherence counts on its own. With accuracy held fixed, more coherent examples generalized far better than mixed ones. For personas that are rare in pretraining data, a small fix helped. Human feedback on the questions where the model was least sure beat the same count of labels on random questions. The authors name coherence a core design rule for value specs at scale.

Catalog record

CREATORTaslim Mahbub, Yiding Pei, Shi Feng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03110

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Coherence Maximization Improves Pluralistic Alignment Taslim Mahbub, Yiding Pei, Shi Feng Abstract Aligning AI systems with diverse human values requires value specifications grounded in concrete examples, but generating such examples without extensive human supervision remains an open challenge. We investigate what makes these examples effective, using Internal Coherence Maximization (ICM)—which infers labels by maximizing their mutual predictability—to generate persona-specific examples that steer a model toward a target group’s values, without human supervision. Across four benchmarks spanning classification, preference, and open-ended generation, ICM-inferred in-context examples match the performance of gold labels. Crucially, coherence matters beyond individual label accuracy: with accuracy held constant, more coherent examples generalize substantially better than incoherent ones. For personas underrepresented in pretraining data, targeted human feedback on the questions where the model is least certain about a persona’s values yields better generalization than the same number of labels on arbitrary questions. These results identify coherence as a key design principle for scalable value specification, leveraging the diverse human perspectives already encoded in pretrained language models. 1 Introduction Figure 1: Unsupervised coherence maximization matches gold-supervised performance; zero-shot prompting trails. Each bar is the mean across all (model, dataset) pairs of a condition’s score as a percentage of gold-supervised performance (y-axis starts at 70% for visual clarity), aggregated over 6 models and 4 datasets. Our method labels the in-context examples with no human supervision, selecting the labels that are most mutually consistent under the model. The Accuracy-Matched baseline relabels the same example items to be equally accurate but less internally consistent, isolating the effect of coherence from that of raw label correctness. Markers show per-dataset means. Effective value specification remains a central challenge in AI alignment: specifications must faithfully represent human preferences while guiding models to generalize appropriately in novel contexts. While high-level principles such as “be helpful and harmless" provide directional guidance, recent work identifies a fundamental gap between abstract principles and practical implementation. 16 show that high-level principles lack proven methods for translation into practice, and 25 demonstrate that inevitable tensions arise when applying principles to concrete cases, tensions that cannot be resolved at the level of abstraction alone. This specification gap suggests that abstract principles are necessary but insufficient for effective value specification. A growing body of evidence indicates that concrete examples are not merely supplementary but foundational to value specification. Constitutional AI requires few-shot examples to operationalize its principles ( 3 ) , InstructGPT’s pipeline begins with supervised learning on examples before preference optimization ( 18 ) , and recent work on inverse reinforcement learning shows that concrete examples can outperform preference data for capturing human values faithfully ( 6 ) . The case-based reasoning tradition in AI ethics grounds this observation theoretically, arguing that ethical evaluation requires carefully engaging with the interplay between general principles and particular cases ( 8 ) . Empirical studies further show that grounding value specifications in examples provides a high-quality signal that zero-shot prompting misses ( 1 ; 26 ) . The challenge intensifies in pluralistic settings where human preferences diverge across populations and contexts. A single constitution cannot capture the full range of human values, and standard alignment procedures risk collapsing the distributional pluralism necessary for serving diverse populations ( 10 ; 23 ) . This motivates the need for value examples specific to a persona, which we define as a conditioning variable representing the values or preferences of a particular group (e.g., a country, a political affiliation, or a shared interaction style), demonstrating how abstract principles apply to that group. Our contribution. We investigate the drivers of effective value specification for pluralistic alignment, using Internal Coherence Maximization (ICM) to generate persona-specific examples. We make three contributions. First , we show that the coherence of an in-context example set (the mutual predictability of its labels under the base model) predicts downstream generalization better than the labels’ individual accuracy , i.e., the fraction that match ground truth: holding label accuracy fixed, more coherent example sets generalize substantially better. Second , ICM-inferred examples, produced without any human supervision, match gold examples at steering a model toward a target group’s values—measured as label or preference accuracy on the classification benchmarks and as a representation score on open-ended generation. This holds across four datasets and three task formats, remains stable across three model families and two scales each, and persists even though the inferred labels are individually less accurate than human labels. Finally , for populations underrepresented in pretraining data, where unsupervised inference is least reliable, we show that collecting human labels on the highest-uncertainty questions generalizes substantially better than the same number of labels on arbitrary questions. Together, these results suggest that coherence is a key design principle for scalable value specification. 2 Background and Motivation The Pluralism Problem. In a pluralistic world, human preferences differ across individuals, cultures, and contexts, making a single globally correct specification ill-defined ( 7 ) . Contemporary alignment operationalizes values via global axes such as helpfulness, honesty, and harmlessness, yet these objectives generalize poorly where preferences diverge ( 23 ) . RLHF-based training compounds this: post-training datasets encode conflicting preferences ( 17 ) , but standard procedures select one perspective rather than preserving diversity ( 12 ; 27 ) . Limitations of Current Approaches. Interactive elicitation methods such as GATE address pluralism through steerable personalization but face two limitations: they require extensive direct user interaction, and they do not leverage latent knowledge about value diversity already encoded within pretrained models. Critically, base models have been shown to better reflect human values across countries than post-trained models ( 23 ) , possibly because post-training collapses the pluralistic structure present in pretraining data. This suggests an opportunity: extracting value-relevant structure from pretrained models with minimal supervision, reserving interaction for cases where it is most needed. We hypothesize that pretrained models encode distinct value profiles for the diverse populations they encounter, and that maximizing the internal coherence of a persona’s labels can surface these profiles without supervision. Operationalizing Pluralism. We operationalize pluralistic alignment as steerability ( 23 ) : the ability to condition a model on a target persona so that its outputs reflect that group’s values rather than a single global norm. This is the property we target throughout. Concretely, steerability asks: when conditioned on a persona, does the model produce outputs consistent with that group? We measure it across all four datasets—as label or preference accuracy on the classification benchmarks and as a representation score on open-ended generation (Figure 2 ). As a complementary lens, we also report distributional pluralism, i.e., whether the model captures how opinions differ across populations, by comparing predicted and observed opinion distributions per persona (Figure 5 ). 3 Method Our approach uses a coherence-maximization algorithm to generate persona-specific value examples without human supervision. The pipeline consists of three stages: (1) persona extraction and item selection, (2) ICM-based label inference, and (3) in-context conditioning for inference. 3.1 Personas and Items The pipeline begins by extracting coarse-grained persona features (e.g., nationality, demographics, or political affiliation) as contextual anchors. In this work, for simplicity and reproducibility, we restrict persona extraction to features that are explicitly stated in the target query. Given a selected persona, we identify a set of items relevant to the target

Read the complete text