Anchorless Diversification for Parallel LLM Ideation

Fares Nabil Ibrahim, Nafis Saami Azad, Raiyan Abdul BatenBellini College of Artificial Intelligence, Cybersecurity, and Computing,University of South Florida, USA {faresibrahim, nafisazad, rbaten}@usf.edu · 2026

Read Anchorless Diversification for Parallel LLM Ideation by Fares Nabil Ibrahim, Nafis Saami Azad, Raiyan Abdul BatenBellini College of Artificial Intelligence, Cybersecurity, and Computing,University of South Florida, USA {faresibrahim, nafisazad, rbaten}@usf.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30150.txt.

Introduction

Fares Nabil Ibrahim, Nafis Saami Azad and Raiyan Abdul Baten study how to widen idea pools from parallel model generation with no seed ideas. Across three creative task families, they test solo generation and semantic direction stratification against anchored baselines. Population-based divergence is a strong low-cost baseline, raising diversity while keeping quality scores. That method does better: one planning call spreads generations for the best diversity, quality and compute frontier. Anchored regeneration fades once full token costs are counted.

Catalog record

CREATORFares Nabil Ibrahim, Nafis Saami Azad, Raiyan Abdul BatenBellini College of Artificial Intelligence, Cybersecurity, and Computing,University of South Florida, USA {faresibrahim, nafisazad, rbaten}@usf.edu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60557
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30150

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Anchorless Diversification for Parallel LLM Ideation Fares Nabil Ibrahim, Nafis Saami Azad, Raiyan Abdul BatenBellini College of Artificial Intelligence, Cybersecurity, and Computing,University of South Florida, USA {faresibrahim, nafisazad, rbaten}@usf.edu Abstract LLMs are increasingly used to generate candidate-idea pools for creative tasks where broad exploration is valuable. Parallel inference can be attractive in this setting when it broadens the pool while retaining quality and cost efficiency. We study inference-time controls for candidate-pool diversification, asking whether anchorless methods can rival methods that depend on observed seed ideas. Across three creative task families, we compare independent generation and semantic direction stratification with self-, peer-, and representative-anchor baselines, under neutral and population-referential divergent instructions. Population-referential divergence is a strong low-cost baseline, increasing semantic diversity while preserving quality proxies. Semantic direction stratification is stronger: a single planning call organizes generations across broad semantic directions, yielding the best diversity–quality–compute frontier. Anchored regeneration can be strong in final-pool diversity, but its advantage shrinks under full-pipeline token accounting. These results establish practical anchorless baselines for open-ended LLM ideation. 1 Introduction LLMs are increasingly used for creative ideation by generating pools of possibilities: research questions, product concepts, story premises, design directions, or campaign ideas ( 15 ; 14 ; 39 ) . This makes parallel inference attractive: instead of scaling model parameters, a deployed system can attempt to optimally fan out many candidate generations in parallel that a human or downstream agent can compare, reject, combine, and develop ( 38 ; 54 ) . The value of this strategy depends on whether the pool broadens the space of possibilities without sacrificing quality or compute budget. When many candidates return to the same semantic basin, parallel generation creates an appearance of exploration while narrowing the ideas available for downstream AI creation and human–AI co-creation ( 11 ; 2 ; 6 ; 32 ; 5 ; 1 ) . This failure mode is especially plausible for contemporary LLMs, whose pretraining, post-training, and preference optimization can concentrate probability mass around familiar patterns ( 47 ; 24 ; 21 ; 29 ; 37 ) . A growing literature has studied how to diversify LLM outputs in creative generation and adjacent NLP tasks. Temperature tuning is the simplest route, but often trades diversity against quality ( 40 ; 9 ; 49 ) . More structured methods add inference-time machinery: collective critique and voting, multi-agent debate, self-evaluation, evolutionary search, iterative prompting, or anti-anchors selected from prior outputs ( 26 ; 28 ; 13 ; 7 ; 9 ; 19 ; 52 ) . These methods can improve final-pool diversity, but they weaken the practical appeal of parallel inference by requiring extra calls, shared state, observed examples, or pool-level coordination. Prior work typically evaluates the returned set while leaving this hidden inference path outside the cost comparison. For scalable parallel creative ideation, the challenge is to obtain as much diversity as possible per unit of inference cost while preserving output quality. Recent stratified-generation work offers a useful clue. In underspecified question-answering tasks, LLMs can identify meaningful partitions of a response space without first observing sample answers , then use those partitions to improve resampling diversity and answer coverage while maintaining quality checks ( 45 ) . This suggests that a model may possess a higher-level map of plausible response regions even when its default samples concentrate in only a few of them. We adapt this approach for a broader suite of creative ideation tasks: a single planning call asks the model to propose broad semantic directions for the task, and all later candidate generations then run in parallel with the generation budget allocated evenly across those directions. The model’s own semantic map therefore becomes a lightweight way to spread a candidate pool across distinct regions of a creative possibility space, without requiring seed ideas or sequential coordination. This same intuition also motivates revisiting an intervention that prior evidence makes easy to doubt: direct instruction ( 17 ; 53 ) . Earlier prompt-only approaches often ask models to be creative or novel, but those instructions can be underspecified. Creativity may refer to the intrinsic quality of one response, whereas candidate-pool diversity is extrinsic and population-level: an idea is useful partly because it differs from what else the system would have produced ( 4 ) . Even when a model follows the instruction to move away from the default response, the instruction alone gives no explicit account of where it should go; crowding can simply reappear in the next most obvious semantic basin. We therefore use a counterfactual, population-referential instruction: generate a response that stands out from other responses that might be generated for the same task. This tests whether contemporary instruction-tuned models can use implicit knowledge of likely responses to avoid redundancy without seeing the pool they are diversifying against. We evaluate these two anchorless controls against stronger stateful alternatives. Across alternative uses, slogans, and short stories, we generate candidate idea pools from GPT-5.4, Claude Sonnet 4.6, and Gemini 2.5 Pro. We compare independent generation, semantic direction stratification, self-anchoring, dyadic and triadic peer anti-anchoring, and shared representative anti-anchoring, each under neutral and divergent instructions. We evaluate each pool using semantic diversity metrics, task-specific quality proxies, rarefaction, and full-pipeline token accounting. This separates the final-pool question from the deployment question: a method may produce a diverse pool, yet become unattractive once planning, seed generation, and regeneration costs are counted. Three results emerge. First, a direct divergence instruction is a strong low-cost baseline: it improves independent-pool diversity for all three models while preserving or improving automatic quality proxies. Second, semantic direction stratification is a strong anchorless diversification signal: it uses a single planning call to organize parallel generation around broad semantic directions, reaches the top tier of final-pool diversity, and yields high diversity gain per 100k pipeline tokens. Third, stratification and divergence are complementary. Their combination provides the strongest diversity–quality–compute frontier in our design and remains substantially cheaper than seed-and-regenerate pipelines. Local self- and peer-anchor methods remain powerful when seed outputs are available, but their advantage shrinks under full-pipeline token accounting. These findings establish direct divergent independent generation and equal-budget stratified divergence as practical inference-time baselines for open-ended LLM ideation. 2 Related Work LLMs sample from prompt-conditioned distributions shaped by shared training data, post-training objectives, decoding parameters, and prompting protocols, often causing the model generations to collapse toward repeated themes, templates, or semantic regions 37 ; 20 ; 25 ; 31 ; 48 . This has motivated several approaches to increasing output diversity, spanning model training and inference-time interventions. One line of work makes diversity a model-development objective. Post-training and preference-optimization methods encourage models to prefer rare and high-quality responses, often through data selection and training objectives ( 44 ; 8 ; 27 ; 23 ; 10 ) . Related work on iterative self-improvement and synthetic data generation shows that repeated training on model-generated text can reduce linguistic or solution-path diversity unless diversity is built into data selection or optimization ( 34 ; 18 ; 17 ) . These approaches are important because they make diversity part of the model or data pipeline, but they are less directly available when users operate fixed, closed-weight models and must decide how to allocate inference calls at deployment time. A second line

Read the complete text