Diverse LLMs or Diverse Question Interpretations? That is the Ensembling Question

Rafael Rosales, Santiago Miret · 2025

Read Diverse LLMs or Diverse Question Interpretations? That is the Ensembling Question by Rafael Rosales, Santiago Miret (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21168.txt.

Description

Rafael Rosales and Santiago Miret test two ways to make language model teams smarter in a 2025 paper. One way fields many distinct models on the same question. The other asks one model the same question in many wordings. Both then settle the answer by majority vote.

Across three yes-no question sets, from general facts to medical claims, the wording route won again and again. The model route mostly landed between its best and worst members, with no clear lift. Tests on two model families told the same tale. Variety in how a question is read beat variety in who reads it.

Catalog record

CREATORRafael Rosales, Santiago Miret
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-21168

Browse the full library · About the Tower of Babel