Dynamic Optimizations of LLM Ensembles with Two-Stage Reinforcement Learning Agents

Selim Furkan Tekin, Gaowen Liu, Ramana Rao Kompella, Ling Liu · 2025

Read Dynamic Optimizations of LLM Ensembles with Two-Stage Reinforcement Learning Agents by Selim Furkan Tekin, Gaowen Liu, Ramana Rao Kompella, Ling Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04492.txt.

Description

Selim Tekin, Gaowen Liu, Ramana Kompella, and Ling Liu route questions across groups of language models. Their twenty twenty-five paper presents a two-stage reinforcement learning system. Using several models together can beat any single model. Picking the right team for each query is the hard part.

A first agent, called the Decider, picks a small team for each task. It rewards teams that reason well and err in different ways. A second agent then merges the team answers and settles conflicts. A new diversity measure helps prune weak team combinations. The system adapts its teams as tasks change, rather than fixing one ensemble for all queries.

Catalog record

CREATORSelim Furkan Tekin, Gaowen Liu, Ramana Rao Kompella, Ling Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE86 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04492

Browse the full library · About the Tower of Babel