A Survey on Collaborative Mechanisms Between Large and Small Language Models

Yi Chen, JiaHao Zhao, HaoHao Han · 2025

Read A Survey on Collaborative Mechanisms Between Large and Small Language Models by Yi Chen, JiaHao Zhao, HaoHao Han (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-07460.txt.

Description

Yi Chen, JiaHao Zhao, and HaoHao Han survey ways for big and small language models to work as a team in a 2025 paper. Big models are capable but slow and costly. Small ones are cheap and quick to run on a phone, yet weaker.

Pairing them can balance the trade off. The survey sorts teamwork into five styles: chains where one feeds the next, routers that send each query to the right size, and helpers that assist in the background. Teaching, where the big model trains the small one, and blends that fuse them round out the list. Uses cluster on devices that need low delay, privacy, personal tuning, or offline work.

Catalog record

CREATORYi Chen, JiaHao Zhao, HaoHao Han
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-07460

Browse the full library · About the Tower of Babel