A Survey on Collaborative Mechanisms Between Large and Small Language Models
Yi Chen, JiaHao Zhao, HaoHao Han · 2025
Read A Survey on Collaborative Mechanisms Between Large and Small Language Models by Yi Chen, JiaHao Zhao, HaoHao Han (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-07460.txt.
Description
Yi Chen, JiaHao Zhao, and HaoHao Han survey ways for big and small language models to work as a team in a 2025 paper. Big models are capable but slow and costly. Small ones are cheap and quick to run on a phone, yet weaker.
Pairing them can balance the trade off. The survey sorts teamwork into five styles: chains where one feeds the next, routers that send each query to the right size, and helpers that assist in the background. Teaching, where the big model trains the small one, and blends that fuse them round out the list. Uses cluster on devices that need low delay, privacy, personal tuning, or offline work.
Catalog record
| CREATOR | Yi Chen, JiaHao Zhao, HaoHao Han |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 104 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-07460