Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device
Juntae Lee Jihwan Bang Seunghan Yang Kyuhong Shim Simyung Chang, Qualcomm AI Research {juntlee, jihwbang, seunghan, kshim, simychan}@qti.qualcomm.com · 2025
Read Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device by Juntae Lee Jihwan Bang Seunghan Yang Kyuhong Shim Simyung Chang, Qualcomm AI Research {juntlee, jihwbang, seunghan, kshim, simychan}@qti.qualcomm.com (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15134.txt.
Description
Juntae Lee and four co-authors at Qualcomm AI Research make retrieval-augmented AI work on small devices in a 2025 paper. Such systems let a language model look up facts, which helps in narrow fields where accuracy matters.
The usual reasoning style, writing out long chains of thought, is too costly for small models on phones and other edge devices. The authors replace it with Chain-of-Rank: the model simply ranks how reliable each retrieved document is. That ranking is cheap to compute and easier for a small model to learn. The method reached top results on their benchmarks. It suits personal devices that must answer from a fixed body of knowledge without a data center behind them.
Catalog record
| CREATOR | Juntae Lee Jihwan Bang Seunghan Yang Kyuhong Shim Simyung Chang, Qualcomm AI Research {juntlee, jihwbang, seunghan, kshim, simychan}@qti.qualcomm.com |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-15134