Can Small Language Models Handle Context-Summarized Multi-Turn Customer-Service QA? A Synthetic Data-Driven Comparative Evaluation
Lakshan Cooray ,1, Deshan Sumanathilaka 2, Pattigadapa Venkatesh Raju 3 · 2026
Read Can Small Language Models Handle Context-Summarized Multi-Turn Customer-Service QA? A Synthetic Data-Driven Comparative Evaluation by Lakshan Cooray ,1, Deshan Sumanathilaka 2, Pattigadapa Venkatesh Raju 3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00665.txt.
Description
Lakshan Cooray and colleagues ask whether small language models can handle multi-turn customer-service question answering. Here history is carried forward as a summary. Large models perform well but cost too much to deploy in constrained settings. Small models remain little tested on dialogue continuity. The study evaluates nine instruction-tuned small models against three commercial large models. It uses lexical and semantic scores plus human and model-based judgement. Results vary widely. Some small models approach large-model quality. Others lose track of context.
Catalog record
| CREATOR | Lakshan Cooray ,1, Deshan Sumanathilaka 2, Pattigadapa Venkatesh Raju 3 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60846 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.00665