Can Small Language Models Handle Context-Summarized Multi-Turn Customer-Service QA? A Synthetic Data-Driven Comparative Evaluation

Lakshan Cooray ,1, Deshan Sumanathilaka 2, Pattigadapa Venkatesh Raju 3 · 2026

Read Can Small Language Models Handle Context-Summarized Multi-Turn Customer-Service QA? A Synthetic Data-Driven Comparative Evaluation by Lakshan Cooray ,1, Deshan Sumanathilaka 2, Pattigadapa Venkatesh Raju 3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00665.txt.

Description

Lakshan Cooray and colleagues ask whether small language models can handle multi-turn customer-service question answering. Here history is carried forward as a summary. Large models perform well but cost too much to deploy in constrained settings. Small models remain little tested on dialogue continuity. The study evaluates nine instruction-tuned small models against three commercial large models. It uses lexical and semantic scores plus human and model-based judgement. Results vary widely. Some small models approach large-model quality. Others lose track of context.

Catalog record

CREATORLakshan Cooray ,1, Deshan Sumanathilaka 2, Pattigadapa Venkatesh Raju 3
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60846
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.00665

Browse the full library · About the Tower of Babel