QUADS \xspace : Qua ntized D istillation Framework for Efficient S peech Language Understanding

Subrata, Mohammad Nur Hossain, Bashima · 2025

Read QUADS \xspace : Qua ntized D istillation Framework for Efficient S peech Language Understanding by Subrata, Mohammad Nur Hossain, Bashima (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14723.txt.

Description

Subrata Biswas, Mohammad Nur Hossain Khan, and Bashima Islam present a compact system for understanding spoken commands, in a paper from 2025. Voice tools on small devices must be both accurate and light. Past work shrank models in two separate steps, which left gains on the table.

Their method trains a small model and squeezes its numbers together in stages, tuned for very low precision. It scored well on two standard speech test sets, with only small drops from top models. At the same time it cut computing work and model size by very large factors. Tests under extreme squeezing held up well, which suits phones and home devices.

Catalog record

CREATORSubrata, Mohammad Nur Hossain, Bashima
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-14723

Browse the full library · About the Tower of Babel