Quantum Large Language Model Fine-Tuning

Sang Hyub Kim, Jonathan Mei, Claudio Girotto, Masako Yamada, Martin Roetteler · 2025

Read Quantum Large Language Model Fine-Tuning by Sang Hyub Kim, Jonathan Mei, Claudio Girotto, Masako Yamada, Martin Roetteler (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08732.txt.

Description

Kim and co-authors fine-tune a language model with a hybrid quantum-classical design, in a 2025 paper. The classical half is a sentence transformer strong enough for tasks like sentiment prediction. The quantum half adds parameterized circuits whose qubits connect across long ranges. The team sweep key settings, including qubit count, circuit depth, and learning rate, to find what drives performance.

Across the settings probed, the hybrid models beat a matched classical baseline, with gains up to 3.14 percent in accuracy. Accuracy trended upward as qubits were added. Ablation tests confirmed each module earned its place. The studies used finite sampling and noisy gate simulations, so the results are a proof of direction rather than a claim about today's quantum hardware.

Catalog record

CREATORSang Hyub Kim, Jonathan Mei, Claudio Girotto, Masako Yamada, Martin Roetteler
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-08732

Browse the full library · About the Tower of Babel