Quantum Large Language Model Fine-Tuning
Sang Hyub Kim, Jonathan Mei, Claudio Girotto, Masako Yamada, Martin Roetteler · 2025
Read Quantum Large Language Model Fine-Tuning by Sang Hyub Kim, Jonathan Mei, Claudio Girotto, Masako Yamada, Martin Roetteler (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08732.txt.
Description
Kim and co-authors fine-tune a language model with a hybrid quantum-classical design, in a 2025 paper. The classical half is a sentence transformer strong enough for tasks like sentiment prediction. The quantum half adds parameterized circuits whose qubits connect across long ranges. The team sweep key settings, including qubit count, circuit depth, and learning rate, to find what drives performance.
Across the settings probed, the hybrid models beat a matched classical baseline, with gains up to 3.14 percent in accuracy. Accuracy trended upward as qubits were added. Ablation tests confirmed each module earned its place. The studies used finite sampling and noisy gate simulations, so the results are a proof of direction rather than a claim about today's quantum hardware.
Catalog record
| CREATOR | Sang Hyub Kim, Jonathan Mei, Claudio Girotto, Masako Yamada, Martin Roetteler |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-08732