Quantum Verifiable Rewards for Post-Training Qiskit Code Assistant
Nicolas Dupuis, Adarsh Tiwari, Youssef Mroueh, David Kremer, Ismael Faro, Juan Cruz-Benito · 2025
Read Quantum Verifiable Rewards for Post-Training Qiskit Code Assistant by Nicolas Dupuis, Adarsh Tiwari, Youssef Mroueh, David Kremer, Ismael Faro, Juan Cruz-Benito (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20907.txt.
Description
Nicolas Dupuis and five co-authors train a code assistant for quantum programming in a paper from two thousand twenty-five. Writing code for the Qiskit framework is error-prone, and large language models need domain tuning. The team used the quantum hardware itself as the judge.
A synthetic pipeline generated quantum problems paired with unit tests, feeding preference data for one alignment method. A second method rewarded code that truly runs on quantum hardware. The combined model beat the strongest open baselines on a hard Qiskit benchmark built from human-written tasks. Verification, the authors argue, is a natural reward signal where correctness is checkable. The approach ties post-training to executable truth rather than style.
Catalog record
| CREATOR | Nicolas Dupuis, Adarsh Tiwari, Youssef Mroueh, David Kremer, Ismael Faro, Juan Cruz-Benito |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-20907