Quantum Verifiable Rewards for Post-Training Qiskit Code Assistant

Nicolas Dupuis, Adarsh Tiwari, Youssef Mroueh, David Kremer, Ismael Faro, Juan Cruz-Benito · 2025

Read Quantum Verifiable Rewards for Post-Training Qiskit Code Assistant by Nicolas Dupuis, Adarsh Tiwari, Youssef Mroueh, David Kremer, Ismael Faro, Juan Cruz-Benito (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20907.txt.

Description

Nicolas Dupuis and five co-authors train a code assistant for quantum programming in a paper from two thousand twenty-five. Writing code for the Qiskit framework is error-prone, and large language models need domain tuning. The team used the quantum hardware itself as the judge.

A synthetic pipeline generated quantum problems paired with unit tests, feeding preference data for one alignment method. A second method rewarded code that truly runs on quantum hardware. The combined model beat the strongest open baselines on a hard Qiskit benchmark built from human-written tasks. Verification, the authors argue, is a natural reward signal where correctness is checkable. The approach ties post-training to executable truth rather than style.

Catalog record

CREATORNicolas Dupuis, Adarsh Tiwari, Youssef Mroueh, David Kremer, Ismael Faro, Juan Cruz-Benito
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-20907

Browse the full library · About the Tower of Babel