Fine-Tuning Small Reasoning Models for Quantum Field Theory

Nathaniel S. Woodward, Zhiqi Gao, Yurii Kvasiuk, Kendrick M. Smith, Frederic Sala, Moritz Münchmeyer · 2026

Read Fine-Tuning Small Reasoning Models for Quantum Field Theory by Nathaniel S. Woodward, Zhiqi Gao, Yurii Kvasiuk, Kendrick M. Smith, Frederic Sala, Moritz Münchmeyer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18936.txt.

Description

Woodward and five colleagues compare reinforcement learning and supervised fine tuning for small reasoning models in quantum field theory. Verifiable training data is scarce, so they built a pipeline that creates synthetic problems and adapts human authored ones. They generated over 2,500 synthetic problems plus curated human adapted problems from arXiv and textbooks. Both methods beat the base model on every set, but supervised gains cluster on synthetic tasks while reinforcement learning generalizes better. Reinforcement learning tops supervised results on human sets and TPBench.

Catalog record

CREATORNathaniel S. Woodward, Zhiqi Gao, Yurii Kvasiuk, Kendrick M. Smith, Frederic Sala, Moritz Münchmeyer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE150637
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18936

Browse the full library · About the Tower of Babel