Fine-Tuning Small Reasoning Models for Quantum Field Theory
Nathaniel S. Woodward, Zhiqi Gao, Yurii Kvasiuk, Kendrick M. Smith, Frederic Sala, Moritz Münchmeyer · 2026
Read Fine-Tuning Small Reasoning Models for Quantum Field Theory by Nathaniel S. Woodward, Zhiqi Gao, Yurii Kvasiuk, Kendrick M. Smith, Frederic Sala, Moritz Münchmeyer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18936.txt.
Description
Woodward and five colleagues compare reinforcement learning and supervised fine tuning for small reasoning models in quantum field theory. Verifiable training data is scarce, so they built a pipeline that creates synthetic problems and adapts human authored ones. They generated over 2,500 synthetic problems plus curated human adapted problems from arXiv and textbooks. Both methods beat the base model on every set, but supervised gains cluster on synthetic tasks while reinforcement learning generalizes better. Reinforcement learning tops supervised results on human sets and TPBench.
Catalog record
| CREATOR | Nathaniel S. Woodward, Zhiqi Gao, Yurii Kvasiuk, Kendrick M. Smith, Frederic Sala, Moritz Münchmeyer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 150637 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18936