PEPS: Quantum-Inspired Reinforcement Learning for Coherent Reasoning Traces in LLMs

Venkat Margapuri, Garik Kazanjian, Naren Kosaraju · 2025

Read PEPS: Quantum-Inspired Reinforcement Learning for Coherent Reasoning Traces in LLMs by Venkat Margapuri, Garik Kazanjian, Naren Kosaraju (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20105.txt.

Description

Venkat Margapuri, Garik Kazanjian, and Naren Kosaraju wrote this 2025 arXiv paper on how language models reason. Long chains of thought often lose their thread, most of all when a task needs strict step-by-step logic. The team tries to fix this with a reward drawn from a quantum physics tool called Projected Entangled Pair States.

The reward scores how well a chain of thought sticks to a clear target shape. It is added to a well-known training method for reinforcement learning. No teacher marks each step; the score guides learning by shape alone. Tests used math word problems and two other reasoning sets, GSM8K, StrategyQA, and EntailmentBank. Scores for coherence rose above those of supervised, contrastive, and plain pretrained baselines. The team presents this quantum-inspired score as a sound base for chains of thought that hold together.

Catalog record

CREATORVenkat Margapuri, Garik Kazanjian, Naren Kosaraju
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-20105

Browse the full library · About the Tower of Babel