Direct Soft-Policy Sampling via Langevin Dynamics

Donghyeon Ki, Hee-Jun Ahn, Kyungyoon Kim, Byung-Jun Lee · 2026

Read Direct Soft-Policy Sampling via Langevin Dynamics by Donghyeon Ki, Hee-Jun Ahn, Kyungyoon Kim, Byung-Jun Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07873.txt.

Description

Soft policies in reinforcement learning balance exploration and exploitation by sampling actions in proportion to their estimated values, but implementing that sampling is awkward. Donghyeon Ki and three co-authors realize soft-policy sampling directly with Langevin dynamics, which follows the gradient of the action-value function to draw samples without an explicit policy network.

Plain Langevin sampling mixes slowly in high-dimensional, rugged value landscapes, so they add multi-scale noise conditioning to the value function, yielding Noise-Conditioned Langevin Q-Learning. The resulting method samples from the target Boltzmann distribution more effectively while keeping entropy estimates tractable. Reinforcement-learning teams gain a more expressive, principled alternative to parametric and diffusion-based policies.

Catalog record

CREATORDonghyeon Ki, Hee-Jun Ahn, Kyungyoon Kim, Byung-Jun Lee
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07873

Browse the full library · About the Tower of Babel