Stabilizing the Q-Gradient Field for Policy Smoothness in Actor–Critic

Jeong Woon Lee, Kyoleen Kwak, Daeho Kim, Hyoseok Hwang · 2026

Read Stabilizing the Q-Gradient Field for Policy Smoothness in Actor–Critic by Jeong Woon Lee, Kyoleen Kwak, Daeho Kim, Hyoseok Hwang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22970.txt.

Description

Jeong Woon Lee and three co-authors seek smoother control policies from actor-critic learning. Policies learned this way often jitter with rapid, erratic swings, which physical machines cannot follow safely. Common fixes smooth the policy's output directly, treating the symptom rather than the cause.

The authors instead stabilize the Q-gradient field, the signal that guides the policy. A calmer guiding signal should yield calm motion without bolted-on smoothing. Smooth control matters for robots, drones, and other systems that act in the physical world. Treating the cause, not the symptom, is the argument: a jittery gradient field will keep producing jittery policies downstream.

Catalog record

CREATORJeong Woon Lee, Kyoleen Kwak, Daeho Kim, Hyoseok Hwang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22970

Browse the full library · About the Tower of Babel