Stabilizing the Q-Gradient Field for Policy Smoothness in Actor–Critic
Jeong Woon Lee, Kyoleen Kwak, Daeho Kim, Hyoseok Hwang · 2026
Read Stabilizing the Q-Gradient Field for Policy Smoothness in Actor–Critic by Jeong Woon Lee, Kyoleen Kwak, Daeho Kim, Hyoseok Hwang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22970.txt.
Description
Jeong Woon Lee and three co-authors seek smoother control policies from actor-critic learning. Policies learned this way often jitter with rapid, erratic swings, which physical machines cannot follow safely. Common fixes smooth the policy's output directly, treating the symptom rather than the cause.
The authors instead stabilize the Q-gradient field, the signal that guides the policy. A calmer guiding signal should yield calm motion without bolted-on smoothing. Smooth control matters for robots, drones, and other systems that act in the physical world. Treating the cause, not the symptom, is the argument: a jittery gradient field will keep producing jittery policies downstream.
Catalog record
| CREATOR | Jeong Woon Lee, Kyoleen Kwak, Daeho Kim, Hyoseok Hwang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22970