SAVGO: Learning State–Action Value Geometry with Cosine Similarity for Continuous Control

Stavros Orfanoudakis, Pedro P. Vergara · 2026

Read SAVGO: Learning State–Action Value Geometry with Cosine Similarity for Continuous Control by Stavros Orfanoudakis, Pedro P. Vergara (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-00787.txt.

Description

Stavros Orfanoudakis and Pedro P. Vergara present SAVGO, a reinforcement learning method for continuous control, where an agent chooses smooth actions such as joint torques. Earlier similarity methods helped agents learn, but rarely shaped the policy update itself. SAVGO learns a shared space for states and actions where pairs with similar values sit close in angle, and pairs with different values point apart.

That learned geometry builds a kernel over candidate actions at each update, steering improvement toward higher-value regions beyond local gradient steps. Learning, value estimation, and policy change share one consistent objective while keeping off-policy training scalable. On MuJoCo benchmarks, SAVGO beats strong baselines on hard high-dimensional tasks, and ablations isolate each part's contribution.

Catalog record

CREATORStavros Orfanoudakis, Pedro P. Vergara
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.00787

Browse the full library · About the Tower of Babel