Posterior Sampling Reinforcement Learning with Gaussian Processes for Continuous Control: Sublinear Regret Bounds for Unbounded State Spaces

Hamish Flynn, Joe Watson, Ingmar Posner, Jan Peters · 2026

Read Posterior Sampling Reinforcement Learning with Gaussian Processes for Continuous Control: Sublinear Regret Bounds for Unbounded State Spaces by Hamish Flynn, Joe Watson, Ingmar Posner, Jan Peters (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08287.txt.

Description

Flynn and colleagues analyze the Bayesian regret of Gaussian process posterior sampling reinforcement learning for continuous control. Posterior sampling is a heuristic for decisions under uncertainty that has powered successful algorithms for many continuous control problems, yet theory on GP-PSRL is limited. Known regret bounds either grow sub-optimally, demand strong smoothness assumptions, or ignore unbounded state sets. Through a recursive application of a Gaussian concentration inequality, the authors show visited states stay within a near-constant-radius ball, then use chaining to control regret under weak smoothness.

Catalog record

CREATORHamish Flynn, Joe Watson, Ingmar Posner, Jan Peters
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE139900
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08287

Browse the full library · About the Tower of Babel