Posterior Sampling Reinforcement Learning with Gaussian Processes for Continuous Control: Sublinear Regret Bounds for Unbounded State Spaces
Hamish Flynn, Joe Watson, Ingmar Posner, Jan Peters · 2026
Read Posterior Sampling Reinforcement Learning with Gaussian Processes for Continuous Control: Sublinear Regret Bounds for Unbounded State Spaces by Hamish Flynn, Joe Watson, Ingmar Posner, Jan Peters (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08287.txt.
Description
Flynn and colleagues analyze the Bayesian regret of Gaussian process posterior sampling reinforcement learning for continuous control. Posterior sampling is a heuristic for decisions under uncertainty that has powered successful algorithms for many continuous control problems, yet theory on GP-PSRL is limited. Known regret bounds either grow sub-optimally, demand strong smoothness assumptions, or ignore unbounded state sets. Through a recursive application of a Gaussian concentration inequality, the authors show visited states stay within a near-constant-radius ball, then use chaining to control regret under weak smoothness.
Catalog record
| CREATOR | Hamish Flynn, Joe Watson, Ingmar Posner, Jan Peters |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 139900 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.08287