Markov Decision Processes of the Third Kind: Learning Distributions by Policy Gradient Descent ∗ Corresponding author
Nicole Bäuerle, Athanasios Vasileiadis ∗ · 2026
Read Markov Decision Processes of the Third Kind: Learning Distributions by Policy Gradient Descent ∗ Corresponding author by Nicole Bäuerle, Athanasios Vasileiadis ∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06567.txt.
Description
Most reward learning chases the best average reward, but some problems ask for a whole spread of outcomes instead. Nicole Bäuerle and Athanasios Vasileiadis study distributional Markov decision processes, where the goal is to steer the law of total reward toward a chosen target pattern. The setting covers cases where matching a shape matters more than raising a mean.
Their solution is a policy-gradient method over random rules, defined on a larger state space and scored by a loss estimated from samples. Under mild smoothness and growth conditions, they prove settling to steady points using random methods. Tests matched complex target patterns, recovered standard best rules where they exist, and exposed many-answers effects intrinsic to distributional control.
Catalog record
| CREATOR | Nicole Bäuerle, Athanasios Vasileiadis ∗ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 96 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-06567