Differentially Private Policy Gradient

Alexandre Rio, Merwan Barlier, Igor Colin · 2025

Read Differentially Private Policy Gradient by Alexandre Rio, Merwan Barlier, Igor Colin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-19080.txt.

Description

Reinforcement learning agents learn by trial and error, often on data about real people, so their training can leak private facts. Alexandre Rio, Merwan Barlier, and Igor Colin build a policy gradient method that carries a formal privacy promise. Their key move reframes the privacy noise as a question of trust regions, the limits on how far each update may move the policy.

Balancing noise against region size yields an agent that stays both private and capable, without giving up the theory behind the non-private method. On standard benchmarks the results improve clearly on earlier private algorithms for online learning, a step toward deploying learning agents where data is sensitive.

Catalog record

CREATORAlexandre Rio, Merwan Barlier, Igor Colin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-19080

Browse the full library · About the Tower of Babel