LLM-Explorer: A Plug-in Reinforcement Learning Policy Exploration Enhancement Driven by Large Language Models
Qianyue Hao, Yiwen Song, Qingmin Liao, Jian Yuan, Yong Li · 2025
Read LLM-Explorer: A Plug-in Reinforcement Learning Policy Exploration Enhancement Driven by Large Language Models by Qianyue Hao, Yiwen Song, Qingmin Liao, Jian Yuan, Yong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15293.txt.
Description
Qianyue Hao and co-authors let a large language model steer how a learning agent explores. In reinforcement learning, exploration decides which actions an agent tries while it learns. Classic tricks use fixed random patterns that ignore the task and barely adapt as skill grows.
Their plug-in, LLM-Explorer, samples the agent's recent learning path and asks the model to judge its state. The model then writes a fresh chance spread for future moves, tuned to that task alone. Updates recur through training, so the search pattern bends with progress. The module fits many standard algorithms, from DQN lines to actor-critic builds. Trials on Atari games and MuJoCo control tasks show stronger learning across the board, with the same base agents.
Catalog record
| CREATOR | Qianyue Hao, Yiwen Song, Qingmin Liao, Jian Yuan, Yong Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-15293