LLM-Explorer: A Plug-in Reinforcement Learning Policy Exploration Enhancement Driven by Large Language Models

Qianyue Hao, Yiwen Song, Qingmin Liao, Jian Yuan, Yong Li · 2025

Read LLM-Explorer: A Plug-in Reinforcement Learning Policy Exploration Enhancement Driven by Large Language Models by Qianyue Hao, Yiwen Song, Qingmin Liao, Jian Yuan, Yong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15293.txt.

Description

Qianyue Hao and co-authors let a large language model steer how a learning agent explores. In reinforcement learning, exploration decides which actions an agent tries while it learns. Classic tricks use fixed random patterns that ignore the task and barely adapt as skill grows.

Their plug-in, LLM-Explorer, samples the agent's recent learning path and asks the model to judge its state. The model then writes a fresh chance spread for future moves, tuned to that task alone. Updates recur through training, so the search pattern bends with progress. The module fits many standard algorithms, from DQN lines to actor-critic builds. Trials on Atari games and MuJoCo control tasks show stronger learning across the board, with the same base agents.

Catalog record

CREATORQianyue Hao, Yiwen Song, Qingmin Liao, Jian Yuan, Yong Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE106 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-15293

Browse the full library · About the Tower of Babel