ESSAM: A Novel Competitive Evolution Strategies Approach to Reinforcement Learning for Memory Efficient LLMs Fine-Tuning

Zhishen Sun, Sizhe Dang, Guang Dai, Haishan Ye · 2026

Read ESSAM: A Novel Competitive Evolution Strategies Approach to Reinforcement Learning for Memory Efficient LLMs Fine-Tuning by Zhishen Sun, Sizhe Dang, Guang Dai, Haishan Ye (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01003.txt.

Description

Zhishen Sun and co-authors build ESSAM, a way to tune big language models that pairs evolution search with sharpness-aware steps. Tuning by reward methods eats a lot of GPU memory, which bars use on small rigs, so their method searches in weight space with no reward model at all. On a grade-school math test, its mean score matched the top reward methods across the models tried. A faster twin of the method nearly halved run time at the same low memory use, while still beating PPO.

Catalog record

CREATORZhishen Sun, Sizhe Dang, Guang Dai, Haishan Ye
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60397
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01003

Browse the full library · About the Tower of Babel