ESSAM: A Novel Competitive Evolution Strategies Approach to Reinforcement Learning for Memory Efficient LLMs Fine-Tuning
Zhishen Sun, Sizhe Dang, Guang Dai, Haishan Ye · 2026
Read ESSAM: A Novel Competitive Evolution Strategies Approach to Reinforcement Learning for Memory Efficient LLMs Fine-Tuning by Zhishen Sun, Sizhe Dang, Guang Dai, Haishan Ye (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01003.txt.
Description
Zhishen Sun and co-authors build ESSAM, a way to tune big language models that pairs evolution search with sharpness-aware steps. Tuning by reward methods eats a lot of GPU memory, which bars use on small rigs, so their method searches in weight space with no reward model at all. On a grade-school math test, its mean score matched the top reward methods across the models tried. A faster twin of the method nearly halved run time at the same low memory use, while still beating PPO.
Catalog record
| CREATOR | Zhishen Sun, Sizhe Dang, Guang Dai, Haishan Ye |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60397 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01003