Forge: Quality-Aware Reinforcement Learning for NP-Hard Optimization in LLMs

Xiaozhe Li, Xinyu Fang, Shengyuan Ding, Yang Li, Linyang Li, Haodong Duan, Qingwen Liu, Kai Chen, Tongji University, Shanghai AI Lab, Zhejiang University, Fudan University, The Chinese University of Hong Kong, Independent · 2026

Read Forge: Quality-Aware Reinforcement Learning for NP-Hard Optimization in LLMs by Xiaozhe Li, Xinyu Fang, Shengyuan Ding, Yang Li, Linyang Li, Haodong Duan, Qingwen Liu, Kai Chen, Tongji University, Shanghai AI Lab, Zhejiang University, Fudan University, The Chinese University of Hong Kong, Independent (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08905.txt.

Description

Xiaozhe Li and seven coauthors train models not just to solve hard tune tasks, but to solve them well. Plain reward grades check right or wrong. They skip how good a fix is under its rules. Their OPT-Bench set packs task makers and quality checks for ten NP-hard tasks. It adds best known base lines. Its test set holds one thousand cases, scored for both work and worth. Rewards grade worth in a smooth way.

A mid size open model, trained on a set of cases, beats a top paid model by a wide gap. It wins on both work rate and worth. The skills cross to math, logic, facts, and task craft.

Catalog record

CREATORXiaozhe Li, Xinyu Fang, Shengyuan Ding, Yang Li, Linyang Li, Haodong Duan, Qingwen Liu, Kai Chen, Tongji University, Shanghai AI Lab, Zhejiang University, Fudan University, The Chinese University of Hong Kong, Independent
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08905

Browse the full library · About the Tower of Babel