Self-Improving Tabular Language Models via Iterative Group Alignment

Yunbo Long, Tejumade Afonja, Alexandra Brintrup, Mario Fritz · 2026

Read Self-Improving Tabular Language Models via Iterative Group Alignment by Yunbo Long, Tejumade Afonja, Alexandra Brintrup, Mario Fritz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18966.txt.

Introduction

Long and four colleagues study reward guided post training for tabular language models. Such models train once and serve as synthesizers, while likelihood misses the qualities used to judge synthetic data. Their generate score align protocol samples rows, ranks them by task reward, and updates the model against a reference. They propose TabGRAA, comparing high and low reward groups with averaged ratios instead of pairwise preferences. Across five benchmarks, TabGRAA beats supervised tuning and tops DPO, KTO, and NPO baselines on fidelity and utility, with privacy near baseline.

Catalog record

CREATORYunbo Long, Tejumade Afonja, Alexandra Brintrup, Mario Fritz
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE136668
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18966

Browse the full library · About the Tower of Babel