Self-Improving Tabular Language Models via Iterative Group Alignment
Yunbo Long, Tejumade Afonja, Alexandra Brintrup, Mario Fritz · 2026
Read Self-Improving Tabular Language Models via Iterative Group Alignment by Yunbo Long, Tejumade Afonja, Alexandra Brintrup, Mario Fritz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18966.txt.
Introduction
Long and four colleagues study reward guided post training for tabular language models. Such models train once and serve as synthesizers, while likelihood misses the qualities used to judge synthetic data. Their generate score align protocol samples rows, ranks them by task reward, and updates the model against a reference. They propose TabGRAA, comparing high and low reward groups with averaged ratios instead of pairwise preferences. Across five benchmarks, TabGRAA beats supervised tuning and tops DPO, KTO, and NPO baselines on fidelity and utility, with privacy near baseline.
Catalog record
| CREATOR | Yunbo Long, Tejumade Afonja, Alexandra Brintrup, Mario Fritz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 136668 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18966