PluRel : Synthetic Data unlocks Scaling Laws for Relational Foundation Models
Vignesh Kothapalli, Rishabh Ranjan, Valter Hudovernik, Vijay Prakash Dwivedi, Johannes Hoffart, Carlos Guestrin, Jure Leskovec · 2026
Read PluRel : Synthetic Data unlocks Scaling Laws for Relational Foundation Models by Vignesh Kothapalli, Rishabh Ranjan, Valter Hudovernik, Vijay Prakash Dwivedi, Johannes Hoffart, Carlos Guestrin, Jure Leskovec (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04029.txt.
Description
Foundation models for databases starve for diverse training data, since real databases stay private. Vignesh Kothapalli and 6 co-authors generate synthetic relational databases from scratch with their PluRel framework in a 2026 paper. Schemas, key links between tables, and value distributions are modeled in three stages.
Pretraining on PluRel data revealed power-law scaling: loss fell predictably as synthetic databases and tokens grew. That is the first such scaling evidence for relational foundation models. Because synthetic data carries no privacy risk, labs can finally study how these models scale and design training mixes rationally.
Catalog record
| CREATOR | Vignesh Kothapalli, Rishabh Ranjan, Valter Hudovernik, Vijay Prakash Dwivedi, Johannes Hoffart, Carlos Guestrin, Jure Leskovec |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04029