Towards Foundation Models for Relational Databases with Language Models and Graph Neural Networks
Jingcheng Wu, Ratan Bahadur Thapa, Mojtaba Nayyeri, Lucas Etteldorf, Max Finkenbeiner, Fabian Leeske, Steffen Staab · 2026
Read Towards Foundation Models for Relational Databases with Language Models and Graph Neural Networks by Jingcheng Wu, Ratan Bahadur Thapa, Mojtaba Nayyeri, Lucas Etteldorf, Max Finkenbeiner, Fabian Leeske, Steffen Staab (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16085.txt.
Description
Wu and six colleagues move toward foundation models for relational databases, which hold much of the world's structured information. Standard deep learning flattens tables by hand and drops relational context. Their hybrid pairs a fine-tuned BART encoder for row meaning with a GraphSAGE graph network for relational context. On RelBench it scored 67.40 ROC-AUC on one task, close to supervised baselines yet still well behind the best foundation model at 82.63.
Catalog record
| CREATOR | Jingcheng Wu, Ratan Bahadur Thapa, Mojtaba Nayyeri, Lucas Etteldorf, Max Finkenbeiner, Fabian Leeske, Steffen Staab |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38658 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16085