Towards Foundation Models for Relational Databases with Language Models and Graph Neural Networks

Jingcheng Wu, Ratan Bahadur Thapa, Mojtaba Nayyeri, Lucas Etteldorf, Max Finkenbeiner, Fabian Leeske, Steffen Staab · 2026

Read Towards Foundation Models for Relational Databases with Language Models and Graph Neural Networks by Jingcheng Wu, Ratan Bahadur Thapa, Mojtaba Nayyeri, Lucas Etteldorf, Max Finkenbeiner, Fabian Leeske, Steffen Staab (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16085.txt.

Description

Wu and six colleagues move toward foundation models for relational databases, which hold much of the world's structured information. Standard deep learning flattens tables by hand and drops relational context. Their hybrid pairs a fine-tuned BART encoder for row meaning with a GraphSAGE graph network for relational context. On RelBench it scored 67.40 ROC-AUC on one task, close to supervised baselines yet still well behind the best foundation model at 82.63.

Catalog record

CREATORJingcheng Wu, Ratan Bahadur Thapa, Mojtaba Nayyeri, Lucas Etteldorf, Max Finkenbeiner, Fabian Leeske, Steffen Staab
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38658
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16085

Browse the full library · About the Tower of Babel