Scaling Transformer-Based Novel View Synthesis Models with Token Disentanglement and Synthetic Data

Nithin Gopalakrishnan Nair, Srinivas Kaza, Xuan Luo, Vishal M. Patel, Stephen Lombardi, Jungyeon Park · 2025

Read Scaling Transformer-Based Novel View Synthesis Models with Token Disentanglement and Synthetic Data by Nithin Gopalakrishnan Nair, Srinivas Kaza, Xuan Luo, Vishal M. Patel, Stephen Lombardi, Jungyeon Park (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06950.txt.

Description

Imagining a scene from new viewpoints, with help from synthetic training data, is scaled up by Nithin Gopalakrishnan Nair and five co-authors in a 2025 computer vision paper. Transformer models can synthesize novel views from a few input images without per-scene tuning. Public scene datasets lack diversity, though, so real-world scenes often fall outside what the models know.

Training data generated by diffusion models adds variety and scale, but its artifacts become the new bottleneck for reconstruction quality. The authors add a token disentanglement process inside the transformer, separating features more cleanly so learning uses the synthetic data better. The refined model beat existing systems on both in-dataset and cross-dataset tests, reaching state-of-the-art results on several benchmarks while cutting computing costs significantly. Synthetic data plus cleaner internal features is the recipe offered.

Catalog record

CREATORNithin Gopalakrishnan Nair, Srinivas Kaza, Xuan Luo, Vishal M. Patel, Stephen Lombardi, Jungyeon Park
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-06950

Browse the full library · About the Tower of Babel