SimVS: Simulating World Inconsistencies for Robust View Synthesis

Alex Trevithick, Roni Paiss, Philipp Henzler, Dor Verbin, Rundi Wu, Hadi Alzayer, Ruiqi Gao, Ben Poole, Jonathan T. Barron, Aleksander Holynski, Ravi Ramamoorthi, Pratul P. Srinivasan · 2024

Read SimVS: Simulating World Inconsistencies for Robust View Synthesis by Alex Trevithick, Roni Paiss, Philipp Henzler, Dor Verbin, Rundi Wu, Hadi Alzayer, Ruiqi Gao, Ben Poole, Jonathan T. Barron, Aleksander Holynski, Ravi Ramamoorthi, Pratul P. Srinivasan (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07696.txt.

Description

Alex Trevithick and a large team of co-authors make view synthesis tougher by faking the flaws of real photo sets. View synthesis builds a 3D scene from photos so new angles can be rendered. Models are often tested on clean, consistent sets that real users never supply. Their 2024 system, SimVS, takes a good scene and simulates world inconsistencies: moved objects, changed light, and other breaks between views. Models must then render views that stay believable despite the mess.

Training and testing against such flaws should yield tools that cope with casual photo collections. The authors argue robustness, not peak scores on perfect data, is the bar that matters for real use. Their simulator gives the field a shared way to measure that robustness. The work targets the gap between lab demos and phone photos.

Catalog record

CREATORAlex Trevithick, Roni Paiss, Philipp Henzler, Dor Verbin, Rundi Wu, Hadi Alzayer, Ruiqi Gao, Ben Poole, Jonathan T. Barron, Aleksander Holynski, Ravi Ramamoorthi, Pratul P. Srinivasan
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-07696

Browse the full library · About the Tower of Babel