SimVS: Simulating World Inconsistencies for Robust View Synthesis
Alex Trevithick, Roni Paiss, Philipp Henzler, Dor Verbin, Rundi Wu, Hadi Alzayer, Ruiqi Gao, Ben Poole, Jonathan T. Barron, Aleksander Holynski, Ravi Ramamoorthi, Pratul P. Srinivasan · 2024
Read SimVS: Simulating World Inconsistencies for Robust View Synthesis by Alex Trevithick, Roni Paiss, Philipp Henzler, Dor Verbin, Rundi Wu, Hadi Alzayer, Ruiqi Gao, Ben Poole, Jonathan T. Barron, Aleksander Holynski, Ravi Ramamoorthi, Pratul P. Srinivasan (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07696.txt.
Description
Alex Trevithick and a large team of co-authors make view synthesis tougher by faking the flaws of real photo sets. View synthesis builds a 3D scene from photos so new angles can be rendered. Models are often tested on clean, consistent sets that real users never supply. Their 2024 system, SimVS, takes a good scene and simulates world inconsistencies: moved objects, changed light, and other breaks between views. Models must then render views that stay believable despite the mess.
Training and testing against such flaws should yield tools that cope with casual photo collections. The authors argue robustness, not peak scores on perfect data, is the bar that matters for real use. Their simulator gives the field a shared way to measure that robustness. The work targets the gap between lab demos and phone photos.
Catalog record
| CREATOR | Alex Trevithick, Roni Paiss, Philipp Henzler, Dor Verbin, Rundi Wu, Hadi Alzayer, Ruiqi Gao, Ben Poole, Jonathan T. Barron, Aleksander Holynski, Ravi Ramamoorthi, Pratul P. Srinivasan |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-07696