QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videos

Sharath GirishUniversity of Maryland [email protected], Tianye LiNVIDIA [email protected], Amrita MazumdarNVIDIA [email protected] Abhinav ShrivastavaUniversity of Maryland [email protected] David LuebkeNVIDIA [email protected] Shalini De MelloNVIDIA [email protected] · 2024

Read QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videos by Sharath GirishUniversity of Maryland [email protected], Tianye LiNVIDIA [email protected], Amrita MazumdarNVIDIA [email protected] Abhinav ShrivastavaUniversity of Maryland [email protected] David LuebkeNVIDIA [email protected] Shalini De MelloNVIDIA [email protected] (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-04469.txt.

Description

Sharath Girish and co-authors present QUEEN, a method for streaming free viewpoint video in a 2024 paper. Such video lets a viewer move around a live scene, so the scene model must update frame by frame, train and render fast, and stay small to send. Their method builds the scene from many small three dimensional blobs, a known approach.

QUEEN learns only the change in blob traits between frames, with no fixed rules on that change, which keeps quality high. A learned coding step squeezes most changes for storage, and a gate step thins out shifts in blob place. A gradient signal helps split still parts from moving parts, which speeds learning.

Catalog record

CREATORSharath GirishUniversity of Maryland [email protected], Tianye LiNVIDIA [email protected], Amrita MazumdarNVIDIA [email protected] Abhinav ShrivastavaUniversity of Maryland [email protected] David LuebkeNVIDIA [email protected] Shalini De MelloNVIDIA [email protected]
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-04469

Browse the full library · About the Tower of Babel