MTVNet: Mapping using Transformers for Volumes – Network for Super-Resolution with Long-Range Interactions

August Leander Høeg, Sophia W. Bardenfleth, Hans Martin Kjer, Tim B. Dyrby, Second Author · 2024

Read MTVNet: Mapping using Transformers for Volumes – Network for Super-Resolution with Long-Range Interactions by August Leander Høeg, Sophia W. Bardenfleth, Hans Martin Kjer, Tim B. Dyrby, Second Author (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03379.txt.

Description

August Leander Høeg and co-authors present, in a 2024 paper, a neural network that sharpens 3D scans. Super-resolution in volumes has lagged behind photo work because the attention trick behind transformer models eats memory in three dimensions. That cap shrinks the area each part of the model can see, so long-range links go unused. Their model, MTVNet, works from coarse to fine scales to widen that view.

Special carrier tokens ferry facts from broad, coarse regions down to finer ones, step by step. Transformer layers run at each scale, but the token count stays modest, so attention can span large areas at last. On five 3D data sets, MTVNet beat the top rival models. The edge grew on larger images, where a wide view matters most. Code is public.

Catalog record

CREATORAugust Leander Høeg, Sophia W. Bardenfleth, Hans Martin Kjer, Tim B. Dyrby, Second Author
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-03379

Browse the full library · About the Tower of Babel