MTVNet: Mapping using Transformers for Volumes – Network for Super-Resolution with Long-Range Interactions
August Leander Høeg, Sophia W. Bardenfleth, Hans Martin Kjer, Tim B. Dyrby, Second Author · 2024
Read MTVNet: Mapping using Transformers for Volumes – Network for Super-Resolution with Long-Range Interactions by August Leander Høeg, Sophia W. Bardenfleth, Hans Martin Kjer, Tim B. Dyrby, Second Author (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03379.txt.
Description
August Leander Høeg and co-authors present, in a 2024 paper, a neural network that sharpens 3D scans. Super-resolution in volumes has lagged behind photo work because the attention trick behind transformer models eats memory in three dimensions. That cap shrinks the area each part of the model can see, so long-range links go unused. Their model, MTVNet, works from coarse to fine scales to widen that view.
Special carrier tokens ferry facts from broad, coarse regions down to finer ones, step by step. Transformer layers run at each scale, but the token count stays modest, so attention can span large areas at last. On five 3D data sets, MTVNet beat the top rival models. The edge grew on larger images, where a wide view matters most. Code is public.
Catalog record
| CREATOR | August Leander Høeg, Sophia W. Bardenfleth, Hans Martin Kjer, Tim B. Dyrby, Second Author |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-03379