Collaborative On-Sensor Array Cameras 986 Journal: TOG Volume: 44 4 8 DOI: 10.1145/3731200 CCS: Computing methodologies Computational photography; Massively parallel algorithms

Jipeng Sun, Kaixuan Wei, Thomas Eboli, Congli Wang, Cheng Zheng, Zhihao Zhou, Arka Majumdar, Wolfgang Heidrich, Felix Heide · 2025

Read Collaborative On-Sensor Array Cameras 986 Journal: TOG Volume: 44 4 8 DOI: 10.1145/3731200 CCS: Computing methodologies Computational photography; Massively parallel algorithms by Jipeng Sun, Kaixuan Wei, Thomas Eboli, Congli Wang, Cheng Zheng, Zhihao Zhou, Arka Majumdar, Wolfgang Heidrich, Felix Heide (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04061.txt.

Description

Jipeng Sun and co-authors design, in a 2025 paper, a flat camera whose lens is an array of a hundred million tiny posts etched on a surface. Such metasurface optics promise to replace bulky glass, but single designs struggle with full-color imaging and can lean on generative fixes that invent detail. The team instead trains many metasurface elements together, so the array shares the imaging work across the whole visible spectrum.

Learning at that scale broke older design tools, so the authors built a distributed learning method that can handle the huge parameter count. A learned stand-in for the tiny atoms and a reconstruction step that respects depth and noise complete the system. In simulations and bench tests, the camera matched up favorably against standard optics. The work points to thin, jointly trained cameras for phones and sensors.

Catalog record

CREATORJipeng Sun, Kaixuan Wei, Thomas Eboli, Congli Wang, Cheng Zheng, Zhihao Zhou, Arka Majumdar, Wolfgang Heidrich, Felix Heide
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-04061

Browse the full library · About the Tower of Babel