Human-level 3D shape perception emerges from multi-view learning

Tyler Bonnen, Jitendra Malik, Angjoo Kanazawa · 2026

Read Human-level 3D shape perception emerges from multi-view learning by Tyler Bonnen, Jitendra Malik, Angjoo Kanazawa (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-17650.txt.

Description

Tyler Bonnen and team ask how humans infer three-dimensional shape from flat images, a feat decades of models failed to match. Their modeling frame predicts human shape inferences for arbitrary objects, straight from experimental stimuli. The key is a new class of neural nets trained with a visual-spatial objective over naturalistic sensory data.

Given images from distinct spots in a natural scene, the models learn to predict spatial facts such as camera location and visual depth, with no object-related biases built in. Those signals mirror cues humans already use. In zero-shot tests on a standard shape task, the models match human accuracy with no task-specific training. Model readouts even predict fine-grained human conduct, including error patterns and reaction times.

Catalog record

CREATORTyler Bonnen, Jitendra Malik, Angjoo Kanazawa
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-17650

Browse the full library · About the Tower of Babel