A Turing Test for Artificial Nets devoted to model Human Vision

Jorge Vila-Tomás, Pablo Hernandez-Cámara, Qiang Li, Valero Laparra, Jesús Malo · 2025

Read A Turing Test for Artificial Nets devoted to model Human Vision by Jorge Vila-Tomás, Pablo Hernandez-Cámara, Qiang Li, Valero Laparra, Jesús Malo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-00721.txt.

Introduction

Jorge Vila-Tomás and four co-authors propose a Turing test for artificial nets that model human vision in two thousand twenty-five. Claims for nets as brain models run ahead of proof, they argue. Open snags span where to read outputs and how to test them. A low level data set of retina to cortex facts is their fix.

Three models with like builds face ten psycho and physio facts. A parametric model tuned by maximum differentiation hugs human acts closest. Its receptive fields and nonlinear color acts lead the pack. Two rivals tuned for opinion and segmentation trail on those facts.

Catalog record

CREATORJorge Vila-Tomás, Pablo Hernandez-Cámara, Qiang Li, Valero Laparra, Jesús Malo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-00721

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Turing Test for Artificial Nets devoted to model Human Vision Jorge Vila-Tomás, Pablo Hernandez-Cámara, Qiang Li, Valero Laparra, Jesús Malo Abstract In this 2022 work 1 1 1 Concept and results first presented at the AI Evaluation Workshop at the University of Bristol, june 2022. 2 2 2 Original presentation: http://isp.uv.es/docs/talk_AI_Bristol_Malo_et_al_2022.pdf we argued that, despite recent claims about successful modeling of the visual brain using artificial nets, the problem is far from being solved (even for low-level vision). First we introduce open issues such as where should we read from in ANNs in order to reproduce human behavior? , what should be the read-out mechanism? , this ad-hoc read-out is considered part of the brain model or not? , in order to understand the behavior of ANNs, should we use artificial psychophysics or artificial physiology? , in the case of ANNs, artificial experiments should literally match the experiments done with humans? . This means that there is a clear need of rigorous procedures for experimental tests for ANNs devoted to model the visual brain, and more generally, to understand ANNs devoted to generic vision tasks. Following our experience in using low-level facts from Quantitative Visual Neuroscience in image processing and computer vision, in this work we presented the idea of developing a low-level dataset compiling the basic spatio-temporal and chromatic facts that are known to happen in the retina-V1 pathway, and they are not currently available in existing databases such as BrainScore. In our illustrative results we checked the behavior of three recently proposed models with similar architecture: (1) A parametric model tuned via the psychophysical method of Maximum Differentiation [Malo & Simoncelli SPIE 15, Martinez et al. PLOS 18, Martinez et al. Front. Neurosci. 19], (2) A non-parametric model called PerceptNet tuned to maximize the correlation with human opinion about subjective distance between images [Hepburn et al. IEEE ICIP 19], and (3) A model with the same encoder as PerceptNet, but tuned for image segmentation (later published as Hernandez-Camara et al. Patt.Recogn.Lett. 23). Results on 10 compelling psycho/physio visual facts show that the first model (the parametric one) is the one with closer behavior to the human observers in terms of receptive fields (obviously because they were parametrically imposed), but more interestingly, on the nonlinear behavior when facing complex spatio-chromatic patterns of a range of luminances and contrasts. 1 Introduction 1.1 Deep Neural Networks are the Best Models of the Human Visual System Deep neural networks (DNNs) currently offer some of the most advanced models for understanding visual information processing in the primate brain [Jacob et al. Nat. Commun. 21, Nikolaus. Annu. Rev. Vis. Sci. 15, Li et al. J. Vis. 22]. Recent research has highlighted the potential for deep learning to inform and refine our theories of brain function, with many findings suggesting that the principles behind DNNs are closely aligned with the way the brain processes visual information [Richards et al. Nat. Neurosci. 19]. The functional similarities and differences between DNNs and the visual brain have been widely explored, making this a dynamic and rapidly growing area of research within both neuroscience and computer vision. 1.2 Using DNNs to Understand the Visual Brain May Not Be That Easy DNN, while powerful, are often poorly explainable, presenting challenges when applying them to understanding the visual brain. Issues such as denoising, which functions similarly to the Lateral Geniculate Nucleus (LGN), and compression, which mimics the information preprocessing from the LGN to the visual cortex. But tasks like segmentation (which are difficult to explain from a visual science perspective), classification (which are also challenging to interpret), and other networks further complicate the process. Is there a unified deep network that can explain all visual functions? These complexities make it difficult to directly map neural network operations onto brain functions in a meaningful way. Another important consideration is whether to focus on reproducing artificial physiology or artificial psychophysics. This distinction involves balancing a literal reproduction of brain processes with an idealized, abstract model of human behavior. For example, should we focus on mimicking response summation and read-out in a way that aligns with human vision, or should we prioritize matching the results of psychophysical experiments? These questions reflect a broader challenge of matching DNN models to human behavior in a way that is both faithful and effective, going beyond the scope of high-level metrics like BrainScore (https://www.brain-score.org/) . Furthermore, when applying DNNs to model the visual brain, one key challenge is determining where to read features from within the network and which layers to focus on for encoding or decoding information. Should we use just one feature, or should we consider all features across different layers? This decision is akin to the physiology-psychophysics problem, These questions ultimately highlight the significant issues related to model plausibility. Understanding how closely DNN models can replicate the complexity of human vision requires addressing many nontrivial challenges. To evaluate whether our models are truly capturing human-like visual processing, we might need to consider a more sophisticated "Turing Test" for visual models, ensuring that the behavior of the artificial networks aligns not just with low-level brain activity but also with high-level cognitive functions. 1.3 Our Proposal: An Easy-To-Use Turing-Test from Vision Science To test the capabilities of DNNs in mimicking human visual functions, we propose an approach inspired by key findings from vision science. By digesting the literature and selecting compelling facts related to stimuli and their corresponding responses, we aim to evaluate how well DNNs align with known physiological and psychophysical principles. In our proposal, we suggest two approaches for testing DNNs: one linear and one nonlinear, as shown in the table 3 3 3 The graphical quality of tables, figures and diagrams in this preprint will be updated in the journal version. in Fig. 1 . For color processing, we first test DNNs from a linear perspective, focusing on spectral sensitivities, and then from a nonlinear perspective to examine adaptation, nonlinear responses, and color illusions. Similarly, for texture processing, we begin by testing the linear aspects, such as receptive fields and contrast sensitivities, and then explore nonlinear responses, including masking effects and contrast illusions 4 4 4 The 2024 code for stimuli generation is here: http://isp.uv.es/docs/TheDecalogueCode2024.zip . This dual approach provides a comprehensive framework for evaluating how DNNs replicate the complexity of visual processing observed in the human brain. Figure 1: Turing-test checklist. This table presents a checklist of tests for evaluating DNNs, examining both linear and nonlinear methods to assess how well they mimic human visual processing. 2 Methods Three biological neural networks are evaluated here: BioMultiLayer [Martinez et al. PLOS 18], Perceptnet [Hepburn et al. IEEE ICIP 19], and Bio U-Net [Hernandez et al. Patt. Recogn. lett. 23] models. BioMultiLayer: A cascade of isomorphic L+NL modules based on canonical Divisive Normalization [Carandini et al. Nat. Rev. Neurosci. 11]. Which optimzied for modeling human low-level visual pathway. The model processes the spatial distribution of spectral irradiance at the retina. It consists of several layers that combine linear and nonlinear transformations to simulate human visual processing. In the first layer, the input is processed by three LMS spectral sensitivities and a linear recombination, producing three tristimulus values representing luminance and opponent chromatic channels. These

Read the complete text