Machine Psychophysics: Cognitive Control in Vision-Language Models
Dezhi Luo, Maijunxian Wang, Bingyang Wang, Tianwei Zhao, Yijiang Li, Hokin Deng, All authors are affiliated with the GrowAI Team., [email protected], [email protected] · 2025
Read Machine Psychophysics: Cognitive Control in Vision-Language Models by Dezhi Luo, Maijunxian Wang, Bingyang Wang, Tianwei Zhao, Yijiang Li, Hokin Deng, All authors are affiliated with the GrowAI Team., [email protected], [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18969.txt.
Introduction
Bingyang Wang and co-authors test whether vision-language models show cognitive control in a 2025 study. Cognitive control is the mind's ability to resolve clashes between competing signals in pursuit of a goal. The head of the paper frames its finding plainly: more computation helps these models resolve such conflicts.
The team built 4,410 tasks across seven clash tests, from the classic Stroop test to realistic variants, and ran 47 models. All showed the human-like congruency effect, doing worse when signals clashed. Larger models resolved clashes better, yet on the hardest trials they could drop below chance. The work gives AI research a human-style yardstick for flexible thinking.
Catalog record
| CREATOR | Dezhi Luo, Maijunxian Wang, Bingyang Wang, Tianwei Zhao, Yijiang Li, Hokin Deng, All authors are affiliated with the GrowAI Team., [email protected], [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18969
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Machine Psychophysics: Cognitive Control in Vision-Language Models Dezhi Luo, Maijunxian Wang, Bingyang Wang, Tianwei Zhao, Yijiang Li, Hokin Deng, All authors are affiliated with the GrowAI Team., [email protected], [email protected] Abstract Cognitive control refers to the ability to flexibly coordinate thought and action in pursuit of internal goals. A standard method for assessing cognitive control involves conflict tasks that contrast congruent and incongruent trials, measuring the ability to prioritize relevant information while suppressing interference. We evaluate 108 vision-language models on three classic conflict tasks and their more demanding "squared" variants across 2,220 trials. Model performance corresponds closely to human behavior under resource constraints and reveals individual differences. These results indicate that some form of human-like executive function have emerged in current multi-modal foundational models. 1 Introduction Human behavior is distinguished by its flexibility and goal-directedness: we can pursue novel, underspecified tasks, adapt to changing contexts, and manage competing objectives over time [ 1 , 2 ] . At the core of these abilities lies cognitive control, a set of mechanisms that support the dynamic coordination of thought and action in service of internal goals [ 3 , 4 ] , making it a particularly valuable target for evaluating signatures and guiding the development of prospective general intelligence in artificial systems [ 5 , 6 , 7 ] . Vision-language models (VLMs) can integrate visual and textual information and have demonstrated strong performance on high-level reasoning benchmarks. Here, we evaluate 108 models on three classic conflict tasks, along with their more cognitively demanding "squared" versions, in a large-scale, strictly controlled setting spanning 2,220 trials. Model performance corresponds remarkably to human behavior under limited computational resources and reveals robust individual differences. This finding provides substantial support for the possibility that cognitive control can emerge from scaling general-purpose associative learning systems. 2 Related Works 2.1 Human Psychophysics Cognitive control enables the regulation of thought and action in service of internal goals, particularly in situations involving conflict, ambiguity, or distraction [ 8 , 9 ] . Conflict tasks are widely used to probe these mechanisms, with behavioral measures such as reaction time and error rates serving as proxies for internal computational demands [ 10 , 11 ] . Slower responses and increased errors typically reflect the effort required to resolve interference between competing inputs or to update internal representations under changing task conditions [ 12 , 13 ] . Control operates by coordinating the flow of information through a limited-capacity system [ 14 , 15 ] , selecting which sensory cues, contextual signals, and goals are actively maintained in working memory and determining when these representations should be updated or suppressed [ 16 , 17 ] . When overlapping sources of information are not well separated—such as when conflicting features map to different responses—interference arises and performance suffers [ 18 ] . Control mitigates this by modulating representational strength and prioritization [ 19 , 20 ] , allowing goal-relevant information to guide behavior efficiently. Cognitive control thereby serves as a core infrastructure for solving problems under constraints of time, uncertainty, and limited resources [ 21 , 22 , 23 ] . Developing unified frameworks that account for these regulatory processes is a central aim of the cognitive science of intelligence, and an important guide for the design of general-purpose artificial agents [ 24 ] . 2.2 Symbolic and Connectionist Models A longstanding line of research in artificial intelligence has explored how control mechanisms can be embedded within integrated models of cognition. Prior to the rise of large-scale data-driven methods, general intelligence was often approached through symbolic and hybrid systems that explicitly specified internal structures for perception, memory, learning, and action selection—commonly known as cognitive architectures [ 25 , 26 , 27 ] . Within these frameworks, cognitive control plays a central role in coordinating competing demands, prioritizing goals, and guiding adaptive behavior across tasks [ 28 , 24 ] . Across a wide range of implementations, cognitive control consistently emerges as a core functional requirement for general-purpose intelligence [ 29 ] . Architectures such as Soar and ACT-R offer contrasting yet complementary realizations of this faculty: Soar emphasizes hierarchical goal management and recursive subgoaling to resolve impasses [ 30 , 31 ] , while ACT-R employs production rules governed by sub-symbolic utility-based conflict resolution [ 32 , 33 ] . Despite their differences, both reflect a shared commitment to modeling the internal regulation required for flexible, multi-context behavior [ 34 ] . However, these architectures, built on human-designed knowledge and representations, often struggle to scale and generalize compared to those that rely on general-purpose learning and search algorithms leveraging computational resources [ 35 ] . In parallel, modern connectionist approaches in deep learning have pursued similar regulatory functions through distributed and data-driven architectures. While these models have achieved notable successes in perception and pattern recognition, they continue to face limitations in core aspects of cognitive control—particularly in generalizing across tasks, applying learned rules to novel situations, and flexibly adapting to shifting goals and environments [ 6 ] . These limitations closely mirror challenges addressed by the prefrontal cortex (PFC), which plays a central role in rule-based behavior, abstract reasoning, and dynamic coordination [ 36 ] . Neuroscientific evidence implicates the PFC in managing working memory, resolving interference, and exerting top-down modulation over other brain areas—functions that remain underdeveloped in current AI systems [ 16 , 21 ] . Efforts to bridge this gap continue to explore architectural principles that integrate connectionist learning with mechanisms of cognitive control, offering promising directions for developing more generalizable artificial agents. Recent theoretical frameworks have proposed that the computational processes underlying human cognitive control may be grounded in associative learning [ 19 ] . However, this perspective still awaits empirical support, particularly from large-scale, general-purpose neural networks that are subjected to scaling. 2.3 Vision-language Models There has been no prior attempt to directly evaluate the cognitive control capacities of vision-language models (VLMs). However, these models have demonstrated near-human performance across a wide range of complex tasks involving perception and reasoning [ 37 , 38 , 39 , 40 , 41 ] , including spatial reasoning [ 42 , 43 ] , Optical Character Recognition (OCR) [ 44 ] , and scene understanding [ 45 ] —all of which serve as functional precursors to tasks requiring flexible cognitive control. And their unprecedented success has been fundamentally driven by large-scale pretraining on web-scale multimodal data and advances in cross-modal alignment [ 37 , 46 , 40 , 47 , 48 , 49 ] , enabled by high-capacity neural architectures optimized through general-purpose learning objectives. Given these capabilities, it is fair to say that VLMs have emerged as the most promising class of artificial systems for probing the emergence of cognitive control from a scalable paradigm of intelligence. In this paper, we aim to bridge this gap. Figure 1: Standard Tasks . In the Stroop task, models were asked to indicate the color a word is printed in while disregarding the word’s meaning. In the Flanker tasks, models were asked to identify either the central letter or number while ignoring the surrounding distractors ("flankers"). Figure 2: Squared Tasks . In Stroop Squared, models were asked to select the response option whose word meaning