CheeseBench: Evaluating Large Language Models on Rodent Behavioral Neuroscience Paradigms

Zacharie Bugaud · 2026

Read CheeseBench: Evaluating Large Language Models on Rodent Behavioral Neuroscience Paradigms by Zacharie Bugaud (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10825.txt.

Introduction

Bugaud introduces CheeseBench, testing large language models on nine classical rodent behavior paradigms, spanning six cognitive dimensions. Each task follows peer-reviewed rodent protocols, and agents must discover goals from ASCII observations and reward signals, like a rodent in an unfamiliar apparatus. Evaluating six open-weight models from 3B to 72B, the best reaches 52.6 percent average success on ASCII input, against 32.1 percent random and 78.9 percent rodent. Scaling beyond 7B yields diminishing returns, longer context hurts, chain-of-thought hurts, and vision-language helps at 7B but hurts at 32B.

Catalog record

CREATORZacharie Bugaud
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29377
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10825

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CheeseBench: Evaluating Large Language Models on Rodent Behavioral Neuroscience Paradigms Zacharie Bugaud Abstract We introduce CheeseBench , a benchmark that evaluates large language models (LLMs) on nine classical behavioral neuroscience paradigms (Morris water maze, Barnes maze, T-maze, radial arm maze, star maze, operant chamber, shuttle box, conditioned place preference, and delayed non-match to sample), spanning six cognitive dimensions. Each task is grounded in peer-reviewed rodent protocols with approximate animal baselines. The agent receives a unified system prompt with no task-specific instructions and must discover goals purely from ASCII text observations and reward signals, much like a rodent placed into an unfamiliar apparatus. We evaluate six open-weight LLMs (3B to 72B parameters) on text-based ASCII renderings and compare against both a random baseline and a graph-based reinforcement learning agent. Our best model (Qwen2.5-VL-7B) reaches 52.6% average success on ASCII input, compared to 32.1% for random agents and 78.9% for approximate rodent baselines. We find that (1) scaling beyond 7B yields diminishing returns, (2) longer context history degrades performance, (3) chain-of-thought prompting hurts rather than helps, and (4) a vision-language architecture provides an advantage at 7B but hurts at 32B. Because the same model’s performance ranges from 20% to 57% depending on interface parameters alone, these results characterize the agent-plus-interface system, not the model in isolation. Under this unified zero-shot ASCII protocol, current open-weight LLM agents remain well below approximate rodent reference values, particularly on tasks requiring spatial navigation and within-trial state tracking. Submission type: Full Paper † † © 2026 Zacharie Bugaud. Published under a Creative Commons Attribution 4.0 International (CC BY 4.0) license. Introduction Large language models (LLMs) now perform well on question answering, reasoning, and multimodal benchmarks ( 10 ; 7 ) . But these benchmarks primarily test declarative knowledge: recognizing objects, answering factual questions, or following explicit instructions. A different kind of intelligence is procedural learning, i.e., discovering goals through trial and error, building spatial representations, and adapting behavior based on reward feedback. This is what behavioral neuroscience has measured in laboratory animals for over a century. Rodent behavioral paradigms provide standardized, reproducible assays of cognitive function ( 17 ; 14 ) . Tasks like the Morris water maze and radial arm maze probe specific neural circuits: hippocampal place cells for spatial learning ( 13 ) , working memory ( 12 ) , and instrumental conditioning ( 16 ) . These paradigms make natural AI benchmarks because they are (i) mechanistically well-understood, (ii) come with quantitative animal baselines from decades of research, and (iii) test capabilities that current LLM benchmarks largely ignore. We present CheeseBench , a benchmark suite of nine environments spanning six cognitive dimensions ( Table 1 ). Each environment implements a published rodent protocol as a gridworld rendered as ASCII text ( Figure 1 ). Three rendering modes are available (ASCII top-down, egocentric, and pseudo-3D first-person), with ASCII top-down used as the default for all experiments. The agent receives a single unified system prompt identical across all tasks, with no task-specific instructions, hints, or reward shaping. It must discover the goal, form a strategy, and improve over repeated trials, just as a rodent placed in an unfamiliar apparatus would. The primary goal of CheeseBench is to evaluate how well current LLM agent configurations perform on procedural discovery under a unified blind protocol; the rodent data serve as approximate biological reference points rather than strict competitive baselines. Our contributions are: 1. A benchmark suite of 9 behavioral neuroscience paradigms with approximate rodent reference values, covering 6 cognitive dimensions. 2. A systematic evaluation of 6 open-weight LLMs (3B to 72B) on ASCII text input, characterizing the agent-plus-interface system and showing that even the best configuration falls well short of approximate rodent reference values. 3. Ablation studies showing that longer context hurts, chain-of-thought hurts, and the advantage of visual input over ASCII text is scale-dependent. Related Work LLM and VLM Benchmarks. Standard VLM benchmarks such as VQA ( 2 ) , MMLU ( 8 ) , and MathVista ( 11 ) primarily assess declarative reasoning. Interactive benchmarks like ALFWorld ( 15 ) and WebArena ( 20 ) test procedural capabilities but use task-specific instructions and structured feedback. CheeseBench uses a unified blind protocol with only scalar reward feedback. Animal Cognition as AI Benchmark. The Animal-AI Testbed ( 6 ) pioneered evaluating AI on animal cognition tests but focused on 3D physics (Unity engine) without direct rodent protocol fidelity. Concurrent work has proposed bird cognition ( 18 ) and primate tests for LLMs. Our work differs in that each environment maps to a specific published rodent protocol with approximate baselines derived from the peer-reviewed literature. Cognitive Profiling of LLMs. Recent work has adapted human psychological batteries (Theory of Mind, analogical reasoning) to test LLMs ( 9 ; 19 ) . We complement this by using the nonverbal, reward-driven paradigms standard in comparative psychology. CheeseBench Benchmark Design Principles CheeseBench follows four principles inspired by how behavioral neuroscience studies are conducted: 1. Unified protocol. A single system prompt for all nine tasks. No task-specific instructions, reward explanations, or goal descriptions. The agent must discover task structure through exploration and reward feedback. 2. Approximate biological references. Each environment corresponds to a real rodent experiment. We derive reference success rates from published learning curves by mapping the original outcome metric to our binary criterion (see the Rodent Baseline Construction appendix). These are constructed reference anchors, not direct competitive baselines. 3. Cognitive taxonomy. Environments span six cognitive dimensions, enabling profiling across distinct neural substrates. 4. Multi-action episodes. The agent outputs up to k actions per API call along with free-text “learnings” that serve as an explicit working memory, mimicking the episodic structure of animal experiments. Environments Table 1 lists all nine paradigms. We briefly describe representative tasks: Morris Water Maze (MWM). A circular arena with a hidden escape platform. The agent uses distal landmarks for allocentric navigation. Rodents typically reach asymptotic performance within 5 sessions ( 17 ) . Radial Arm Maze (RAM). An 8-arm maze with 4 baited arms. The agent must visit all baited arms without revisiting. This requires working memory across choices within each trial, and rodents learn to avoid revisits within several sessions ( 12 ) . Operant Chamber. A Skinner box with two levers and a magazine. The agent learns to press the correct lever to obtain reward via instrumental conditioning. Rodents rapidly acquire lever-press responses under continuous reinforcement ( 16 ) . Shuttle Box. A two-compartment chamber with a conditioned stimulus (CS) preceding an aversive unconditioned stimulus (US). The agent must learn to shuttle to the other compartment during the CS to avoid the US. Rodents typically reach \sim 70% avoidance by session 5 ( 4 ) . Figure 1 shows the ASCII rendering of all nine environments as the model sees them. Figure 1: ASCII renderings of all nine CheeseBench environments as seen by the model. Walls are shown as # , traversable areas as ˜ or . , goals as G , and the agent arrow indicates position and facing direction. Table 1: CheeseBench environments. Animal baselines are from published rodent studies. Trials = evaluation trials; Steps = max steps/trial. Environment Cognitive Dimension Species Trials Steps MorrisWaterMaze Spatial Learning C57BL/6 20 500 BarnesMaze Spatial Learning C57BL/6

Read the complete text