Adaptive Social Learning using Theory of Mind

Lance Ying, Ryan Truong, Joshua B. Tenenbaum, Samuel J. Gershman · 2025

Read Adaptive Social Learning using Theory of Mind by Lance Ying, Ryan Truong, Joshua B. Tenenbaum, Samuel J. Gershman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-09409.txt.

Introduction

Lance Ying and three co-authors model when people learn from others in a 2025 paper. Watching peers is a strong way to learn, yet it costs time and thought, so men do not always choose it. How the trade is struck was the open ask.

Their model weighs the choice like a sane mind reader: it guesses the peer's aim and how much their next acts will tell, then sets that worth against digging alone. In a group treasure hunt game, the model's calls matched human trades in count. Mind reading may steer when crowds teach us.

Catalog record

CREATORLance Ying, Ryan Truong, Joshua B. Tenenbaum, Samuel J. Gershman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-09409

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adaptive Social Learning using Theory of Mind Lance Ying, Ryan Truong, Joshua B. Tenenbaum, Samuel J. Gershman Abstract Social learning is a powerful mechanism through which agents learn about the world from others. However, humans don’t always choose to observe others, since social learning can carry time and cognitive resource costs. How do people balance social and non-social learning? In this paper, we propose a rational mentalizing model of the decision to engage in social learning. This model estimates the utility of social learning by reasoning about the other agent’s goal and the informativity of their future actions. It then weighs the utility of social learning against the utility of self-exploration (non-social learning). Using a multi-player treasure hunt game, we show that our model can quantitatively capture human trade-offs between social and non-social learning. Furthermore, our results indicate that these two components allow agents to flexibly apply social learning to achieve their goals more efficiently. Keywords: social learning, Theory of Mind, decision making, social cognition, utility maximization Introduction Social learning is a powerful mechanism through which humans and non-human animals acquire information about the world. It often requires observing other agents’ actions and extracting information from these observations. However, the payoffs of social learning are not always immediately clear; non-social learning (e.g., through trial-and-error) can sometimes be just as (or even more) powerful and efficient. † † Published as a conference paper at CogSci 2025 Imagine you are deciding a restaurant to go for dinner. There are many restaurant options and you don’t know which ones are good. You can go through their menus (nonsocial learning) and decide or observe which restaurants others tend to go to (social learning). However, because people have different food preferences, social learning may not lead to the most optimal outcome as many may be heading towards a famous Italian restaurant but you are craving for Asian food. Much of the research on social learning has focused on various heuristics, such as copying the most successful agent or the majority ( Heyes 2012a ; Rendell et al. 2011a ; Muthukrishna et al. 2016a ; Laland 2004a ) . While these heuristics can be powerful, and seem to be attested in behavioral data, they are probably not the whole story. Humans are able to use more sophisticated learning strategies based on reasoning about the beliefs and desires of other agents ( Gershman et al. 2017a ; Gweon 2021a ; Hawkins et al. 2023a ) . We refer to such strategies as “theory-of-mind” (ToM) social learning. These strategies enable learning from sparse, indirect data. For example, you might infer that your friend knows a good restaurant but isn’t hungry, or is hungry but doesn’t know a good restaurant; only when you can infer that both conditions are true should you follow your friend. You could also observe your knowledgeable friend when she’s hungry so that you can use this information later when you’re hungry. Or you could wait until your ignorant friend acquires knowledge before following them. Most existing studies on social learning have mainly focused on tasks where all agents are pursuing the same goal. For example, in the collective sensing task used by Hawkins et al. 2023a , once the observer can infer who has knowledge of the goal location, social learning (observing knowledgeable agents) tends to be less costly than non-social learning (direct exploration in the environment). In more realistic settings, agents may have different goals, and direct exploration may sometimes be more effective. While some recent work has started to explore human social learning in settings with diverse agent goals Witt et al. 2024a , they do not explicitly propose how humans estimate the utilities of social vs non-social learning strategies in complex tasks. Estimating the utility of social learning becomes challenging in a complex multi-agent domain where agents have diverging goals and knowledge. The benefit of observing others, despite their expertise, may not always outweigh the cost, because even if the agents are knowledgeable, they may not produce behaviors that are more useful to an observer than direct experience. Even in cases where we can infer useful information from these behaviors, social learning can quickly become expensive and time consuming if it requires observing long trajectories. Our aim is to understand how humans balance these trade-offs as they decide when to engage in social vs. non-social learning. We propose a “Rational Mentalizing” model of social learning grounded in prior work on Bayesian ToM ( Baker et al. 2017a ; Jara-Ettinger 2019a ) . The model estimates the utility of social learning by mentalizing about other agents’ goals and plans, which it weighs against the utility of non-social learning to decide if and when to observe the other agent. We test the model in a complex multi-agent treasure hunt game where each player needs to find one hidden object in order to pass a barrier and reach their goal. On each step, the main agent, controlled by the participants, can either observe another agent for one step with a low cost, or perform an action with a higher cost. We created different trade-offs by varying the layout of the environment, allowing us to disentangle the predictions of the rational mentalizing model from several alternatives (Figure 1 ). Related Work Social learning and non-social learning Social learning and non-social learning are two dominate ways humans and non-human animals apply to acquire new information and skills. The former enables agents to observe others to gather social information while non-social learning primarily relies on reward learning by trial-and-error. Studies in evolutionary biology and animal cognition have long explored the ”when” and ”who” in social learning and suggested that social learning gives social learners evolutionary advantages as they can gather information more efficiently than non-social learners ( Kendal et al. 2005a ; Heyes 2012a ; Kameda & Nakanishi 2003a ; Henrich 2016a ; Kendal et al. 2018a ) . However, most existing studies treat social learning as copying or imitating other agent’s actions or policies. Human social learning, on the other hand, is uniquely complex, flexible and efficient, as we don’t simply copy successful agents, but use higher level cognitive skills to reason about the secrets behind their success ( Horner & Whiten 2005a ; Gweon 2021a ; Bonawitz & Shafto 2016a ) . Theory of Mind Theory of Mind refers to human’s ability to reason about other agents’ mental states such as goals and beliefs. It’s a critical cognitive skill for human social interaction ( Wellman & Lagattuta 2004a ; Wellman 2002a ) . Recent work in cognitive science has increasingly suggested that Theory of Mind plays a crucial role in human teaching and learning ( Gweon 2021a ; Shafto et al. 2012a ; Hawkins et al. 2023a ; Dutemple et al. 2023a ) . Our work builds on the Bayesian Theory of Mind framework by Baker et al. 2017a , which models other agents as rational planners and infers their goals and beliefs by inverting a generative model of agent’s goal-directed actions. The BToM model has been used for modeling a variety of human social behaviors that involve mentalizing ( Zhi-Xuan et al. 2024a ; Ying et al. 2024a ; Stacy et al. 2021a )

Read the complete text