How trust networks shape students’ opinions about the proficiency of artificially intelligent assistants

Yutong Bu, Andrew Melatos, Robin Evans · 2025

Read How trust networks shape students’ opinions about the proficiency of artificially intelligent assistants by Yutong Bu, Andrew Melatos, Robin Evans (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-19655.txt.

Introduction

How trust webs shape student views of AI helpers is simulated by Yutong Bu, Andrew Melatos, and Robin Evans in a 2025 arXiv paper. Each student holds a spread of beliefs about the tool's skill. Beliefs update by own trials and by peer push, weighted by trust. The team runs Monte Carlo worlds of many such students. In high-trust webs, students land on the true skill.

One stubborn wrong partisan can wreck that calm for all. In low-trust webs, all settle but few land right. Mixed webs can churn or settle by who sits where. Class rules should mind these web effects.

Catalog record

CREATORYutong Bu, Andrew Melatos, Robin Evans
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE95 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-19655

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

How trust networks shape students’ opinions about the proficiency of artificially intelligent assistants Yutong Bu, Andrew Melatos, Robin Evans Abstract The rising use of educational tools controlled by artificial intelligence (AI) has provoked a debate about their proficiency. While intrinsic proficiency, especially in tasks such as grading, has been measured and studied extensively, perceived proficiency remains underexplored. Here it is shown through Monte Carlo multi-agent simulations that trust networks among students influence their perceptions of the proficiency of an AI tool. A probabilistic opinion dynamics model is constructed, in which every student’s perceptions are described by a probability density function (PDF), which is updated at every time step through independent, personal observations and peer pressure shaped by trust relationships. It is found that students infer correctly the AI tool’s proficiency θ AI \theta_{\rm AI} in allies-only networks (i.e. high trust networks). AI-avoiders reach asymptotic learning faster than AI-users, and the asymptotic learning time for AI-users decreases as their number increases. However, asymptotic learning is disrupted even by a single partisan, who is stubbornly incorrect in their belief θ p ≠ θ AI \theta_{\rm p}\neq\theta_{\rm AI} , making other students’ beliefs vacillate indefinitely between θ p \theta_{\rm p} and θ AI \theta_{\rm AI} . In opponents-only (low trust) networks, all students reach asymptotic learning, but only a minority infer θ AI \theta_{\rm AI} correctly. AI-users have a small advantage over AI-avoiders in reaching the right conclusion. The outcomes in allies-only and opponents-only networks depend weakly on network size n n . In mixed networks, students may exhibit turbulent nonconvergence and intermittency, or achieve asymptotic learning, depending on the relationships between partisans and AI-users. In smaller mixed networks with n ≲ 10 n\lesssim 10 students, the long-term outcome is affected by whether a partisan teacher is an AI-skeptic ( θ p < θ AI \theta_{\rm p}<\theta_{\rm AI} ) or an AI-promoter ( θ p ≥ θ AI \theta_{\rm p}\geq\theta_{\rm AI} ). In larger mixed networks with n ≳ 10 2 n\gtrsim 10^{2} , students are more likely to infer θ p \theta_{\rm p} instead of θ AI \theta_{\rm AI} . The educational implications of the results are discussed briefly in the context of designing robust usage policies for AI tools, with an emphasis on the unintended and inequitable consequences which arise sometimes from counterintuitive network effects. 1 Introduction The growing use of artificial intelligence (AI) tools in educational settings is generating debate [ 1 ] . AI tools are deployed by teachers, e.g. to author lesson plans [ 2 ] , compose feedback [ 3 ] , and grade assessment tasks [ 4 ] . They are also deployed by students, e.g. to conduct background research [ 5 , 6 ] and even generate answers to assessment tasks directly [ 7 ] . A multifarious conversation is underway about AI-assisted teaching and learning: its ethics and philosophical underpinnings [ 5 , 8 ] , its impact on educational goals (e.g. liberal, vocational) and hence on society [ 9 , 10 ] , the practicalities of its use [ 11 ] , the pace and socioeconomic uniformity of its adoption [ 12 , 13 , 14 ] , its fairness and bias [ 15 ] , and so on. Important issues of academic integrity arise, especially when students use AI tools to do assessment tasks with zero or minimal human intervention [ 11 ] . Policy frameworks and guardrails are being developed to combat the latter risk [ 16 , 17 ] . One key question about AI-assisted teaching and learning is how well AI tools can grade or respond to assessment tasks respectively, when judged by a human expert. Colloquially speaking, how intelligent is the AI? There are two facets to the question. First, what is the intrinsic proficiency of the AI? Many studies have been performed to quantify proficiency statistically for objective assessment tasks, e.g. mathematical questions with a unique correct answer [ 18 , 19 ] , and subjective assessment tasks, e.g. writing a cogent nonfiction essay or a piece of creative fiction [ 20 ] . The results depend strongly on the specific task and AI tool [ 21 ] but have exceeded expectations in some quarters, leading to statements such as (verbatim quotes) “ChatGPT-3.5 performed on average at the level of a C+ student” [ 22 ] and “GPT-4 performed at a level comparable to the best performing undergraduate medical student” [ 23 ] . Beyond intrinsic proficiency, there is a second facet: what is the perceived proficiency of the AI? Perceived proficiency has received less attention than intrinsic proficiency, partly because it is harder to measure rigorously, and partly because there is a tacit assumption sometimes that it is correlated with intrinsic proficiency and therefore does not warrant separate treatment. In reality, perceived and intrinsic proficiencies often differ. For example, large language models (LLMs) may hallucinate (i.e. return false answers) in a superficially plausible manner [ 24 ] and indeed may lie confidently [ 25 ] , posing risks for credulous users who overestimate an LLM’s intrinsic proficiency [ 26 ] . Perceived proficiency is crucial because it is the chief determinant of how fast and uniformly AI tools are adopted [ 27 ] . It is a socially emergent construct. In this paper, we study how students in a networked cohort form opinions about the proficiency of an AI tool, based on observations of their own performance when they do or do not use the tool, as well as exposure to the opinions of other students in the network. A central factor is how the intrinsic performance of the AI tool interacts with trust relationships between students. As just one example, student X may develop an inaccurate perception about the AI tool’s proficiency (e.g. overly optimistic or pessimistic) and transmit it by contagion to other students who trust student X. Such phenomena can be investigated through multi-agent simulations and related techniques from the field of opinion dynamics [ 28 ] , which studies how individual opinions evolve through peer pressure within a community or group. Related analyses have been conducted recently to model opinions about media bias (e.g. the political bias of a newspaper, as displayed through its editorials) within a network of political allies and opponents [ 29 , 30 , 31 , 32 , 33 , 34 , 35 , 36 ] . Counterintuitive outcomes emerge under certain realistic conditions, e.g. agents in the network exhibit unstable opinions (vacillating intermittently, or failing to converge) [ 30 ] , converge faster on false than true opinions [ 29 , 31 ] , or develop weak or even negative correlations between perceived and intrinsic media biases [ 31 ] . Counterintuitive network outcomes driven by similar dynamics may also occur in educational settings, when students form opinions about the proficiency of AI assistants. It is therefore important to understand under what conditions this may occur when developing policy frameworks and guardrails around the use of AI assistants, lest the adoption of AI tools is disturbed by network effects unrelated to the ethical or technical characteristics of the tools themselves. The paper is structured as follows. Section 2 introduces an idealized opinion dynamics model, in which a

Read the complete text