Personality over Precision: Exploring the Influence of Human-Likeness on ChatGPT Use for Search DOI: XXXXXXX.XXXXXXX Conference: New Interaction Paradigms for Information Retrieval in the Era of Generative AI; July 17, 2025; Padua, Italy ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Users
Mert Yazan, Frederik Bungaran Ishak Situmeang, Suzan Verberne · 2025
Read Personality over Precision: Exploring the Influence of Human-Likeness on ChatGPT Use for Search DOI: XXXXXXX.XXXXXXX Conference: New Interaction Paradigms for Information Retrieval in the Era of Generative AI; July 17, 2025; Padua, Italy ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Users by Mert Yazan, Frederik Bungaran Ishak Situmeang, Suzan Verberne (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06447.txt.
Introduction
Mert Yazan, Frederik Situmeang, and Suzan Verberne survey why people choose ChatGPT for search despite its risk of confident errors. Conversational interfaces feel personal and engaging next to classic search engines, which can breed overtrust. The team asked one hundred seventy-three users about trust, human-likeness, and design preferences across both tools.
Daily users of both systems trusted ChatGPT more, rated it more human-like, and accepted trading factual accuracy for smoother conversation. Google-first users trusted it less yet still liked the ad-free, responsive feel. Middle-aged adults used ChatGPT least but trusted it most, a pattern the authors flag as a misinformation vulnerability.
Catalog record
| CREATOR | Mert Yazan, Frederik Bungaran Ishak Situmeang, Suzan Verberne |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-06447
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Personality over Precision: Exploring the Influence of Human-Likeness on ChatGPT Use for Search DOI: XXXXXXX.XXXXXXX Conference: New Interaction Paradigms for Information Retrieval in the Era of Generative AI; July 17, 2025; Padua, Italy ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Users and interactive retrieval CCS: Human-centered computing User studies Mert Yazan, Frederik Bungaran Ishak Situmeang, Suzan Verberne Abstract . Conversational search interfaces, like ChatGPT, offer an interactive, personalized, and engaging user experience compared to traditional search. On the downside, they are prone to cause overtrust issues where users rely on their responses even when they are incorrect. What aspects of the conversational interaction paradigm drive people to adopt it, and how it creates personalized experiences that lead to overtrust, is not clear. To understand the factors influencing the adoption of conversational interfaces, we conducted a survey with 173 participants. We examined user perceptions regarding trust, human-likeness (anthropomorphism), and design preferences between ChatGPT and Google. To better understand the overtrust phenomenon, we asked users about their willingness to trade off factuality for constructs like ease of use or human-likeness. Our analysis identified two distinct user groups: those who use both ChatGPT and Google daily (DUB), and those who primarily rely on Google (DUG). The DUB group exhibited higher trust in ChatGPT, perceiving it as more human-like, and expressed greater willingness to trade factual accuracy for enhanced personalization and conversational flow. Conversely, the DUG group showed lower trust toward ChatGPT but still appreciated aspects like ad-free experiences and responsive interactions. Demographic analysis further revealed nuanced patterns, with middle-aged adults using ChatGPT less frequently yet trusting it more, suggesting potential vulnerability to misinformation. Our findings contribute to understanding user segmentation, emphasizing the critical roles of personalization and human-likeness in conversational IR systems, and reveal important implications regarding users’ willingness to compromise factual accuracy for more engaging interactions. 1. Introduction There has been a growing interest in making information retrieval (IR) more conversational ( 23 ) . Conversational search offers significant advantages over traditional search by enabling context-aware, natural language interactions that support personalized responses and enhanced user engagement ( 23 ) . Conversational search interfaces, such as ChatGPT, are rated as more enjoyable and useful compared to traditional search engines ( 20 ; 13 ) . The ever-increasing influence of Large Language Models (LLMs) allows conversational search to be even more powerful, as they can be used in many tasks like query reformulation, search clarification, conversational retrieval, and response generation ( 12 ) . Despite ChatGPT’s popularity, Google has approximately 14 to 16 billion daily searches ( 4 ) , whereas ChatGPT processes around 1 billion prompts each day ( 16 ) . Given the fact that ChatGPT or similar platforms are commonly used for tasks like coding and writing besides search ( 18 ; 7 ; 17 ) , traditional search engines are still the most popular means of information finding. Yet, the current paradigm is steering towards a more unified experience. Apps like Perplexity or the search feature of ChatGPT provide LLMs with real-time web search results to mitigate inaccuracies. Also, Google has integrated generative AI into its search ( 14 ) , which shows a clear trend of making search more conversational. Perceived usefulness is one of the main pillars of technology acceptance ( 5 ) , and anthropomorphism (human-likeness) is shown to increase acceptance in customer-support bots ( 19 ) . Similarly, in the case of ChatGPT, users highlight human-like qualities ( 10 ) and perceived usefulness ( 20 ; 13 ) as key reasons for choosing it. Users who interact with ChatGPT report higher enjoyment and satisfaction, compared to users who interact with Google, despite similar task performances ( 20 ) . Apparently, the conversational interaction paradigm driven by the human-likeness and perceived usefulness leads to more enjoyable experiences ( 20 ; 21 ) . Similarly, trust in ChatGPT is influenced positively by conversationality, fast responses, and perceived human-likeness ( 10 ) . Despite the advantages, there is an emerging issue with conversational interfaces: overtrust. While the generative nature of LLMs empowers them as effective conversational tools, it also makes them prone to hallucinations and fabricating inaccurate information ( 9 ) . Despite inconsistencies and a worse performance than Google in fact-checking tasks, people who only used ChatGPT were more likely to trust its answers ( 20 ) . Users show overreliance on conversational AI interfaces, even when it is incorrect ( 23 ) . Anthropomorphism reduces risk perception ( 19 ) , which can further aggravate overtrust. Therefore, even though users trust chat-based interfaces for their interaction flow and personality, they become more susceptible to misinformation. Vulnerable groups like older adults are at a higher risk, since they are more prone to believe fake information ( 2 ) . To better understand the adoption of conversational interfaces, we conduct an exploratory survey study with 173 participants to identify the types of users who interact with Google and ChatGPT. We investigate the main design principles that drive tool preferences and how they relate to perceived human-likeness and trust. We further look into how design, trust, and human-likeness relate to people’s perception of factuality, while identifying people’s willingness to trade off factuality for ease-of-use and more personalized interactions. Finally, an age - and gender - based analysis further illuminates how demographic factors modulate the aforementioned factors. Our findings reveal two user groups: people who use both ChatGPT and Google daily, and people who only use Google daily. The groups diverged significantly in their trust towards the platforms, as daily users of both platforms showed more trust towards ChatGPT and perceived it as more human-like. Both groups listed personalized outputs as the most common reason that they would prefer ChatGPT over Google. Interaction flow and conversational interface emerged as the most popular design aspects of ChatGPT, especially for daily users of both platforms. When asked if they would agree on trading factuality for ease-of-use and human-likeness, the groups again diverged, as daily users of both agreed more with the statement. Age groups also suggest an interesting pattern: middle-aged (30-55) adults use ChatGPT less frequently but trust it more. Therefore, the main contributions of this paper are: (1) We provide distinct user segments (based on usage patterns and age) that have significantly different perceptions and preferences towards ChatGPT. (2) We identify the influence of human-likeness and personalization on trust and design preferences in conversational assistants. (3) We demonstrate that users may be willing to trade off factuality for more personalized interactions. 2. Background Various studies identify a higher technology acceptance of conversational search compared to traditional search, due to its usefulness and ease-of-use ( 13 ; 21 ; 20 ) . Both those dimensions are pillars of the technology acceptance model (TAM) ( 5 ) , and a higher acceptance leads to a higher use intention and adoption ( 13 ) . The user interface is directly related to technology acceptance, as design choices affect perceived ease-of-use and usefulness ( 5 ) . Conversational search interfaces offer an interactive and personalized experience over traditional methods, reducing the cognitive and emotional load of the users, leading to increased acceptance ( 11 ) . Compared to web search, users preferred conversational assistants more when the