Are Cognitive Biases as Important as they Seem for Data Visualization? DOI: 10.1145/3706599.3719926 Conference: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan Extended Abstracts of the CHI Conference on Human Factors in Computing
Ali Baigelenov, Prakash Shukla, Zixu Zhang, Paul Parsons · 2025
Read Are Cognitive Biases as Important as they Seem for Data Visualization? DOI: 10.1145/3706599.3719926 Conference: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan Extended Abstracts of the CHI Conference on Human Factors in Computing by Ali Baigelenov, Prakash Shukla, Zixu Zhang, Paul Parsons (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03852.txt.
Introduction
Ali Baigelenov and co-authors wrote a 2025 paper asking whether work on bias in charts has told only half the story. Studies of charts often stress how mental shortcuts lead people to read data in flawed ways and make poor choices. The authors argue that this focus can make human judgment sound weaker and less skilled than it really is.
The paper reviews views in the chart field and work that takes a more balanced stance. The same shortcuts that cause errors can also show skill, speed, and learned judgment in hard settings. The authors urge chart researchers to study both the limits and the strengths of human thought, so design choices rest on a fuller picture of how people decide.
Catalog record
| CREATOR | Ali Baigelenov, Prakash Shukla, Zixu Zhang, Paul Parsons |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-03852
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Are Cognitive Biases as Important as they Seem for Data Visualization? DOI: 10.1145/3706599.3719926 Conference: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA ’25), April 26-May 1, 2025, Yokohama, Japan ISBN: 979-8-4007-1395-8/2025/04 CCS: Human-centered computing Visualization CCS: Applied computing Psychology Ali Baigelenov, Prakash Shukla, Zixu Zhang, Paul Parsons Abstract . Research on cognitive biases and heuristics has become increasingly popular in the visualization literature in recent years. Researchers have studied the effects of biases on visualization interpretation and subsequent decision-making. While this work is important, we contend that the view on biases has presented human cognitive abilities in an unbalanced manner, placing too much emphasis on the flaws and limitations of human decision-making, and potentially suggesting that it should not be trusted. Several decision researchers have argued that the flip side of biases—i.e., mental shortcuts or heuristics—demonstrate human ingenuity and serve as core markers of adaptive expertise. In this paper, we review the perspectives and sentiments of the visualization community on biases and describe literature arguing for more balanced views of biases and heuristics. We hope this paper will encourage visualization researchers to consider a fuller picture of human cognitive limitations and strategies for making decisions in complex environments. 1. Introduction Human decision-making has been an important area of research for several decades. While perfect rationality was long upheld as the ideal, human decision-making has been consistently shown to be sub-optimal by the researchers since the 1950s (e.g., Simon’s bounded rationality ( Simon 1955 ) ). In their seminal work, Kahneman and Tversky ( Kahneman et al. 1982 ) argued that people often resort to mental shortcuts (which they referred to as heuristics) when making decisions, especially in situations involving uncertainty. While these heuristics are often useful as they reduce cognitive load, in some cases they lead to cognitive biases, which have been characterized as systematic "errors" in thinking. Many such biases have been documented over the years, and overall the topic has been extremely popular across a wide range of fields. With this popularity, however, there have been critiques that the overall research program has been unbalanced, with researchers advocating for a more nuanced perspective that considers the context and adaptive nature of human decision-making ( Gigerenzer 1991 ; Cohen 1981 ) . As in other fields dealing with human decision-making, there has been significant interest in biases in the visualization community, where we have seen considerable efforts over the past decade (e.g., ( Dimara et al. 2017 ; Wall et al. 2021 ; Procopio et al. 2021 ; Cottam and Blaha 2018 ) ). With this trend, however, the view on decision-making under uncertainty has been somewhat limited, not representing the full range of human capabilities and limitations. Because of this, the visualization community might be missing out on important insights about the adaptive nature of decision-making. In this paper, we provide a preliminary analysis of sentiments towards cognitive biases and heuristics in the visualization literature from the past decade. We draw on literature from psychology and decision making to describe a more balanced perspective of heuristic reasoning that highlights the adaptive and positive aspects of mental shortcuts. Lastly, we present an example to illustrate how a more nuanced view of biases can be utilized in a real world research project involving data visualizations. 2. Sentiments on Cognitive Biases in the Visualization Literature 2.1. Method To investigate sentiments on cognitive biases in the visualization literature, we conducted a preliminary analysis using Google Scholar where we searched for literature using a variety of keyword combinations, essentially in the form of “cognitive bias” and related terms (e.g., heuristics, fallacies, framing effects) plus (i.e., AND command) “information visualization” and related terms (e.g., data visualization, visual analytics). Besides the keyword combinations, our inclusion criteria were as follows: 1) To investigate recent trends and create a manageable starting point for this work, we limited our search to include only literature from the last 10 years (starting from 2014 and onwards, the data collection ended on May 1st of 2024). 2) Included literature must primarily be about visualization (e.g., information visualization, data visualization, visual analytics) and cognitive bias (including related concepts such as heuristics, shortcuts, fallacies, and specific biases like anchoring, confirmation, framing effects, and so on). Additionally, both visualizations and cognitive biases have to be prominent concepts in the work (i.e., mentioned in the title and/or abstract). Regarding our classification criteria, we have identified a variety of keywords (see supplementary materials for the full list) which were used to determine whether the paper was classified as having negative, neutral, or positive views on cognitive biases and human decision-making. For example, papers were classified as negative if they only used keywords such as inaccurate, irrational, suboptimal and faulty to describe human decision-making; imperfections, deviations, mistakes, and errors to describe biases; and de-biasing, mitigate, and alleviate to frame human decision-making as something that needs to be fixed. Papers in the neutral classification were divided into three categories: neutral-more-negative, neutral-more-positive, and neutral. If a paper mentioned positive sides (in addition to the negative sides) of human decision-making and biases (e.g., mentioned that the underlying mechanisms behind biases are often beneficial, mentioned cases in which "biased" behavior was/is beneficial, and discussed the intricacies of human decision-making through the lens of heuristics and shortcuts rather than only biases) but still adopted a mostly negative sentiment, we classified it as neutral-more-negative. Similarly, if a paper mentioned both positive and negative aspects of human decision-making and biases, but maintained a more positive view throughout the work, we classified it as neutral-more-positive. Then, if a paper maintained a more neutral tone and discussed both negative and positive aspects of the biases and human decision-making roughly equally, we classified it as neutral. Lastly, a paper was classified as positive if it didn’t mention any negative aspects (according to the keywords we identified) of biases and human decision-making. 2.2. Findings This search resulted in 134 papers, of which 22 papers were found to be not relevant in the initial review based on our inclusion criteria; thus, the final list consisted of 112 papers. The final list of 112 papers was collectively coded and analyzed by the first two authors and later discussed with all the authors. The final list of analyzed references (with the codes and comments) is provided as a supplementary material. Out of the 112 papers analyzed, 71 displayed largely negative sentiments toward human cognitive abilities, emphasizing the flawed nature of the human decision-making and discussing ways of mitigating these perceived flaws. Within the remaining 41 papers, 24 papers presented a somewhat more balanced viewpoint, at least acknowledging that criticisms of the bias-focused work exist or that heuristics can sometimes be useful. 14 of these papers made such acknowledgments (often only superficially or in passing) but remained largely negative throughout the rest of the paper’s content. Only three papers (within the remaining 41) adopted a more balanced perspective. None of the papers were purely positive in their view of human cognitive abilities. In the sub-sections below, we discuss our findings in relation to our coding strategy described above,