What’s Privacy Good for? Measuring Privacy as a Shield from Harms due to Personal Data Use
Sri Harsha Gajavalli, Junichi Koizumi, Rakibul Hasan · 2025
Read What’s Privacy Good for? Measuring Privacy as a Shield from Harms due to Personal Data Use by Sri Harsha Gajavalli, Junichi Koizumi, Rakibul Hasan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-22787.txt.
Introduction
Sri Harsha Gajavalli, Junichi Koizumi and Rakibul Hasan propose measuring privacy by the harms it prevents, in their 2025 arXiv paper. Existing frameworks, they argue, miss many harms that arise when modern systems infer and use personal data. Their question is simple: what harms from data use can privacy shield people from?
They tested the idea in an online study with four hundred students. Participants rated fourteen harms, such as manipulation, discrimination and harassment, across six types of inferred data in school and job settings. The harms hung together as one general notion, with views varying by context and demographics. The authors discuss how privacy could be improved more fairly.
Catalog record
| CREATOR | Sri Harsha Gajavalli, Junichi Koizumi, Rakibul Hasan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-22787
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
What’s Privacy Good for? Measuring Privacy as a Shield from Harms due to Personal Data Use Sri Harsha Gajavalli, Junichi Koizumi, Rakibul Hasan Abstract We propose a harm-centric conceptualization of privacy that asks: What harms from personal data use can privacy prevent? The motivation behind this research is limitations in existing privacy frameworks (e.g., Contextual Integrity) to capture or categorize many of the harms that arise from modern technology’s use of personal data. We operationalize this conceptualization in an online study with 400 college and university students. Study participants indicated their perceptions of different harms (e.g., manipulation, discrimination, and harassment) that may arise when artificial intelligence-based algorithms infer personal data (e.g., demographics, personality traits, and cognitive disability) and use it to identify students who are likely to drop out of a course or the best job candidate. The study includes 14 harms and six types of personal data selected based on an extensive literature review. Comprehensive statistical analyses of the study data show that the 14 harms are internally consistent and collectively represent a general notion of privacy harms. The study data also surfaces nuanced perceptions of harms, both across the contexts and participants’ demographic factors. Based on these results, we discuss how privacy can be improved equitably. Thus, this research not only contributes to enhancing the understanding of privacy as a concept but also provides practical guidance to improve privacy in the context of education and employment. 1 Introduction A crucial goal of usable privacy research has been to define and measure privacy. Earlier efforts centered around the concept of disclosure (or concealment) of private data, where privacy is violated when such data is leaked [ 1 ] . However, categorizing data as private (versus public) is arbitrary and malleable [ 2 ] , their disclosure is often a necessity, and they can be inferred using non-private data. Research on defining and measuring related (or proxy) concepts, such as privacy concerns [ 3 ] , primarily to understand and predict data-disclosing behaviors, remained unsatisfactory, with the coining of (now-debunked [ 4 ] ) terms like privacy-paradox to explain concern-behavior mismatches. Likewise, framing privacy as control over personal data led to measures like notice and consent, which ultimately degraded privacy [ 5 ] . A different perspective, privacy as contextual integrity (CI) [ 6 ] , sidesteps defining data as inherently private or public; instead, it declares a data flow as a privacy violation if it is misaligned with established norms or expectations in a given context. CI overcomes many of the limitations mentioned above, better explains people’s privacy-related attitudes, and has gained wide popularity in the last two decades within the privacy research community [ 7 ] . CI, however, only concerns semantically meaningful data (e.g., age); the exclusion of information that can be inferred from other data renders it incapable of determining privacy violations for a large number of digital services based on AI (artificial intelligence) that constantly perform such inferences. Moreover, CI’s reliance on norms prevents it from recognizing novel privacy violations from established data-disclosing practices. In this paper, we conceptualize privacy as a shield against harms caused by the use of personal data in a certain context . The fact that privacy is much more than data protection [ 8 ] , and its role in achieving other human values, including freedom, protection from manipulation, and identity building, has long been recognized [ 9 ] . Lack of privacy, then, may lead to harms like being discriminated against or manipulated; such harm-centric framings are frequently used in court cases [ 8 , 10 ] (about privacy violations) and legal scholarship [ 2 ] . This conceptualization avoids many of the limitations of the other formulations: it is oblivious to whether the data are private or sensitive, or accessed directly versus inferred from other data. Crucially, this framing may better explain and predict privacy-related behaviors, as privacy risks largely depend upon how data subjects perceive the effects of privacy harms [ 11 ] . Finally, technical and legal protective mechanisms can focus on preventing specific harms rather than aiming to eliminate data disclosure, which is close to impossible in practice. We operationalize this framing of privacy in an online study that investigates: (1) What harms do data subjects anticipate when artificial intelligence (AI) algorithms infer personal data and use it to make consequential decisions? and (2) How do perceived harms vary across data types as well as data subjects’ demographic factors? We focus on two decision contexts: whether a student will drop out of a course or a job candidate should be hired—both are being increasingly AI-driven in practice [ 12 , 13 , 14 , 15 , 16 , 17 , 18 ] . In this study, we surveyed college or university students (N=400), who are also current or future job seekers, and thus the population likely to be impacted the most by such algorithms (i.e., the “experiential experts” in this context [ 19 ] ). Each participant indicated whether they (dis)agree that the use of personal data will cause privacy harms in either the education or the employment context (between-subject design). The study included six classes of personal data (demographics, personality, traits, and emotional state) and 14 types of harms (e.g., manipulation, bias, and stereotyping), selected through a comprehensive literature review (see § 3 ). Our data reveals interesting and nuanced patterns in participants’ conceptualization of privacy harms. For example, when demographic or personality trait data is used in either domain, participants anticipated harms like being stereotyped, discriminated, or manipulated; but perception of such data as inherently private was much weaker---lending support for the harm-centric understanding of privacy. Surprisingly, participants indicated that traits like creativity and motivation would cause harms like inconsistent and biased decisions when used in the education domain, but not when used to make hiring decisions. Finally, we uncover complex variations of perceived harms across participants’ demographics. Overall, female, older, and non-white participants expressed more concerns about different harms compared to male, younger, and white participants, respectively; however, the type of harms they were concerned about varied across data type and the context. These findings not only provide a clearer picture of privacy violations but also offer actionable preventive measures. We additionally demonstrate the robustness of our measurement approach through reliability statistics and factor analysis, and practical significance by applying the harm categories in real-life incidents from the AIID dataset 1 1 1 https://incidentdatabase.io . Together, they prove that a harm-centric conceptualization of privacy can be valuable in many contexts that usable privacy researchers study. In sum, this paper makes the following contributions: 1. We conceptualize and operationalize a harm-centric conceptualization of privacy and evaluate this framing on two decision contexts that are of increasing relevance to society. 2. We empirically demonstrate the reliability and consistency of measuring privacy through perceived harms. Thus, we extend the literature on privacy frameworks. 3. We provide empirical evidence for the benefits of harm-centric framing. For example, privacy as a shield from harm detects violations of privacy that would go undetected under other frameworks (see results and discussions) and could guide technical and policy interventions to minimize harms when a complete ban on data collection is