Recommending With, Not For Journal: TORS 8 Volume: TBA TBA 1 DOI: 10.1145/3759261 CCS: Human-centered computing Participatory design CCS: Human-centered computing HCI design and evaluation methods CCS: Information systems Recommender systems CCS: General and reference Evaluation
Michael D. Ekstrand, Afsaneh Razi, Aleksandra Sarcevic, Maria Soledad Pera, Robin Burke, Katherine Landau Wright · 2025
Read Recommending With, Not For Journal: TORS 8 Volume: TBA TBA 1 DOI: 10.1145/3759261 CCS: Human-centered computing Participatory design CCS: Human-centered computing HCI design and evaluation methods CCS: Information systems Recommender systems CCS: General and reference Evaluation by Michael D. Ekstrand, Afsaneh Razi, Aleksandra Sarcevic, Maria Soledad Pera, Robin Burke, Katherine Landau Wright (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03792.txt.
Introduction
Michael Ekstrand and co-authors argue for designing recommender systems with their communities, not just for them, in this 2025 paper. Recommenders are usually built by platform teams alone. Goals come from those teams and the business. Users and other affected groups get little say. That imbalance matters most when systems aim at social good. Affected people hold knowledge designers lack.
The authors draw on participatory design traditions. Co-design shares the power to set goals and judge success. Their paper lays out how that would change recommender practice. Evaluation would include the community's own measures. The work is a position and methods paper in computing. It speaks to builders of public-interest platforms.
Catalog record
| CREATOR | Michael D. Ekstrand, Afsaneh Razi, Aleksandra Sarcevic, Maria Soledad Pera, Robin Burke, Katherine Landau Wright |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-03792
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Recommending With, Not For Journal: TORS 8 Volume: TBA TBA 1 DOI: 10.1145/3759261 CCS: Human-centered computing Participatory design CCS: Human-centered computing HCI design and evaluation methods CCS: Information systems Recommender systems CCS: General and reference Evaluation Michael D. Ekstrand, Afsaneh Razi, Aleksandra Sarcevic, Maria Soledad Pera, Robin Burke, Katherine Landau Wright Abstract . Recommender systems are usually designed by engineers, researchers, designers, and other members of development teams. These systems are then evaluated based on goals set by the aforementioned teams and other business units of the platforms operating the recommender systems. This design approach emphasizes the designers’ vision for how the system can best serve the interests of users, providers, businesses, and other stakeholders. Although designers may be well-informed about user needs through user experience and market research, they are still the arbiters of the system’s design and evaluation, with other stakeholders’ interests less emphasized in user-centered design and evaluation. When extended to recommender systems for social good, this approach results in systems that reflect the social objectives as envisioned by the designers and evaluated as the designers understand them. Instead, social goals and operationalizations should be developed through participatory and democratic processes that are accountable to their stakeholders. We argue that recommender systems aimed at improving social good should be designed by and with , not just for , the people who will experience their benefits and harms. That is, they should be designed in collaboration with their users, creators, and other stakeholders as full co-designers, not only as user study participants. \fancypagestyleassign origstdstandardpagestyle \fancypagestyleassign origfirstfirstpagestyle Co-Designing Recommender Systems for Social Good † † cc-license: by-sa 1. Introduction Recommender systems have a substantial impact not only on the people who directly use them, but also on other stakeholders 1 1 1 We use the term “stakeholder” for familiarity and consistency with the multistakeholder recommendation literature ( Burke 2017 ; Abdollahpouri et al. 2017 ) . However, we note that this term is contested ( Sharfstein 2016 ) and obscures the varying power relationships that participatory design in its full form seeks to directly confront. and on the broader information and economic ecosystems in which they are embedded. As people use recommender systems to locate information, entertainment, goods, and services that meet their often personalized and contextual needs, the system has a pivotal role in providing or withholding exposure to providers and their content, influencing user perceptions of the information space and aiding or impeding access to different types of information. In practice, this means that recommender systems have the potential to promote diverse and equitable marketplaces ( Mehrotra et al. 2018 ) , influence users towards personally- and socially-beneficial activity ( Starke et al. 2017 ; Knijnenburg et al. 2016 ) , and advance other pro-social outcomes. However, recommender systems can also entrench established players, facilitate the spread of disinformation and propaganda, promote social division or unsustainable consumption practices, and generally catalyze societal harm ( Belkin and Robertson 1976 ; Milano et al. 2020 ) . Recommender systems research and development is carried out by the engineers, researchers, designers, and other development team members, typically employed by the owner of the platforms where the systems will be deployed (collectively, the recommender designers ). These designers are usually the primary agents in designing and evaluating recommendation experiences, and users are involved only as research subjects or occasionally through early-stage design activities such as focus groups. It is rare for users to be involved in the design of the system or in the design and interpretation of the evaluations used to validate it. Because evaluation and design are often based on observation of behavior, users have little opportunity to influence design or evaluation outside the behavioral measurements defined by the designers. Ekstrand and Willemsen 2016 critiqued this trend, calling for increased involvement of explicit user preferences, while Seaver 2018 examines recommendation and behavior through the lens of “trapping.” Current practice, however, overwhelmingly emphasizes the designers’ notions of what it means for the recommender system and its effects to be “good,” both for individual users and for society. As the recommender systems community looks beyond providing user and business benefit to projects that advance social good, the importance of incorporating diverse perspectives into research and development only increases. Recent work has sought to qualitatively understand the various human factors involved in recommendation ( Pera et al. 2024 ) and what users ( Harambam et al. 2019 ; Smith et al. 2020 ) , artists ( Ferraro et al. 2021 ) , and other stakeholders want from recommendation ( Bauer et al. 2024 , §4.4) . Stray et al. 2024 discussed the need for eliciting values from a wide range of perspectives and disciplines and incorporating them into the recommender design process, but the field so far has few examples of how to implement this in practice. In this paper, we examine who is, or can be, meaningfully empowered to determine the goals, methods, and design of recommender systems , both with respect to their ability to meet individual users’ needs and their impact on other people, organizations, and society. We argue that recommender systems should be designed in collaboration with users, providers, and other stakeholders as full co-designers instead of merely user study participants. Our claim is that to effectively support both individual and social good through recommendation, designers must fully involve the many different stakeholders of the recommender ecosystem — including the users it will serve, the providers whose content visibility it will affect, and others impacted by the system — in the process of designing and evaluating recommender systems. We build on and extend prior arguments that explicit user goals and preferences should be elicited and considered ( Ekstrand and Willemsen 2016 ; Lyngs et al. 2018 ) to propose engaging users, providers, and other stakeholders as designers and evaluators of recommender systems ( Charisi et al. 2022 ) . Recommender system design can and should be a collaborative, participatory effort where designers co-design the system with the people it will affect, an approach we call participatory recommendation . We develop this argument by first reviewing common practices, user-centric developments, and social concerns in recommender systems (§ 2 ) and providing a brief primer on the principle of co-design from human-computer interaction (§ 3 ). We then lay out our vision for co-design of recommender systems (§ 4 ), and describe the impact of this vision through several case studies across diverse domains and applications (§ 5 ). 2. Current Recommender System Design and Evaluation Practice Current practice in recommender system design and evaluation typically starts with the designer as the source of ideas and requirements for the recommendation experience. We briefly review this practice and the associated literature as a foundation for our argument about re-negotiating the power relationships in recommender design to enable participatory recommendation. 2.1. Design Lifecycle and Participants Figure 1. Diagram of typical recommender system design and evaluation process. A block diagram of recommender system process. In the top row, there is cloud on the left side labeled “Concept.” Arrows show the process progressing from “Concept” through “Development,” “Preliminary Evaluation,” and “Early User Testing,” all on the top row, and then to “Online trials (A/B,