Computer-Aided Tagging on Wikimedia Commons: Designing for Human–AI Collaboration in Open Knowledge Work DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06

Yihan Yu, David W. McDonald · 2026

Read Computer-Aided Tagging on Wikimedia Commons: Designing for Human–AI Collaboration in Open Knowledge Work DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 by Yihan Yu, David W. McDonald (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30800.txt.

Introduction

Yu and McDonald study Wikimedia Commons writers' views with the Computer-Aided Tagging tool, an AI-assisted tagging system for discoverability, searchability, accessibility, and multilingual support. From 595 comments from 11 wiki pages and 16 interviews, they identify seven key issues behind the tool's mixed reception and final deactivation. They offer user-informed ideas for fixing the tool. The authors reflect on designing human-AI collaboration on Commons and developing AI tools for open knowledge work. The work extends understanding of human-AI collaboration beyond Anglophone, text-centric platforms.

Catalog record

CREATORYihan Yu, David W. McDonald
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE92861
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30800

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Computer-Aided Tagging on Wikimedia Commons: Designing for Human–AI Collaboration in Open Knowledge Work DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Yihan Yu, David W. McDonald Abstract . This study investigates Wikimedia Commons contributors’ lived experiences with the Computer-Aided Tagging (CAT) tool, an AI-assisted image tagging system designed to improve Commons’ discoverability, searchability, accessibility, and multilingual support. Using a qualitative analysis of 595 CAT-related community comments from 11 wiki pages and 16 in-depth interviews, we identify seven key issues that contributed to CAT’s mixed reception and eventual deactivation. We also offer community-informed suggestions for improving the tool. We reflect on the implications for designing human–AI collaboration on Commons and for developing AI-assisted tools that support open knowledge work. This work contributes to HCI and CSCW research by extending the understanding of human–AI collaboration beyond Anglophone, text-centric, corporate platforms. 1. Introduction Wikimedia Commons is one of the world’s largest repositories of free-to-use images and media files. It supports over 300 Wikipedia language editions and a global community of contributors and users. Commons has relied on a hierarchical category system as its primary infrastructure for organizing media. This system functions as a decentralized, volunteer-driven social tagging mechanism that allows contributors to manually annotate files using nested category tags. While categories support browsing, keyword-based search, and manual organization, Commons’ rapid growth has revealed persistent limitations in discoverability, semantic search, and multilingual access, largely because file metadata remains predominantly unstructured and English-dominant in practice. To address these limitations, the Wikimedia Foundation launched the Structured Data on Commons (SDC) project. SDC moves Commons metadata from unstructured plaintext into a structured, ontology-linked property–value statement model. It connects file annotations to Wikidata’s shared knowledge graph so that metadata can resolve to a globally consistent, community-maintained ontology. To support community adoption of SDC, the Foundation later introduced the Computer-Aided Tagging (CAT) tool. CAT was designed as a human-in-the-loop image-tagging assistant. It generates AI-suggested labels using the Google Cloud Vision API, maps those labels to language-agnostic Wikidata items, and presents them to Commons contributors for human verification. Contributors can review each suggestion and selectively publish confirmed labels as SDC Depicts statements, which are structured semantic claims that assert what is visually represented in a media file and link files to shared concepts defined in Wikidata. In doing so, CAT aimed to support semantic media search across languages and to make multimedia files more discoverable and reusable across Wikimedia projects. Prior research in HCI/CSCW has investigated human–AI collaboration on commercial, corporate-controlled platforms such as Facebook ( 9 ; 18 ) , Twitter ( 32 ) , and TikTok ( 13 ; 31 ; 9 ) . In the context of Wikimedia projects, prior research has primarily focused on AI/ML tools deployed in English Wikipedia that support indirect tasks, such as detecting vandalism ( 1 ) , evaluating contributions or article quality ( 10 ) , and suggesting tasks ( 5 ) . However, little is known about how human contributors and AI collaborate in a multilingual, community-governed platform with a focus on direct content creation rather than indirect tasks. In this study, we address this gap by presenting one of the first empirical accounts of the full lifecycle of a human–AI collaboration deployed within a volunteer-governed open knowledge ecosystem, where semantic tagging is central to direct knowledge creation. By studying CAT’s mixed reception and eventual deactivation as a consequential failed AI deployment, we treat failure as an empirical resource to reveal broader, generalizable CSCW insights into how legacy socio-technical infrastructures, community values, goals, and practices, participatory design approaches, and consensus-driven governance mechanisms interact with AI pipelines to shape collaboration breakdowns and possibilities for redesign in open knowledge ecosystems. Our findings generate community-informed design implications for future AI-assisted tools that seek to support SDC. In the following sections, we first introduce Wikimedia Commons, its category system, SDC, the CAT tool, and tagging practices on Commons. We then review related literature on AI/ML-assisted tools in Wikimedia projects and describe our methods, which include a qualitative analysis of Wiki discussions and participant interviews. The paper reports seven key issues that contributed to CAT’s mixed reception and eventual deactivation, along with community-informed suggestions for improving tool design and adoption. We conclude by discussing implications for human–AI collaboration on Commons and for AI-assisted tools supporting open knowledge work. 2. Background and Literature Review In this section, we introduce Wikimedia Commons, the Commons category system, SDC, and the CAT tool. We then define tagging on Commons and situate our research within the existing literature on the design of AI/ML-assisted tools in Wikimedia projects. 2.1. Wikimedia Commons Wikimedia Commons 1 1 1 https://commons.wikimedia.org/wiki/Commons:Welcome is one of the world’s largest online repositories of freely usable multimedia files, including images, audio, and video. Its content is contributed and curated by a global community of volunteers. According to recent statistics 2 2 2 https://commons.wikimedia.org/wiki/Special:Statistics , the platform hosts over 118 million files contributed by approximately 13 million users. Commons supports more than 300 Wikipedia language editions as well as other Wikimedia projects such as Wikivoyage, Wikispecies, and Wikiversity, while also serving the broader internet public. Despite its scale and importance, Commons remains relatively understudied and underappreciated in academic research ( 22 ; 33 ) , particularly in contrast to its sister project, Wikipedia. While both are examples of open knowledge work, prior work ( 34 ; 33 ) highlights key differences between the two. Wikipedia focuses on collaborative text production for an online encyclopedia, whereas Commons centers on the collection and curation of free-to-use multimedia. Although both platforms are built on the MediaWiki software, their functionalities, symbolic roles (reference vs. collection), and governance structures position them as fundamentally distinct socio-technical platforms, in line with Gillespie’s extended definitions of platform ( 8 ) . Overall, while Commons plays a critical infrastructural and cultural role within the Wikimedia ecosystem and the broader open knowledge landscape, it is uniquely characterized as a collaboration-for-reuse platform rather than a co-authoring platform ( 34 ; 33 ) . Unlike text-centric peer production systems such as Wikipedia, which converge on a single, relatively stable knowledge artifact, Commons supports ongoing, distributed collaboration in which contributors share, interpret, curate, and validate visual materials within diverse linguistic and cultural contexts. Its core coordination work centers on iterative negotiation over metadata, categorization, licensing, and cross-project image reuse, rather than the joint authorship of a single fixed object. Commons contributors do not co-produce a singular canonical artifact. Instead, they collectively construct and maintain evolving descriptive infrastructures that enable shared image sensemaking and support downstream reuse at global scale. These distinctive activities and collaboration dynamics make Commons an important and comparatively understudied site of inquiry for CSCW research. 2.2. Commons Category System Wikimedia Commons has relied for over twenty years on a hierarchical category system 3 3 3 https://commons.wikimedia.org/wiki/Commons:Categories as its primary infrastructure for organizing and navigating multimedia content. The system operates as a collaborative, decentralized social tagging mechanism. It allows contributors to manually apply hierarchical category tags to file metadata. Because multiple contributors can annotate the same file from diverse perspectives, the category system has supported distributed sensemaking and the bottom-up construction of a large-scale, broad folksonomy,

Read the complete text