Navigating Uncertainties: Understanding How GenAI Developers Document Their Models on Open-Source Platforms DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze

Ningjing Tang, Megan Li, Amy Winecoff*, Michael Madaio*, Hoda Heidari †, Hong Shen † · 2025

Read Navigating Uncertainties: Understanding How GenAI Developers Document Their Models on Open-Source Platforms DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze by Ningjing Tang, Megan Li, Amy Winecoff*, Michael Madaio*, Hoda Heidari †, Hong Shen † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-23574.txt.

Introduction

Open-source platforms now host a flood of generative models, and the model cards documenting them are the main window the public has into their risks. Ningjing Tang and co-authors ask the writers of those cards how the work actually goes in a 2025 study. They interviewed thirteen developers active on open-source platforms.

Three layers of uncertainty emerged: what content a card should include, how to report the key components well, and who owns each part of the job. Platform guidelines exist, but developers still improvised around them. The authors draw lessons for policymakers, platforms, and researchers who want documentation that is meaningful rather than decorative. The study treats documentation as a practice shaped by doubt, not a form filled in once.

Catalog record

CREATORNingjing Tang, Megan Li, Amy Winecoff*, Michael Madaio*, Hoda Heidari †, Hong Shen †
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-23574

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Navigating Uncertainties: Understanding How GenAI Developers Document Their Models on Open-Source Platforms DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered computing HCI design and evaluation methods CCS: Human-centered computing Empirical studies in HCI Ningjing Tang, Megan Li, Amy Winecoff*, Michael Madaio*, Hoda Heidari †, Hong Shen † Abstract . Model documentation plays a crucial role in promoting transparency and responsible development of AI systems. With the rise of Generative AI (GenAI), open-source platforms have increasingly become hubs for hosting and distributing these models, prompting platforms like Hugging Face to develop dedicated model documentation guidelines that align with responsible AI principles. Despite these growing efforts, there remains a lack of understanding of how developers document their GenAI models on open-source platforms. Through interviews with 13 GenAI developers active on open-source platforms, we provide empirical insights into their documentation practices and challenges. Our analysis reveals that despite existing resources, developers of GenAI models still face multiple layers of uncertainties in their model documentation: (1) uncertainties about what specific content should be included; (2) uncertainties about how to effectively report key components of their models; and (3) uncertainties in deciding who should take responsibilities for various aspects of model documentation. Based on our findings, we discuss the implications for policymakers, open-source platforms, and the research community to support meaningful, effective and actionable model documentation in the GenAI era, including cultivating better community norms, building robust evaluation infrastructures, and clarifying roles and responsibilities. 1 1 footnotetext: ∗ Co-third authors contributed equally to this work. 2 2 footnotetext: † Co-last authors contributed equally to this work. 1. Introduction Model documentation like Model Cards ( Mitchell et al. 2018 ) has long been considered as a key mechanism for enhancing AI transparency and accountability by the broader responsible AI (RAI) community ( Winecoff and Bogen 2024 ; Liao et al. 2023 ; Liao and Vaughan 2023 ) . The emergence of Generative AI (GenAI) has amplified both the complexity and importance of model documentation. On the one hand, unlike traditional AI/ML systems designed for specific tasks, GenAI models present unique documentation challenges due to their broad capabilities, emergent behaviors, and potential for unexpected outputs. These challenges intersect with what researchers have termed the “evaluation crisis”—the growing difficulty in predicting and measuring model performance across diverse tasks and contexts ( Xiao et al. 2024 ; Ganguli et al. 2022a ; Chang et al. 2023 ; Wallach et al. 2024 ; Grill 2024 ; Hutchinson et al. 2022 ) . On the other hand, these unique characteristics and rapid development have also spurred new regulatory initiatives, such as the EU AI Act’s code of practice for general-purpose models ( AIA [n. d.] ) , which aims to standardize documentation requirements for these systems. With the proliferation of GenAI systems, open-source platforms have emerged as central hubs for hosting, sharing, and deploying these models ( Srikumar et al. 2024 ) . Far from serving merely as code repositories, these platforms function as dynamic ecosystems where models are collaboratively developed, modified, and applied across diverse contexts ( Gorwa and Veale 2023 ) . This shift has driven initiatives like Hugging Face’s dedicated model documentation guidelines ( Face 2024a ) , which seek to align open-source practices with RAI principles. Prior work in the HCI and FAccT communities has offered critical guidelines and frameworks to help AI/ML practitioners document their models and facilitate stakeholder communication ( Mitchell et al. 2018 ; Crisan et al. 2022 ; Mohammad 2021 ; McMillan-Major et al. 2021 ) . Since the introduction of these frameworks, researchers have investigated their value and implementation, through both lab-based studies ( Liao and Vaughan 2023 ; Boyd 2021 ; Nunes et al. 2022 ; Nunes et al. 2024 ; McMillan-Major et al. 2024 ) and real-world investigations ( Yang et al. 2024 ; Liang et al. 2024 ; Heger et al. 2022 ; Chang and Custis 2022 ; Bhat et al. 2023 ) . While these studies provide important insights into how documentation has been performed in corporate and research settings ( Chang and Custis 2022 ; Heger et al. 2022 ) , little is known about documentation practices in the open-source ecosystem, which might pose unique challenges—particularly with GenAI models. Meanwhile, recent large-scale studies have highlighted widespread insufficiencies and incompleteness in documentation artifacts on open-source platforms ( Liang et al. 2024 ; Winecoff and Bogen 2024 ) . However, these studies focus primarily on the artifacts themselves, leaving limited understanding of the underlying reasons for these gaps and how developers on these platforms approach and practice documentation. Finally, while extensive research has examined how open-source software developers document code and leverage documentation for peer knowledge sharing ( Guzzi 2012 ; Rai et al. 2022 ; Kadhim 2024 ; Sharma et al. 2022 ) , there remains a critical gap in understanding how traditional code documentation practices adapt to the unique demands of GenAI models. Our study addresses these gaps by exploring how GenAI developers navigate documentation practices in open-source contexts, uncovering the distinct challenges and emerging practices that characterize this rapidly evolving field. In this paper, we ask the following research questions: How do developers of GenAI document their models on open-source platforms? What are the challenges they face in this process? To answer these questions, we conducted semi-structured interviews with 13 developers who had experiences in documenting GenAI models on open-source platforms. Our findings reveal that despite existing resources ( Mitchell et al. 2018 ) , developers still face significant uncertainties in three key areas: determining what content to include in documentation, figuring out how to effectively document different aspects of their models, and establishing who should be responsible for various documentation components. We find that these uncertainties are shaped by competing pressures among traditional open-source documentation norms, market-driven interests, and emerging RAI guidelines. By illuminating these uncertainties and the underlying tensions that contribute to them, this work advances our understanding of documentation practices in the evolving landscape of GenAI development on open-source platforms. Based on our findings, we further discuss implications for policymakers, open-source platforms, and RAI researchers to support more meaningful, effective, and actionable model documentation in the GenAI era, including fostering stronger community norms, building robust evaluation infrastructures, and clarifying roles and responsibilities. More broadly, this work contributes to the growing discussions on achieving meaningful transparency and accountability in AI development within existing open-source community norms and practices. 2. Background and Related Work 2.1. AI/ML Documentation as Responsible AI Artifacts AI/ML documentation has been considered as a key mechanism for enhancing AI transparency and accountability by the Responsible AI (RAI) community ( Liao et al. 2023 ; Liao and Vaughan 2023 ; Mitchell et al. 2018 ) . Past RAI literature in CHI, FAccT, and other conferences have proposed specialized documentation approaches, including data documentation ( Gebru et al. 2018 ; Jain et al. 2024 ; Bender and Friedman 2018 ) , model documentation ( Mitchell et al. 2018 ; Crisan et al. 2022 ; Mohammad 2021 ; McMillan-Major et al. 2021

Read the complete text