AI Policy, Disclosure, and Human in the Loop: How Are Contribution Guidelines Adapting to GenAI?

Andre Hora, Romain Robbes · 2026

Read AI Policy, Disclosure, and Human in the Loop: How Are Contribution Guidelines Adapting to GenAI? by Andre Hora, Romain Robbes (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16706.txt.

Introduction

Hora and Robbes survey how open-source projects adapt contribution rules to generative AI. From 1,000 popular GitHub repositories they identify 118 AI policies for contributors. Most policies, 78%, allow AI-assisted contributions, while 22% discourage AI use. About half require disclosure of AI help, and 74% require a human in the loop. The authors conclude that project rules are broadly positive toward generative AI, with disclosure and human oversight treated as fundamental.

Catalog record

CREATORAndre Hora, Romain Robbes
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27227
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16706

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AI Policy, Disclosure, and Human in the Loop: How Are Contribution Guidelines Adapting to GenAI? Andre Hora, Romain Robbes Abstract Generative AI (GenAI) has recently transformed software development. Due to the ease of generating code, open source projects are experiencing a growth in contributions. To address the rise of GenAI, open source projects have begun implementing policies for AI usage in contributions. However, the extent to which open source specifies whether AI-assisted contributions are allowed or prohibited, along with the best practices for contributors, remains unclear. This paper provides an initial empirical study to explore how open source projects are adapting to GenAI contributions. We analyzed 1,000 popular GitHub repositories and identified 118 AI policies for contributors. Our results show that (1) 78% of the AI policies allow contributions generated with GenAI, while 22% explicitly discourage their use; (2) 51% of the AI policies require the disclosure of AI-generated contributions; and (3) 74% of the AI policies require a human in the loop during contribution. Overall, we find that the majority of the analyzed AI policies are positive regarding the usage of GenAI. However, AI disclosure and human in the loop are fundamental in the contribution process. Finally, we conclude by discussing implications for developers and researchers. I Introduction Generative AI (GenAI) has transformed how software is designed, developed, and engineered [ 35 , 37 ] . Coding agents such as Claude Code, Cursor, and Codex have seen rapid recent adoption, operating with a high degree of autonomy ; for example, they can invoke external tools, execute code, and complete end-to-end development tasks [ 46 ] . A recent study of over 128k projects estimates that coding agent adoption on GitHub ranges from 22.20% to 28.66% [ 45 ] . Due to the ease of generating code, open source projects are experiencing a growth in contributions [ 49 , 43 , 51 , 29 ] . The volume contributions partially or entirely AI-generated have outpaced the maintenance capacity of many projects, creating debates within the open source community [ 51 , 42 , 40 , 44 ] . As a result, maintainers often lack sufficient capacity to review submissions effectively [ 51 ] . AI-generated contributions may also lack quality—a phenomenon known as AI slop, which refers to low-quality content produced at scale using AI [ 48 , 29 , 28 ] . To address the rise of generative AI, open source projects have begun implementing policies for AI usage in contributions. Several open source projects have established AI policies, including Linux [ 39 ] , Fedora [ 36 ] , and LLVM [ 41 ] . Figure 1 presents the AI policy of the Ghostty project, which states that AI-generated contributions are allowed provided they are disclosed and include human involvement in the contribution process. 1 1 1 https://github.com/ghostty-org/ghostty/blob/main/AI_POLICY.md FastAPI contribution guidelines state that low-effort or low-quality pull requests are not accepted, and that AI-generated submissions may be closed and accounts blocked. 2 2 2 https://fastapi.tiangolo.com/contributing/#automated-code-and-ai Some projects are more welcoming toward generative AI. For instance, the AI policy of huggingface/transformers states that “ AI-assisted contributions are welcome ” [ 15 ] . In contrast, other projects are more restrictive, for example, the 9001/copyparty policy states: “ Do not use AI / LLM when writing code ” [ 2 ] . However, the extent to which open source projects specify whether AI-assisted contributions are allowed or prohibited, along with the best practices contributors are expected to follow, remains unclear. Fig. 1 : AI policy of project ghostty-org/ghostty. This short paper provides an initial empirical study to explore how open source projects are adapting to generative AI contributions. We analyzed 1,000 popular GitHub repositories and identified 118 AI policies for contributors. We propose three research questions to address AI policy, AI disclosure, and human involvement in contributions: • RQ1. How do open source projects address the use of generative AI in contributions? Overall, 78% of the AI policies allow contributions generated with generative AI, while 22% explicitly discourage their use. • RQ2. How do open source projects address disclosure of AI-assisted contributions? We find that 51% of the AI policies require the disclosure of AI-generated contributions. • RQ3. How do open source projects address human involvement in AI-assisted contributions? 74% of the AI policies require a human in the loop during contribution. Overall, we find that the majority of the analyzed AI policies are positive regarding the usage of generative AI. However, AI disclosure and human in the loop are fundamental in the contribution process. AI disclosure is important to support maintainers during the review process, enabling them to verify AI-generated content more effectively. The human in the loop reinforces the idea that contributors remain responsible for the code they submit. Based on our findings, we discuss implications for practitioners and researchers, including the lack of clear guidance in AI policies, practices for AI disclosure, and the growing concern around AI slop. Dataset availability: [ 1 ] . II Study Design II-A Initial Set of Repositories Our goal is to analyze real-world, actively maintained repositories hosted on GitHub. To this end, we rely on the SEART GitHub Search Engine (seart-ghs), a tool that allows researchers to sample repositories to use for empirical studies by using multiple combinations of selection criteria [ 32 ] . This tool maintains metadata for all GitHub repositories with at least ten stars. Based on seart-ghs, we selected the top 1,000 repositories with the most stars that meet the following criteria: at least 100 commits, not being forks, and having at least one commit in 2026 (the star metric is primarily adopted in the software mining literature as a proxy of popularity [ 30 , 47 ] ). II-B Detecting Repositories with AI Policy We define an AI policy as any set of rules governing AI usage for contributors. From the initial set of repositories, we identified those containing AI policies using two complementary methods: (1) Contribution guideline files containing AI policies and (2) Explicit AI policy files. 1. Contribution guideline files containing AI policies. We verified the presence of contribution guideline files CONTRIBUTING.md and DEVELOPING.md with AI policies [ 34 ] . Specifically, we looked for generative AI–related terms ( LLM , generative AI , GenAI , AI , AI agents ) as signs of AI policy. In addition, when performing this analysis, we observed that some repositories use GitHub guideline files primarily to redirect contributors to external documentation. For instance, in FastAPI, the CONTRIBUTING.md 3 3 3 https://github.com/fastapi/fastapi/blob/master/CONTRIBUTING.md file points to a separate contributing documentation. To find such cases, we also analyzed external contributing documentation whenever the GitHub guideline files included a single link, checking for the presence of generative AI–related terms in those sources as well. In total, we identified 752 repositories with contribution guideline files, of which 158 included generative AI–related terms. We then manually reviewed these 158 cases and found 45 false positives (e.g., AI/LLM-focused projects, benchmarks, and datasets) and 113 true positives, i.e., repositories that actually include AI policies for contributors. 2. Explicit AI policy files. We also checked for the presence of the standard AI policy file AI_POLICY.md . In addition, we included two other AI policy files: LLM_POLICY.md

Read the complete text