Position Paper: Model Access should be a Key Concern in AI Governance
Edward Kembery, Ben Bucknall, Morgan Simpson · 2024
Read Position Paper: Model Access should be a Key Concern in AI Governance by Edward Kembery, Ben Bucknall, Morgan Simpson (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00836.txt.
Introduction
Edward Kembery, Ben Bucknall, and Morgan Simpson argued in a 2024 position paper that model access should be a key concern in AI governance. What an AI system ends up doing, for good or ill, depends heavily on who can reach it and in what form. Yet the downstream effects of access choices are poorly understood, so officials must decide with thin evidence.
The authors spotlight a field they call model access governance, devoted to responsible, evidence-based access decisions. They lay out the risks of getting access wrong, the limits of current research, and the chance to do better. Four sets of recommendations address evaluation groups, frontier AI firms, governments, and world bodies. Readers get an agenda for treating access itself as a policy lever, rather than an afterthought to model release.
Catalog record
| CREATOR | Edward Kembery, Ben Bucknall, Morgan Simpson |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-00836
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Position Paper: Model Access should be a Key Concern in AI Governance Edward Kembery, Ben Bucknall, Morgan Simpson Abstract The downstream use cases, benefits, and risks of AI systems depend significantly on the access afforded to the system, and to whom. However, the downstream implications of different access styles are not well understood, making it difficult for decision-makers to govern model access responsibly. Consequently, we spotlight Model Access Governance, an emerging field focused on helping organisations and governments make responsible, evidence-based access decisions. We outline the motivation for developing this field by highlighting the risks of misgoverning model access, the limitations of existing research on the topic, and the opportunity for impact. We then make four sets of recommendations, aimed at helping AI evaluation organisations, frontier AI companies, governments and international bodies build consensus around empirically-driven access governance. Introduction The rapid development of general-purpose AI has led to discussions and significant legislative efforts focused on governing the technology to minimise societal harm while promoting objectives such as economic growth and respect for diverse cultural norms [ 1 , 2 , 3 , 4 ] . A key question has concerned which aspects of models to make available and to whom [ 5 , 6 , 7 , 8 ] . Access provisions can vary: some model developers might offer the public a chat interface, while others may share model weights or training data. Access can also be distributed differently between different stakeholders, including internal company members, regulators, AI safety organisations, third-party researchers, and the public. These decisions form the basis of governing model access. Poor model access governance could have serious consequences. Insufficiently cautious information release could increase risks [ 7 , 9 , 8 ] , while overly restrictive policies could centralise power or stifle critical research [ 10 , 11 , 12 ] . Experts have argued that both risks may become more likely over time, and could be difficult to reverse [ 7 , 11 ] . Failing to establish good governance principles early could lead to new risks, such as those from unsafeguarded dangerously powerful publicly available models, which would be more challenging to mitigate [ 9 ] . Despite this urgency, decision-makers in frontier AI companies and governments are ill-equipped to govern model access due to limited research, lack of empirical data, and inadequate conceptual clarity. Significant legislation acknowledges the need for risk-proportional model release [ 13 ] , but no clear guidance exists on how deployers should manage different access styles [ 2 , 3 ] . There also remains substantial uncertainty regarding the use cases afforded by different access styles, and the real-world impacts they could have on various stakeholders [ 14 ] . Resolving these uncertainties will require the work of a dedicated field aimed at gathering empirical data on these outstanding questions. We consequently spotlight "Model Access Governance", an emerging field focused on answering the questions needed for organisations and governments to make responsible, evidence-based access decisions. As a domain of AI Governance research [ 15 ] , this field would develop policies, norms, laws, and institutions to determine who accesses which features of AI models and under what conditions. We argue that the risks of mismanagement are significant, current understanding of different model access styles and their implications is limited, and improving this understanding through further research could improve decision-making. We consequently make four recommendations to improve understanding around key issues in Model Access Governance, namely that: i) AI organisations extend evaluations across different access styles, ii) frontier AI companies commit to following responsible best practices, (iii) governments work to coordinate research on downstream implications, and iv) international organisations work to build consensus around empirically-driven access governance. Two appendix sections then set out six priority areas for future research and review existing work related to Model Access Governance. 1 Defining Model Access Governance Model Access : A term describing the manner in which individuals, organisations, and systems can interact with or inspect different aspects of an AI model. This involves three components (see Fig. 1). Model Aspects : AI models are comprised of components including code and weights [ 16 ] . They serve as the foundation of AI systems , which include infrastructure such as GPUs and user interfaces [ 16 , 3 ] . Developers must decide which model components and broader information—such as training data or outputs—to share with different groups. We refer to these components as model aspects . Access Styles: When a developer provides access to a model aspect with specific permissions or usage restrictions, we term this an access style. Bucknall and Trager (2023) outline key access styles, including sampling, inspecting, fine-tuning, and modifying [ 17 ] . However, not all model aspects support all access styles, and different or future models may enable new ones. Thus, existing taxonomies should be viewed as provisional. Access Groups: An AI developer might decide to make particular aspects of a model or particular access styles available to particular groups with distinct needs, permissions, goals, or capabilities, referred to here as access groups . Access groups might include intracompany groups, governments and AISIs, trusted third-party auditors and industry partnerships, research communities, and the general public. Figure 1 : The Three Elements of Model Access Model Access Governance : Governing model access refers to the process of making decisions as to which access groups should have what styles of access to which model aspects under what circumstances. Model Access Governance refers to an emerging research field looking to systematise and build on existing research to build evidence and develop concepts, policies, norms, laws, and institutions that help actors make these decisions better achieve diverse societal objectives. For further information about open problems in Model Access Governance and a broader review of related work, see the Appendix. 2 The Case for Developing Model Access Governance Our case for Model Access Governance is based on three propositions. i) Misgoverning model access could have serious consequences; ii) there is a lack of expert consensus about how to govern model access; and iii) insights and evidence provided by further targeted research can help decision-makers govern model access more effectively. This section expands on each proposition in turn. 2.1 Misgoverning model access could have serious consequences Whilst governing model access incautiously could lead to societal harms, to do so too cautiously could create significant opportunity costs. In the first case, it is already well established that powerful AI systems might have the potential to cause significant societal harms, whether via misuse or accident [ 4 , 18 ] . However, miscalibrated access governance might make these risks significantly worse, for three main reasons: • Incautious access policies could make models easier to jailbreak and augment . Most leading contemporary models are straightforward to jailbreak using text-based commands [ 19 ] . However, future models might be significantly more robust to attacks afforded by some styles of access than others [ 20 , 21 ] . Releasing more information about these more powerful models–for instance, internal chains of thought [ 20 ] –might make them more vulnerable to jailbreaks and enhancements, increasing the risk of more frequent and serious harm [ 22 ] . Furthermore,