Expanding ML-Documentation Standards For Better Security
1 st Cara Ellen Appel · 2025
Read Expanding ML-Documentation Standards For Better Security by 1 st Cara Ellen Appel (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12003.txt.
Introduction
Cara Ellen Appel, writing alone, argues that the standard write-ups for machine learning models and data need a section on security, in this 2025 arXiv article. Appel surveys how ML security stands and how teams record what they build. Few builders think much about security, write-up habits vary widely, and the shared formats are rarely used.
Two well-known formats, Model Cards and Datasheets for Datasets, say almost nothing about security. Appel proposes adding a fixed section to such formats, listing the facts that matter for safe use. The article lays out the expanded method and recommends it for all ML write-ups. Stronger security notes, the argument runs, are one concrete step toward closing the wider gap in ML safety.
Catalog record
| CREATOR | 1 st Cara Ellen Appel |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12003
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Expanding ML-Documentation Standards For Better Security 1 st Cara Ellen Appel Abstract This article presents the current state of ML-security and of the documentation of ML-based systems, models and datasets in research and practice based on an extensive review of the existing literature. It shows a generally low awareness of security aspects among ML-practitioners and organizations and an often unstandardized approach to documentation, leading to overall low quality of ML-documentation. Existing standards are not regularly adopted in practice and IT-security aspects are often not included in documentation. Due to these factors, there is a clear need for improved security documentation in ML, as one step towards addressing the existing gaps in ML-security. To achieve this, we propose expanding existing documentation standards for ML-documentation to include a security section with specific security relevant information. Implementing this, a novel expanded method of documenting security requirements in ML-documentation is presented, based on the existing Model Cards and Datasheets for Datasets standards, but with the recommendation to adopt these findings in all ML-documentation. I Introduction Every day, millions of cyberattacks are launched against internet users and organizations [ 29 ] . Cyberattacks aim to disrupt or take over control of systems and networks, as well as to steal, exploit or delete data involved in them [ 23 ] . The field of IT-security aims to protect the confidentiality, integrity and availability of data and systems [ 22 ] [ 32 ] . To achieve this, a number of different protections need to be implemented to secure any IT-system [ 23 ] [ 21 ] . AI has only become well-established in everyday technology usage in the past few years, as publicly accessible AI-technologies have become available directly to consumers. But the idea of creating artificially intelligent systems is an old one [ 24 ] . What largely contributed to the widespread application of AI within the last decade is the advent of machine learning, which significantly accelerated AI development and progress [ 24 ] . The importance and societal impact of AI continues to grow with it being increasingly used in critical systems [ 8 ] [ 28 ] . A failure in such a system might result in catastrophic consequences like the loss of human lives [ 28 ] . Machine learning is currently at the core of most artificial intelligence systems, and is one of the most developed and widely applicable fields in AI-research [ 27 ] . Organizations rely on ML-models more than ever for their operations, which has led to an ever-greater need for robust security to protect ML-systems [ 20 ] . Documentation is one area where steps towards better ML-security can be made. Security as a critical aspect of software quality should be discussed in documentation, although in practice this often is not the case, both for ML and traditional software [ 32 ] . But existing ML-documentation standards do not include security aspects and these standards often are not used by practitioners [ 7 ] [ 26 ] . Practitioners similarly do not include security aspects in ML-documentation in practice, due in large part to their lack of security awareness regarding ML-systems [ 8 ] [ 9 ] . We address the resulting clear need to close the gaps in ML-documentation regarding security in this paper, as well as discussing the larger problems facing ML-security. II Methodology We have conducted an extensive review of the existing literature in three main areas: ML-documentation (both its implementation in practice and the existing standards), ML-security and traditional software documentation. To identify relevant literature, we used Google Scholar due to its broad coverage of recent academic literature and its keyword search functionality. We searched for literature that was published from 2019 onwards, as a preliminary search of commonly cited research in these fields showed that almost all relevant research was conducted since then. We searched for articles with the following keywords, as we identified these as relevant to the topic of this paper: ‘ML’, ‘AI’, ‘standards’, ‘security’, ‘Adversarial Machine Learning’, ‘model’, ‘dataset’, ‘software documentation’. We searched for these terms individually as well as in various combinations like ‘ML security documentation’. Furthermore, we looked at the cited research in the articles we found through our search and, when relevant, also included these in our literature review. Chapters III to VI of this article discuss the state of the research based on our literature review. Chapter VII presents our proposed method of expanding existing ML-documentation standards to include security aspects, with the goal of raising the quality of security documentation for ML. This section draws on the results of the previous chapters. In chapter VIII we discuss challenges in implementing the proposed method, before concluding with recommendations for future work in chapter IX. III The Role of Documentation in IT-Security There are many different documentation standards for non-ML software, serving different purposes. These help practitioners create suitable high-quality documentation [ 4 ] . But while documentation guidelines for ML exist, they do not provide adequate guidance for practitioners on the same level as guidelines for traditional software do [ 4 ] . One of documentation’s main goals is for its corresponding software to fulfill all legal, compliance and technical requirements [ 4 ] . Documentation is the main resource used by practitioners to understand and evaluate software [ 10 ] . State of the art in documentation is the automated generation of software documentation with only minimal effort required from developers [ 3 ] . But this is not yet the reality for ML-documentation, even though some researchers have proposed more interactive methods of documentation for ML-models [ 12 ] . Documentation covers different aspects of a software system, including security. In regards to documenting the security aspects of a software system, one option is the creation of specific security documentation with a great level of detail regarding IT-security, the other is including security aspects in non security-specific documentation. This can help encourage all developers to take security considerations into account and reliably document their projects with security in mind [ 25 ] . Thus, a combined approach of using and creating both specific security documentation and more general documentation, which includes security concerns on a more basic level, is optimal [ 25 ] . The reality for ML-documentation is however a distinct lack of specific security-documentation standards, as well as the inclusion of few security aspects in general ML-documentation. This is the case both within existing standards, as well as within documentation created by practitioners [ 16 ] . IV The Current State of Security for AI and ML Both AI technologies and the world they exist in and draw data from are continuously changing and evolving, which makes safeguarding AI and more specifically ML a challenging task [ 1 ] . Cyberattacks on ML-systems occur significantly more frequently than many practitioners are aware of [ 36 ] . But, security continues being a minor factor in ML-development, often overlooked in favor of functionality, which is generally seen as most important [ 8 ] . Because of inadequate standards for securing ML-models and -systems as well as due to a lack of awareness from organizations, the security of ML-systems still depends largely