Securing the AI Supply Chain: What Can We Learn From Developer-Reported Security Issues and Solutions of AI Projects? Conference: 48th International Conference on Software Engineering; April 12–18, 2026; Rio De Janeiro, Brazil DOI: XXXXXXX.XXXXXXX CCS: Security and privacy Software and application s

The Anh Nguyen, Triet Huynh Minh Le, M. Ali Babar · 2025

Read Securing the AI Supply Chain: What Can We Learn From Developer-Reported Security Issues and Solutions of AI Projects? Conference: 48th International Conference on Software Engineering; April 12–18, 2026; Rio De Janeiro, Brazil DOI: XXXXXXX.XXXXXXX CCS: Security and privacy Software and application s by The Anh Nguyen, Triet Huynh Minh Le, M. Ali Babar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23385.txt.

Introduction

The Anh Nguyen, Triet Huynh Minh Le, and M. Ali Babar mine developer discussions to chart real security problems of AI projects. AI builders face ordinary software supply chain risks plus novel threats against models and data, yet little was known about which issues practitioners hit and how they fix them. The authors gathered discussions from Hugging Face and GitHub, filtering them with a pipeline that pairs keyword matching with a fine-tuned classifier chosen after comparing models.

The pipeline produced a dataset of more than three hundred thousand security discussions. A thematic analysis of a sample yielded thirty-two security issues and twenty-four solutions across software, external tools, models, and data. Many problems trace to tangled dependencies and black-box AI components. Model and data issues often lacked solutions. The authors offer the taxonomy as evidence-based guidance for securing links of the AI supply chain.

Catalog record

CREATORThe Anh Nguyen, Triet Huynh Minh Le, M. Ali Babar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-23385

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Securing the AI Supply Chain: What Can We Learn From Developer-Reported Security Issues and Solutions of AI Projects? Conference: 48th International Conference on Software Engineering; April 12–18, 2026; Rio De Janeiro, Brazil DOI: XXXXXXX.XXXXXXX CCS: Security and privacy Software and application security The Anh Nguyen, Triet Huynh Minh Le, M. Ali Babar Abstract . The rapid growth of Artificial Intelligence (AI) models and applications has led to an increasingly complex security landscape. Developers of AI projects must contend not only with traditional software supply chain issues but also with novel, AI-specific security threats. However, little is known about what security issues are commonly encountered and how they are resolved in practice. This gap hinders the development of effective security measures for each component of the AI supply chain. We bridge this gap by conducting an empirical investigation of developer-reported issues and solutions, based on discussions from Hugging Face and GitHub. To identify security-related discussions, we develop a pipeline that combines keyword matching with an optimal fine-tuned distilBERT classifier, which achieved the best performance in our extensive comparison of various deep learning and large language models. This pipeline produces a dataset of 312,868 security discussions, providing insights into the security reporting practices of AI applications and projects. We conduct a thematic analysis of 753 posts sampled from our dataset and uncover a fine-grained taxonomy of 32 security issues and 24 solutions across four themes: (1) System and Software, (2) External Tools and Ecosystem, (3) Model, and (4) Data. We reveal that many security issues arise from the complex dependencies and black-box nature of AI components. Notably, challenges related to Models and Data often lack concrete solutions. Our insights can offer evidence-based guidance for developers and researchers to address real-world security threats across the AI supply chain. 1. Introduction With the emergence of Artificial Intelligence (AI)-enabled software, developers of these projects face unique security challenges due to the growing complexity of the AI supply chain. They contend with not only the risks inherited from traditional software, e.g., vulnerable dependencies and insecure coding practices ( 70 ) , but also novel AI-specific threats such as adversarial manipulations ( 68 ) . Consequently, multiple high-level risk frameworks, e.g., the OWASP Top 10 for Large Language Models (LLMs) Applications ( 28 ) , have been developed. These frameworks provide valuable guidance on the theoretical dimensions of AI supply chain risks. However, a significant gap remains between these theoretical frameworks and concrete security problems across different AI supply chain components that developers actually face. Specifically, it is unclear what security issues are commonly encountered, what challenges they pose, and how developers can effectively mitigate or resolve them. Discussions on open-source platforms such as Hugging Face (HF) and GitHub (GH) can provide insights into real-world security issues in different components of AI-enabled projects. These platforms are central hubs where developers not only share models, code, and datasets but also engage in critical discussions that drive innovation and problem-solving ( 22 ; 42 ) . Security-wise, discussions on these platforms include the security of application, source code, and infrastructure on GH ( 67 ; 9 ; 36 ) , as well as the security of AI models, e.g., model serialization vulnerabilities on HF ( 65 ) . An example of such security-related discussions is the Ultralytics supply chain attack report ( 81 ) , where multiple issues were raised from downstream projects ( 72 ; 50 ; 60 ) when developers found that the model package was compromised to install crypto miners. This attack demonstrates how a single vulnerability in the AI supply chain can have widespread consequences. The community discussions raised during the attack have proven to be critical data sources in understanding the practical security landscape for developing AI-enabled projects. However, to the best of our knowledge, there is no prior empirical effort to identify and analyze these large-scale discussions to distill real-world security issues that affect the AI supply chain and potential solutions to address these issues. Our study bridges these gaps by empirically investigating security issues and solutions raised by developers on open-source platforms. We propose a new pipeline combining keyword matching and an optimal fine-tuned distilBERT model, selected from a wide range of tested deep learning and large language models, to identify security-related discussions on HF and GH. Using this pipeline, we have identified a large-scale dataset of 312,868 security-related discussion posts, enabling representative sampling for our subsequent qualitative analysis. We leverage these posts to characterize security reporting practices in AI-enabled projects. We then perform a thematic analysis of 753 sampled posts to manually construct a fine-grained taxonomy, capturing real-world AI security issues and corresponding solutions. These analyses provide synthesized insights to inform the integration of security into the development and maintenance of AI projects. Our key contributions are: • To the best of our knowledge, we present the first empirical study on real-world security issues and solutions in the AI supply chain using developer discussions on HF and GH. • We empirically evaluate various DL models and LLMs to select the best classifier (MCC: 0.79) to curate a comprehensive dataset of AI security discussions. We reveal an exponential growth in security issues that far outpaces formal CVE reporting, and are more commonly found in text generation and foundation models. • We develop a taxonomy of 32 security issues and 24 solutions across AI components (System and Software, External Tools and Ecosystem, Model, and Data). We find that many AI-specific vulnerabilities stem from the complex dependencies and data flows in AI-enabled projects, with dependency incompatibilities and unsafe deserialization among the most frequent issues. The black-box nature of models and data further introduces unique security problems, such as malicious output generation and sensitive data leakage. Critically, we observe a significant gap between identified issues and available solutions in the Models and Data themes, where fixes are scarce and are often indirect. We also uncover the cross-cutting nature of solutions, as issues in one domain are often resolved by fixes in another. Overall, our findings highlight the need for a holistic view of the AI supply chain, and provide recommendations for securing AI-enabled projects. • We release our source code, models, datasets as a replication package ( 55 ) , and our full taxonomy is publicly available at ( 54 ) . 2. Related Work and Motivation 2.1. Security of the AI supply chain Security challenges of the AI supply chain have become increasingly prominent due to the proliferation of reusable components. While the software supply chain focuses primarily on source code dependencies ( 70 ) , the AI supply chain encompasses not only software components but also unique AI assets such as models, datasets, and specialized development platforms ( 24 ) . This makes AI systems susceptible not only to traditional vulnerabilities but also to novel attacks, e.g., model poisoning and data manipulations ( 12 ; 92 ; 41 ; 80 ; 68 ) . All of these problems fall under a broad definition of AI security issues , i.e., any adversarial or accidental conditions that undermine the confidentiality, integrity, availability, and, in turn, the trustworthiness of AI assets and systems ( 33 ; 66 ; 6 ) . We adopt this definition consistently

Read the complete text