Comprehensive Analysis of Transparency and Accessibility of ChatGPT, DeepSeek, and other SoTA Large Language Models

Ranjan Sapkota, Shaina Raza, Manoj Karkee · 2025

Read Comprehensive Analysis of Transparency and Accessibility of ChatGPT, DeepSeek, and other SoTA Large Language Models by Ranjan Sapkota, Shaina Raza, Manoj Karkee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-18505.txt.

Introduction

Ranjan Sapkota, Shaina Raza, and Manoj Karkee analyze, in twenty twenty-five, how open the leading large language models really are. Talk of open-source AI has grown, yet few studies test if top models meet the claim. A formal definition of open-source software now exists, but AI has its own quirks. A concern is open-washing: models claim openness while hiding key parts. That limits checking results, fixing bias, and adapting models to new fields. The team reviewed top models from the past five years, including ChatGPT, DeepSeek, and LLaMA.

They split openness into two kinds: open source and open weights. Even models labeled open source often hide their training data, code, and key metrics, they find.

Catalog record

CREATORRanjan Sapkota, Shaina Raza, Manoj Karkee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE100 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-18505

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Comprehensive Analysis of Transparency and Accessibility of ChatGPT, DeepSeek, and other SoTA Large Language Models Ranjan Sapkota, Shaina Raza, Manoj Karkee Abstract Despite increasing discussions on open-source Artificial Intelligence (AI), existing research lacks a discussion on the transparency and accessibility of state-of-the-art (SoTA) Large Language Models (LLMs). The Open Source Initiative (OSI) has recently released its first formal definition of open-source software. This definition, when combined with standard dictionary definitions and the sparse published literature, provide an initial framework to support broader accessibility to AI models such as LLMs, but more work is essential to capture the unique dynamics of openness in AI. In addition, concerns about open-washing, where models claim openness but lack full transparency, has been raised, which limits the reproducibility, bias mitigation, and domain adaptation of these models. In this context, our study critically analyzes SoTA LLMs from the last five years, including ChatGPT, DeepSeek, LLaMA, and others, to assess their adherence to transparency standards and the implications of partial openness. Specifically, we examine transparency and accessibility from two perspectives: open-source vs. open-weight models. Our findings reveal that while some models are labeled as open-source, this does not necessarily mean they are fully open-sourced. Even in the best cases, open-source models often do not report model training data, and code as well as key metrics, such as weight accessibility, and carbon emissions. To the best of our knowledge, this is the first study that systematically examines the transparency and accessibility of over 100 different SoTA LLMs through the dual lens of open-source and open-weight models. The findings open avenues for further research and call for responsible and sustainable AI practices to ensure greater transparency, accountability, and ethical deployment of these models. Journal: AI OPEN 1 Introduction Natural Language Processing (NLP) and Large Language Models (LLMs), including multimodal LLMs such as GPT-4o, DeepSeek-V2, and Gemini 1.5, have witnessed transformative advancements and significant growth in recent years, as illustrated by the surging global interest from both research and industry, as depicted in Figure 1 a Figure 1: Analysis of NLP/LLM Interest (a) Google Trends showing increasing interest in NLP and LLMs from 2015 to 2025; (b) Global interest for ChatGPT, Gemini, and DeepSeek on January 28 2025, highlighting DeepSeek’s rapid rise; (c) ChatGPT and Deepseek global interest on January 30, 2025; (d) Growth rates of open sourced and close closed souced LLMs Xu et al. (2025) ; (e) Percentage of arXiv papers mentioning open LLMs or closed LLMs from 2019 onwards, with BERT as a baseline Xu et al. (2025) These technologies have become integral to systems and solutions across a diverse array of sectors, including healthcare Cascella et al. (2023) , finance Li et al. (2023) , education Neumann et al. (2024) , and entertainment Qiu (2024) . Their remarkable capabilities in language understanding and generation have not only revolutionized these industries but have also spurred a new wave of innovation and application development Weldon et al. (2024) ; Grant et al. (2025) . Amidst this rapid expansion, the term “open-source” frequently surfaces within discussions about LLMs Kukreja et al. (2024) . However, this descriptor is often misapplied or misunderstood. In many instances, developers may release only the model weights, that is, the trained parameters, without sharing the comprehensive suite of model assets such as model card, training data, code, sustainability factors (e.g., CO 2 emissions), or detailed development processes. This gap is also widely discussed in the literature Ramlochan (2023) and in numerous tech blogs, including Walker II (2024) , to name a few. Although proprietary LLMs like OpenAI GPT-series (4/4o) Achiam et al. (2023) exhibit strong performance, their closed-source nature limits access to API-based interactions. In contrast, open-weight models like Meta LLama-series Touvron et al. (2023) provide downloadable model weights under non-proprietary licenses, enabling specialized deployments and cost-effective fine-tuning. For instance, Princeton’s Llemma leverages Code Llama for advanced mathematical modeling Azerbayev et al. (2023) , showcases the flexibility and cost benefits of open-weight models. The distinction between "open" and "closed" LLMs is evident in their adoption trends. Closed models like GPT-3 followed a linear growth pattern (gray bars, Figure 1 d), while open LLMs surged after Meta’s Llama release, driving exponential adoption (green and orange bars, Figure 1 d). Figure 1 e further illustrates how open source models increasingly attract scientific focus compared to the same with proprietary models such as GPT-4. Despite this growing interest, the term “open-source” has frequently been used interchangeably with “open weights”, leading to confusion in discussions about model accessibility. Many models labeled as open-source provide access only to their trained weights while withholding essential components such as training data, fine-tuning methodologies, and full implementation details. This distinction is critical, as true open-source models enable not just inference but also full transparency and reproducibility in AI research. A recent case highlighting the confusion between open-source and open-weight models is DeepSeek-R1 Guo et al. (2025) . Initially surpassing ChatGPT in search interest (Figure 1 b), its popularity rapidly declined (Figure 1 c), reflecting unmet expectations. While DeepSeek-R1 provides weights and partial code under the MIT license 1 1 1 https://opensource.org/license/mit , it lacks full open-source transparency, including access to training data and methodologies. This partial openness, common to models like ChatGPT and Google’s Gemini, allows broader usage compared to fully closed models, but restricts deeper architectural modifications, evaluation of biases, and further enhancement of the training processes and datasets. This ambiguity in AI terminologies necessitates clearer distinctions between open-source and open-weight models. True open-source AI requires full transparency, including training data and development processes, fostering reproducibility and ethical AI advancements. Defining and broadly adopting clear standards would enhance transparency, set realistic expectations, and promote responsible AI development. 1.1 Aim and Objectives The goal of this study is to critically examines transparency practices of such "open-weight" LLMs, using DeepSeek-R1 and ChatGPT4o as primary examples, to map the distinctions between open-weight and fully open-source models. By doing so, we aim to: 1. Elucidate the terminological ambiguities surrounding "open-source" within the AI domain, specifically distinguishing between truly open-source models and those termed "open-weight" which offer limited transparency. 2. Investigate the implications of partial transparency on the reproducibility, community engagement, and ethical dimensions of AI development, emphasizing how these factors influence the practical deployment and trustworthiness of LLMs. 3. Propose clearer guidelines and standards to differentiate truly open-source methodologies and models from strategies that merely provide access to pre-trained model weights. With this study, we seek to contribute to an informed advancement of responsible AI, where both technological innovation and collaborative transparency are harmonized. The following sections describe the current landscape of LLMs, the tensions between proprietary and open-weight models, and the broader impacts of these approaches on the AI research community. Figure 2: Overview of the methodologies used in evaluating ChatGPT, DeepSeek, and SoTA multimodal LLMs 2 Methodology This study systematically examines the concepts of openness and transparency in the development and dissemination of LLMs. A multi-stage approach is used in this study,beginning with a thorough examination of foundational concepts and progressing through detailed analyses of licensing types and transparency definitions as they relate to AI systems. 2.1 Research Design This study adopts a multi-stage research design to evaluate the openness and transparency of SoTA

Read the complete text