Glucose-ML: A collection of longitudinal diabetes datasets for development of robust AI solutions

Temiloluwa Prioleau, Baiying Lu, Yanjun Cui · 2025

Read Glucose-ML: A collection of longitudinal diabetes datasets for development of robust AI solutions by Temiloluwa Prioleau, Baiying Lu, Yanjun Cui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-14077.txt.

Introduction

Temiloluwa Prioleau, Baiying Lu, and Yanjun Cui present Glucose-ML, a collection of diabetes datasets for AI research, in a 2025 paper. AI tools for diabetes care need large, high-quality data, and a lack of shared data slows progress. Their collection gathers ten public datasets released in recent years.

Together the sets hold hundreds of thousands of days of continuous glucose readings from thousands of people in four countries. Users include people with type 1, type 2, and pre-diabetes, plus people without diabetes. The team compares the sets to guide data choice and benchmarks one prediction task across all of them. The same method scored very differently by dataset.

Catalog record

CREATORTemiloluwa Prioleau, Baiying Lu, Yanjun Cui
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-14077

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Glucose-ML: A collection of longitudinal diabetes datasets for development of robust AI solutions Temiloluwa Prioleau, Baiying Lu, Yanjun Cui Abstract Artificial intelligence (AI) algorithms are a critical part of state-of-the-art digital health technology for diabetes management. Yet, access to large high-quality datasets is creating barriers that impede development of robust AI solutions. To accelerate development of transparent, reproducible, and robust AI solutions, we present Glucose-ML, a collection of 10 publicly available diabetes datasets, released within the last 7 years (i.e., 2018 - 2025). The Glucose-ML collection comprises over 300,000 days of continuous glucose monitor (CGM) data with a total of 38 million glucose samples collected from 2500+ people across 4 countries. Participants include persons living with type 1 diabetes, type 2 diabetes, prediabetes, and no diabetes. To support researchers and innovators with using this rich collection of diabetes datasets, we present a comparative analysis to guide algorithm developers with data selection. Additionally, we conduct a case study for the task of blood glucose prediction - one of the most common AI tasks within the field. Through this case study, we provide a benchmark for short-term blood glucose prediction across all 10 publicly available diabetes datasets within the Glucose-ML collection. We show that the same algorithm can have significantly different prediction results when developed/evaluated with different datasets. Findings from this study are then used to inform recommendations for developing robust AI solutions within the diabetes or broader health domain. We provide direct links to each longitudinal diabetes dataset in the Glucose-ML collection and openly provide our code: https://anonymous.4open.science/r/GlucoseML_Diabetes_Datasets_NeurIPS2025-F5FC/ . 1 Introduction An artificial intelligence (AI) algorithm is only as good as the data used for development and evaluation. As a result, access to high-quality datasets is a precursor for building robust AI algorithms. This fundamental principle motivates the growing effort to increase access to high-quality datasets and in so doing increase the transparency, reproducibility, generalizability, fairness, and robustness of AI algorithms, especially in human-centered domains like healthcare [ 91 , 85 , 79 , 18 , 71 ] . Yet, access to large high-quality datasets is a challenge in many health domains where a patients’ privacy and security is critical. This challenge motivates the target goal of making large volumes of health-relevant data accessible for research while minimizing potential risks and threats [ 55 , 111 , 83 ] . Diabetes is an exemplar health domain in which AI algorithms are a critical part of state-of-the-art technology (e.g. for screening, decision-support, and management [ 41 , 22 , 30 , 37 , 102 , 81 ] ). The prevalence of digital health technology, such as wearable continuous glucose monitors (CGMs), insulin pumps, and activity trackers, is creating large volumes of longitudinal diabetes-relevant data that is critical to develop and evaluate transformational AI-driven solutions. However, progress within the field is hampered by the highly regulated nature of the healthcare industry, low interoperability across technology, and a fragmented research community. Consequently, data-centric researchers and innovators have limited or no access to large high-quality datasets for developing robust AI solutions. To bridge this gap, we present Glucose-ML - a collection of longitudinal diabetes-relevant datasets to accelerate development and evaluation of transparent, reproducible, and robust AI solutions that can revolutionize the field. This study focuses on recent diabetes datasets that are publicly available through open or controlled access, and released within the last 7 years (2018 - 2025). All datasets in the Glucose-ML collection include real-world glucose data collected using clinically-validated CGMs across populations of people living with type 1 diabetes (T1D), type 2 diabetes (T2D), pre-diabetes (PreD), and people without diabetes. The key contributions of this work are: • We curate and present Glucose-ML - a collection of 10 publicly-available, diabetes-relevant datasets comprising longitudinal glucose data from over 2500 people across 4 countries, to support robust development and evaluation of AI-driven algorithms, models, and tools. Glucose-ML includes over 300,000 days of CGM data and a total of 38 million blood glucose samples. • We present a comparative analysis of individual datasets within the Glucose-ML collection to highlight strengths and weaknesses of each dataset, and to guide algorithm developers with the dataset selection process when seeking to develop AI solutions. • We present a case study for the common machine learning (ML) task of blood glucose prediction. Through this analysis, we characterize and compare the performance of two naïve prediction algorithms across 10 publicly available diabetes datasets. Additionally, we show that the same model can have significant performance differences for predicting glucose when developed/evaluated on different datasets. Findings from this study serve as a basis for recommendations to practitioners developing AI solutions for diabetes and within the broader health domain, especially as it relates to data selection, model design, and model evaluation. 2 Background & Related Work Wearable CGMs are minimally-invasive sensors for continuous monitoring of glucose trends [ 10 ] . Based on today’s technology, CGMs provide real-time glucose readings based on sensor measurements from the interstitial fluid [ 53 ] . Most CGMs record one glucose sample every 5 - 15 minutes depending on the manufacturer, and have a lifespan of 10 - 14 days [ 53 ] . CGMs are considered to be the standard of care for people living with T1D, and increasing evidence shows the benefit and effectiveness of CGM use in populations of people living with T2D [ 7 , 65 , 103 ] . Additionally, in recent years, CGM use is becoming more popular in populations of people with prediabetes, people without diabetes, and in sports [ 14 , 47 , 51 , 54 ] . Other diabetes-relevant wearable devices that monitor and record longitudinal data include insulin pumps used for administering insulin (the hormone needed to metabolize glucose), and activity trackers used for monitoring relevant behavioral and physiological factors, such as physical activity, sedentary behavior, heart rate, body temperature, and sleep metrics [ 36 , 97 ] . User-generated data from these digital health technologies is foundational for understanding diabetes management in outpatient settings and developing novel AI solutions to support care [ 104 , 82 , 24 , 41 , 51 , 66 , 9 , 94 ] . While there are existing efforts to increase access to and availability of high quality data in the diabetes domain, the fragmented nature of this interdisciplinary field has created silos between various stakeholders, including data creators and algorithm developers. For example, the Jaeb Center for Health Research (JCHR) - a nonprofit research center that conducts world class clinical trials with a core focus on T1D - provides public access to rich datasets from their studies [ 33 ] . However, the majority of these datasets are not leveraged within the AI and ML community for algorithmic innovation as evident from several literature reviews [ 31 , 113 , 116 ] . The most widely used publicly accessible datasets used for diabetes-relevant AI and ML tasks include: the Pima Indian Diabetes Dataset [ 116 , 17 , 78 ] , UVA/Padova simulated dataset for T1D [ 67 , 108 ] , and OhioT1DM [ 68 ] . The Pima Indian Diabetes Dataset (PIDD) was originally collected by the National Institutes of Diabetes and Digestive and Kidney Diseases (NIDDK) and

Read the complete text