A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysis DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: General and reference Surveys and ove

Hui Wei, Dong Yoon Lee, Shubham Rohal, Zhizhang Hu, Shiwei Fang, Shijia Pan · 2025

Read A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysis DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: General and reference Surveys and ove by Hui Wei, Dong Yoon Lee, Shubham Rohal, Zhizhang Hu, Shiwei Fang, Shijia Pan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-12263.txt.

Introduction

Wei and co-authors survey foundation models built for the internet of things, in a 2025 paper. Large pre-trained models promise to ease the sensor world's chronic shortage of labeled data, but most work targets one task at a time, so results cannot be compared across domains. The survey organizes the field by four shared goals: efficiency, context awareness, safety, and security with privacy.

For each goal the authors review representative systems, common techniques, and how success is measured. The structure lets newcomers pick and design solutions for fresh tasks with clearer expectations. The paper closes with directions for future research in connected-device intelligence.

Catalog record

CREATORHui Wei, Dong Yoon Lee, Shubham Rohal, Zhizhang Hu, Shiwei Fang, Shijia Pan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-12263

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysis DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: General and reference Surveys and overviews CCS: Computing methodologies Artificial intelligence CCS: Computer systems organization Embedded and cyber-physical systems Hui Wei, Dong Yoon Lee, Shubham Rohal, Zhizhang Hu, Shiwei Fang, Shijia Pan Abstract . Foundation models have gained growing interest in the IoT domain due to their reduced reliance on labeled data and strong generalizability across tasks, which address key limitations of traditional machine learning approaches. However, most existing foundation model based methods are developed for specific IoT tasks, making it difficult to compare approaches across IoT domains and limiting guidance for applying them to new tasks. This survey aims to bridge this gap by providing a comprehensive overview of current methodologies and organizing them around four shared performance objectives by different domains: efficiency , context-awareness , safety , and security & privacy . For each objective, we review representative works, summarize commonly-used techniques and evaluation metrics. This objective-centric organization enables meaningful cross-domain comparisons and offers practical insights for selecting and designing foundation model based solutions for new IoT tasks. We conclude with key directions for future research to guide both practitioners and researchers in advancing the use of foundation models in IoT applications. 1. Introduction Machine learning (ML) models have been widely adopted in IoT applications to enable more convenient, automated, and intelligent solutions across diverse domains (e.g., smart cities ( Ullah et al. 2020 ; Mehta et al. 2022 ) , autonomous driving ( Bachute and Subhedar 2021 ; Grigorescu et al. 2020 ; Dogan et al. 2011 ) , smart agriculture ( Benos et al. 2021 ; Sharma et al. 2020 ; Liakos et al. 2018 ) , and precision health ( Javaid et al. 2022 ; Habehh and Gohel 2021 ; Shailaja et al. 2018 ) ). However, existing approaches that rely on traditional ML models (e.g., models trained on task-specific datasets ( Xu et al. 2024c ) ; deep learning models are also considered as traditional ML in this work) face two key limitations: (C1) Dependence on Labeled data : Most of proposed methods depend on supervised learning, which require large volumes of labeled data to achieve high performance ( Xu et al. 2021 ; Bian et al. 2022 ; Bzai et al. 2022 ) . However, IoT data are often not human-interpretable, making it difficult to obtain sufficient high-quality annotations. (C2) Poor Generalization Across Contexts : Even when labeled data are available, IoT data are highly heterogeneous. As a result, models trained in one context (e.g., specific environments or applications) often fail to generalize to others, limiting scalability and cross-domain applicability ( Ji et al. 2024 ; Chen et al. 2024b ; Xue et al. 2024 ) . In order to address these two challenges, foundation models ( Bommasani et al. 2021 ; Zhou et al. 2024 ) (e.g., large language models) have gained increasing attention and adoption in the IoT domain. First, foundation models (FMs) rely on self-supervised training instead of traditional supervised approaches, which addresses Challenge C1 by reducing the dependency on large labeled IoT datasets. Second, the training data for FMs typically span multiple domains and contexts, which allows FMs to learn generalizable, context-invariant representations, making them more adaptable to a wide range of downstream tasks. This mitigates Challenge C2. To advance the field and guide future research, prior surveys ( Baris et al. 2025 ; Xu et al. 2024c ; Kök et al. 2024 ; Siam et al. 2025 ; Bhat et al. 2025 ; Sarhaddi et al. 2025 ) have summarized FM-based approaches for IoT tasks, along with evaluation metrics and benchmark datasets, primarily from the perspective of specific application domains (e.g., healthcare, robotics, smart homes). However, our review of the cited papers reveals a key but previously overlooked insight: while tasks within the same domain may require different techniques, similar techniques can often be applied across domains to address shared objectives (e.g., reducing training time, personalizing outputs). Organizing the literature solely by application area obscures these cross-domain goals and the research opportunities they present. Moreover, proposed methods targeting the same objective are often evaluated on different tasks, without comparison to other approaches targeting the same objective. This inconsistent evaluation makes it difficult to assess which approaches are most effective across different scenarios, providing limited insights for addressing the same objective in new tasks. To address the limitations identified above, this paper categorizes current research on FMs for IoT around four key performance criteria that serve as shared objectives across diverse application domains: (1) Efficiency , (2) Context-awareness , (3) Safety (different from Security in this paper. Please see Section 5 for more details), and (4) Security and privacy . By organizing the literature around these common objectives rather than specific tasks, we aim to provide a clearer understanding of how foundation models are being leveraged across the IoT landscape. This approach enables the community to (i) identify shared performance objectives across diverse IoT tasks, (ii) facilitate meaningful cross-domain comparisons, and (iii) promote the design of more generalizable and effective solutions. To support this goal, we address the following research questions: (1) What methodologies have been proposed to improve each performance criterion? (2) What metrics are used to evaluate these criteria? (3) What evaluation strategies are commonly adopted when applying FMs to IoT tasks? Finally, based on our analysis, we identify additional gaps in the literature and suggest future research directions to further advance the field. The structure of this paper is as follows: Section 2 introduces three fundamental paradigms and frameworks for applying foundation models to IoT tasks, providing essential background for readers new to the field. Sections 3 through 6 examine the four key performance criteria along with commonly used approaches to improve each. Section 7 reviews the evaluation metrics used in the current literature for each criterion and discusses the strategies employed to assess FM-based solutions in IoT applications. Finally, Section 8 discusses existing research limitations and outlines future directions. Figure 1 presents a taxonomy of this paper and representative techniques. For readers who are already familiar with foundation models, we recommend proceeding directly to the sections of interest. For those who are familiar with IoT but new to foundation models, we encourage a thorough reading of the entire paper, with particular emphasis on Section 2 , which introduces the essential background relevant to this emerging area. {forest} Figure 1. Taxonomy of Foundation Models for IoT. The structure of this paper is as follows: Section 2 introduces three fundamental paradigms and frameworks for applying foundation models to IoT tasks, providing essential background for readers new to the field. Sections 3 through 6 examine the four key performance criteria along with commonly used approaches to improve each. Section 7 reviews the evaluation metrics used in the current literature for each criterion and discusses the strategies employed to assess FM-based solutions in IoT applications. Finally, Section 8 discusses existing research limitations and outlines future directions. 2. Foundations of FMs for IoT In this section, we categorize existing approaches that leverage foundation models into

Read the complete text