DEFEND: A Large-scale 1M Dataset and Foundation Model for Tobacco Addiction Prevention

Naga VS Raviteja Chappa, Matthew Shepard, Connor McCurtain, Charlotte McCormick, Page Daniel Dobbs, Khoa Luu · 2025

Read DEFEND: A Large-scale 1M Dataset and Foundation Model for Tobacco Addiction Prevention by Naga VS Raviteja Chappa, Matthew Shepard, Connor McCurtain, Charlotte McCormick, Page Daniel Dobbs, Khoa Luu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13950.txt.

Introduction

Naga VS Raviteja Chappa and co-authors build a dataset and model to police tobacco marketing in a 2025 paper. Tobacco ads evolve fast, above all on social media, while health watchdogs still rely on slow manual checks. That gap lets new products reach young users unseen.

Their dataset, Tobacco-1M, holds one million tobacco product images sorted into 75 classes in a layered scheme. Their model, DEFEND, learns from both image and text cues, with parts that sharpen fine detail and align the two views. Trained on the dataset, it aims to spot products and promotions at a scale human teams cannot match.

Catalog record

CREATORNaga VS Raviteja Chappa, Matthew Shepard, Connor McCurtain, Charlotte McCormick, Page Daniel Dobbs, Khoa Luu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-13950

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DEFEND: A Large-scale 1M Dataset and Foundation Model for Tobacco Addiction Prevention Naga VS Raviteja Chappa, Matthew Shepard, Connor McCurtain, Charlotte McCormick, Page Daniel Dobbs, Khoa Luu Abstract While tobacco advertising innovates at unprecedented speed, traditional surveillance methods remain frozen in time, especially in the context of social media. The lack of large-scale, comprehensive datasets and sophisticated monitoring systems has created a widening gap between industry advancement and public health oversight. This paper addresses this critical challenge by introducing Tobacco-1M, a comprehensive dataset of one million tobacco product images with hierarchical labels spanning 75 product categories, and DEFEND, a novel foundation model for tobacco product understanding. Our approach integrates a Feature Enhancement Module for rich multimodal representation learning, a Local-Global Visual Coherence mechanism for detailed feature discrimination, and an Enhanced Image-Text Alignment strategy for precise product characterization. Experimental results demonstrate DEFEND’s superior performance, achieving 83.1% accuracy in product classification and 73.8% in visual question-answering tasks, outperforming existing methods by significant margins. Moreover, the model exhibits robust zero-shot learning capabilities with 45.6% accuracy on novel product categories. This work provides regulatory bodies and public health researchers with powerful tools for monitoring emerging tobacco products and marketing strategies, potentially revolutionizing approaches to tobacco control and public health surveillance. Figure 1 : Examples of Our Tobacco-1M Dataset for Tobacco Product Understanding. The left section displays visual samples from the major product categories, including Combustible Products , Non-Combustible Products , and Nicotine Replacement Products . The right section demonstrates a hierarchical annotation example of an E-cigarette product with detailed categorical descriptions. Note: This dataset is not intended for the promotion of any tobacco products. 1 Introduction Tobacco addiction persists as a critical public health challenge, with particularly severe implications for youth and young adults. The tobacco industry’s rapid innovation in product development, including e-cigarettes and novel nicotine delivery systems, has consistently outpaced regulatory efforts and traditional monitoring methods. This dynamic landscape creates significant obstacles for public health officials, researchers, and policymakers in effectively addressing tobacco use and its far-reaching health impacts. Accurate detection and classification of tobacco products serve as a critical foundation for addiction prevention by enabling regulatory bodies to identify new products, enforce marketing restrictions, and develop targeted intervention strategies for vulnerable populations. Table 1 : Comparison with existing datasets related to tobacco products. Our proposed Tobacco-1M dataset has hierarchical labels with four main hierarchical levels, i.e., Product Type, Usage Context, Content Purpose, and Health Impact, and large numbers of product types and samples. Moreover, the proposed dataset contains hierarchical descriptions for each tobacco product and auxiliary categorization levels, i.e., Product Sub-categories, Direct health impacts, Marketing strategies, etc. Dataset Year Product Types Hierarchical Labels Hierarchical Levels Product Description Auxiliary Categorization Levels Number of Samples Murthy et al . [ 33 ] 2024 3 ✗ 1 ✗ ✗ 826 Vassey et al . [ 40 ] 2023 7 ✗ 1 ✗ ✗ 6,999 PHAD [ 8 ] 2024 8 ✗ 1 ✗ ✗ 171,900 Our Tobacco-1M 2024 75 ✓ 4 ✓ ✓ 1,128,652 Existing tobacco product detection and classification methods have been constrained by limited datasets, often focusing on a narrow range of product types. Recent studies, such as Murthy et al. [ 33 ] , Vassey et al. [ 40 ] , and the PHAD dataset [ 8 ] , have made progress by expanding the number of product types examined. However, while valuable, these efforts still fall short of capturing the full spectrum of tobacco products in today’s diverse market, thus limiting their utility in comprehensive tobacco control efforts. The advent of foundation models in artificial intelligence offers a promising avenue for developing more robust and adaptable tobacco product monitoring systems. Recent advancements have demonstrated the power of these models, pre-trained on large-scale datasets, in revolutionizing vision tasks and generalizing well to various downstream applications [ 17 , 11 , 37 , 19 , 3 ] . They excel at capturing both general and specific properties of visual data, making them potentially valuable tools for tobacco product analysis. However, the development of effective foundation models for tobacco product monitoring faces a significant hurdle: the lack of a sufficiently large and diverse dataset. Current tobacco-related datasets, as evidenced by our comparative analysis (Table 1 ), are limited in scale and scope. This limitation mirrors challenges observed in other domains, such as insect recognition [ 43 ] , where the diversity and complexity of the subject matter demand datasets of unprecedented scale and detail. Contributions of this Work: To advance tobacco product monitoring and analysis, we introduce Tobacco-1M , a comprehensive tobacco product dataset, and D istillation-enabled E nhanced F eature learning for tobacco EN forcement and D iscernment (DEFEND), a novel foundation model for tobacco product understanding. First, we present Tobacco-1M, comprising one million images with hierarchical labels spanning from broad categories (e.g., Combustible, Non-Combustible) to specific types (e.g., Cigarettes, E-cigarettes), each annotated with detailed descriptions of features, usage context, and health impacts (refer to Fig. 1 for the dataset sample). This dataset is relatively 140 times larger than prior work [ 40 ] . Second, we introduce a self-supervised learning approach with a Feature Enhancement module that captures nuanced correlations between visual and textual features. Third, we propose a Local-Global Visual Coherence loss that ensures consistency between fine-grained and holistic product representations. Fourth, we implement an Enhanced Image-Text Alignment mechanism with specialized contrastive loss for precise feature-description mapping. Finally, through extensive experiments on product classification, marketing strategy detection, and health impact assessment tasks, we demonstrate significant performance improvements over existing tobacco control and public health research methods. Figure 2 : The Distribution of Tobacco Product Categories (left) which illustrates the primary classification of our Tobacco-1M dataset with its four major domains, while The Distribution of Product Type Hierarchy (center) provides a detailed breakdown of product types and their associated brands. Word Cloud (right) of the most frequent product types in our dataset. Best viewed with zoom-in and color. 2 Related Works Recent advancements in video analysis [ 42 , 4 , 5 , 39 , 50 , 48 , 49 , 28 , 51 , 46 , 35 ] have predominantly employed traditional deep learning algorithms, but the absence of language comprehension limits their efficacy. Recognizing this gap, there is a shift towards integrating text modalities [ 7 , 9 ] to enhance understanding capabilities. It underscores the need to evolve existing algorithms, advocating for joint training with Large Language Models (LLMs) [ 25 ] to achieve superior performance and nuanced comprehension. Foundation Models and Multimodal Learning. Recent foundation model research [ 44 , 10 , 30 ] has advanced multimodal approaches, integrating diverse data sources for richer representation learning. These models have demonstrated particular success in hierarchical learning [ 31 , 2 ] , enabling classification across both broad and fine-grained categories. Transfer learning capabilities [ 21 , 15 ] have further extended their utility, allowing models trained on one domain to generalize to related tasks. For instance, Luis et al . [ 15 ] successfully applied transfer learning to connect training across DNA, RNA, and protein sequences, demonstrating the potential for cross-domain knowledge transfer. Tobacco Content Analysis in Social Media. Recent studies [ 23 , 32 , 6 ]

Read the complete text