CLIFF: Continual Learning for Incremental Flake Features in 2D Material Identification

Sankalp Pandey, Xuan Bac Nguyen, Nicholas Borys, Hugh Churchill, Khoa Luu · 2025

Read CLIFF: Continual Learning for Incremental Flake Features in 2D Material Identification by Sankalp Pandey, Xuan Bac Nguyen, Nicholas Borys, Hugh Churchill, Khoa Luu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17261.txt.

Introduction

Sankalp Pandey, Xuan Bac Nguyen, Nicholas Borys, Hugh Churchill, and Khoa Luu present CLIFF, a learning system for naming thin flakes of two dimensional materials, in work from 2025. Finding and sorting such flakes is key for quantum hardware. Under a microscope, flakes look very different from one material to the next.

CLIFF learns one material at a time without forgetting the last. It freezes its core and learns a small prompt and fix for each new material. A gate picks the right fix, and replay with teaching from the old model guards past skill. Accuracy stayed strong in their tests.

Catalog record

CREATORSankalp Pandey, Xuan Bac Nguyen, Nicholas Borys, Hugh Churchill, Khoa Luu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE14 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-17261

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CLIFF: Continual Learning for Incremental Flake Features in 2D Material Identification Sankalp Pandey, Xuan Bac Nguyen, Nicholas Borys, Hugh Churchill, Khoa Luu Abstract Identifying quantum flakes is crucial for scalable quantum hardware; however, automated layer classification from optical microscopy remains challenging due to substantial appearance shifts across different materials. In this paper, we propose a new Continual-Learning Framework for Flake Layer Classification (CLIFF) 1 1 1 The code will be made publicly available. . To our knowledge, this is the first systematic study of continual learning in the domain of two-dimensional (2D) materials. Our method enables the model to differentiate between materials and their physical and optical properties by freezing a backbone and base head trained on a reference material. For each new material, it learns a material-specific prompt, embedding, and a delta head. A prompt pool and a cosine-similarity gate modulate features and compute material-specific corrections. Additionally, we incorporate memory replay with knowledge distillation. CLIFF achieves competitive accuracy with significantly lower forgetting than naive fine-tuning and a prompt-based baseline. 1 Introduction Characterizing the layer counts of two-dimensional (2D) material flakes is crucial for the fabrication of Van der Waals heterostructures, which facilitate a range of studies and applications, especially those in quantum mechanics james2021recent ; lemme20222d ; liu2022chemical . Typically, researchers find flakes through repetitive, manual optical microscopy searches, and the samples must be transferred to an Atomic Force Microscope (AFM) for thickness measurement, which doubles the manual effort involved and significantly limits the complexity and scalability of heterostructure construction. To overcome these bottlenecks, deep learning approaches have emerged in recent years, aiming to automate flake layer classification of exfoliated 2D materials, but they present poor versatility across domain shifts. In this work, we present, to our knowledge, the first systematic study of continual learning for 2D flake thickness classification. We establish our evaluation as a material-incremental, continual learning problem setting, where new materials arrive sequentially. The Challenges of Automated Flake Identification. The difficulty in automating the identification of 2D materials is estimating the layer count of a flake from optical microscopy images. Importantly, the subtle visual characteristics for layer count classification are highly dependent on factors that vary in real-world laboratory settings. This variability makes it challenging to train a typical deep learning model, motivating the use of a continual learning approach to preserve learned information. Limitations of Prior Work. Prior work in automated flake characterization has several limitations. Traditional machine learning methods hearst1998support ; fix1985discriminatory often fail to capture the subtle, non-linear visual differences between flake thicknesses. While deep learning approaches have shown promise ronneberger2015u ; he2017mask ; nguyen2024two ; kirillov2023segment ; ravi2024sam , they often overfit to specific materials or imaging conditions. When typical static models are fine-tuned on new materials, they suffer from catastrophic forgetting, rendering them impractical for real-world laboratory environments. To address this, continual learning (CL) methods have been developed, including rehearsal-based approaches hayes2019memoryefficientexperiencereplay ; chaudhry2019efficientlifelonglearningagem ; chaudhry2019tinyepisodicmemoriescontinual ; 7447103 , knowledge distillation chaudhry2021usinghindsightanchorpast ; buzzega2020darkexperiencegeneralcontinual ; rebuffi2017icarlincrementalclassifierrepresentation ; wu2019largescaleincrementallearning , self-supervision pham2021dualnetcontinuallearningfast ; cha2021co2lcontrastivecontinuallearning ; 9022316 ; nguyen2024qclusformerquantumtransformerbasedframework , and architectural methods that add new parameters zhao2021deepbayesianunsupervisedlifelong ; li2019learngrowcontinualstructure ; wortsman2020supermaskssuperposition ; ke2021continuallearningmixedsequence . Our work is inspired by prompt-based CL wang2022learningpromptcontinuallearning ; wang2022dualpromptcomplementarypromptingrehearsalfree . Problem Motivation. Addressing these limitations is critical for developing robust automated exfoliation analysis systems for real-world settings. We formulate flake layer count classification as a material-incremental problem where the model must learn new materials while retaining performance on previously seen materials. To address this, we propose a continual learning (CL) framework that preserves prior knowledge by freezing a backbone and base head trained on a reference material and learning a per-material addition for each new material. Contributions of this Work. We present, to the best of our knowledge, the first study of continual learning for 2D material flake thickness classification and formulate a material-incremental benchmark. Our proposed CLIFF approach is a novel continual learning framework for 2D material flake layer count classification across multiple materials. We evaluate our approach and compare it against joint training, naive fine-tuning, and another Learning-to-Prompt (L2P) method. wang2022learningpromptcontinuallearning . 2 Methodology We propose CLIFF, a continual learning framework for 2D flake layer classification. For each subsequent material, the framework learns a small set of new components: a dedicated prompt pool, a material embedding, and a delta head that models a material-specific correction. A prompt pool adapts the frozen backbone’s features during training on a new material by prepending learned tokens to the input patch sequence. We also replay a small number of stored samples and use knowledge distillation. The final classification head computes predictions for all seen materials in parallel, guided by an auxiliary loss on material identity. This allows our approach to perform task-agnostic classification without needing material labels at test time. Figure 1: The proposed CLIFF approach. 2.1 Base Training on a Reference Material Let D_{0}=\{(x_{i},y_{i})\}_{i=1}^{N_{0}} be the reference material dataset, where x_{i} represents the i -th input image and y_{i}\in\{\text{Few},\text{Mono},\text{Thick}\} is the corresponding thickness label. A Vision Transformer (ViT) dosovitskiy2021imageworth16x16words backbone f_{\theta} with parameters \theta and a linear classification head g_{\phi} with parameters \phi are trained by optimizing the base loss function shown in Eqn. ( 1 ) as follow, \mathcal{L}_{base}=\frac{1}{N_{0}}\sum_{i=1}^{N_{0}}\mathrm{CE}\!\big(b(x_{i}),\,y_{i}\big)=\frac{1}{N_{0}}\sum_{i=1}^{N_{0}}\mathrm{CE}\!\big(g_{\phi}(f_{\theta}(x_{i})),\,y_{i}\big), (1) where \mathrm{CE}(\cdot,\cdot) denotes the cross-entropy loss function and b(x_{i})=g_{\phi}(f_{\theta}(x_{i})) represents the base classification logits for image x_{i} . 2.2 Incremental Learning for New Materials When a new material m arrives, we introduce three new learnable components: a prompt P_{m} , a material embedding e_{m} , and a delta head D_{m} . Prompting. For each material m , we learn a separate prompt P_{m} . It selects a set of prompt tokens and prepends them to the sequence of image patch embeddings before the frozen transformer backbone processes them. This allows for material-specific adaptation of the backbone’s features without altering its weights. We denote the feature output from the prompted backbone as Eqn. ( 2 ) z_{m}=f_{\theta}(x;P_{m}). (2) CLIFF Head. The CLIFF head processes the prompted features z_{m}\in\mathbb{R}^{d} , where d is the backbone’s feature dimension. It maintains an embedding table E\in\mathbb{R}^{M\times d_{e}} containing a unique embedding vector e_{i} for each of the M seen materials, and d_{e} is the embedding dimension. As described in Eqn. ( 3 ), for each material i , a multilayer perceptron (MLP), the delta head D_{i}:\mathbb{R}^{d+d_{e}}\to\mathbb{R}^{C} , computes a residual correction \Delta_{i}(x)\in\mathbb{R}^{C} : \Delta_{i}(x)=D_{i}\!\big(\mathrm{Concat}[z_{m},\,e_{i}]\big). (3) Here, C=3 is the number of thickness classes. The final output is a single, large logit vector L(x) created by concatenating the corrected logits for all M materials, as calculated using Eqn ( 4 ): L(x)=\mathrm{Concat}_{i=1}^{M}\big(b(x)+\Delta_{i}(x)\big)\in\mathbb{R}^{CM}. (4) The prediction is the argmax over this global CM -dimensional label space. Optimization with Rehearsal and Distillation. With f_{\theta} and g_{\phi} frozen, we learn the new components ( P_{m},e_{m},D_{m} ) for a new material. We maintain a small memory buffer \mathcal{M} of samples from past tasks. The total loss for a sample (x,y) from the current task m is calculated as shown in Eqn. ( 5 ). \mathcal{L}=\mathcal{L}_{\text{cls}}+\lambda_{\text{gate}}\mathcal{L}_{\text{gate}}+\lambda_{\text{mem}}\mathcal{L}_{\text{mem}}+\lambda_{\text{kd}}\mathcal{L}_{\text{kd}}. (5) Here, \mathcal{L}_{\text{cls}} is the standard cross-entropy loss on the current task’s data. An auxiliary gate loss, \mathcal{L}_{\text{gate}} , is computed using cosine similarity between features and material embeddings to improve material identification. \mathcal{L}_{\text{mem}} is the cross-entropy loss for samples replayed from

Read the complete text