PEFT-MuTS: A Multivariate Parameter-Efficient Fine-Tuning Framework for Remaining Useful Life Prediction based on Cross-domain Time Series Representation Model

En Fu, Yanyan Hu, Changhua Hu, Zengwang Jin, Kaixiang Peng · 2026

Read PEFT-MuTS: A Multivariate Parameter-Efficient Fine-Tuning Framework for Remaining Useful Life Prediction based on Cross-domain Time Series Representation Model by En Fu, Yanyan Hu, Changhua Hu, Zengwang Jin, Kaixiang Peng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22631.txt.

Introduction

En Fu, Yanyan Hu, Changhua Hu, Zengwang Jin, and Kaixiang Peng predict how much useful life a machine has left, from little data. Such forecasts guide repairs, yet they have long needed heaps of past wear data from twin machines. Their 2026 preprint, PEFT-MuTS, takes a leaner path.

Their frame fine-tunes only a small part of a model, across many signals at once. Small-data forecasts could serve rare or new gear, where twins do not exist. The work cuts the data bill for a key factory task. It also aims to keep accuracy high. Less data, same warning time, is the goal.

Catalog record

CREATOREn Fu, Yanyan Hu, Changhua Hu, Zengwang Jin, Kaixiang Peng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22631

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PEFT-MuTS: A Multivariate Parameter-Efficient Fine-Tuning Framework for Remaining Useful Life Prediction based on Cross-domain Time Series Representation Model En Fu, Yanyan Hu, Changhua Hu, Zengwang Jin, Kaixiang Peng Abstract The application of data-driven remaining useful life (RUL) prediction has long been constrained by the availability of large amount of degradation data. Mainstream solutions such as domain adaptation and meta-learning still rely on large amounts of historical degradation data from equipment that is identical or similar to the target, which imposes significant limitations in practical applications. This study investigates PEFT-MuTS, a Parameter-Efficient Fine-Tuning framework for few-shot RUL prediction, built on cross-domain pre-trained time-series representation models. Contrary to the widely held view that knowledge transfer in RUL prediction can only occur within similar devices, we demonstrate that substantial benefits can be achieved through pre-training process with large-scale cross-domain time series datasets. A independent feature tuning network and a meta-variable-based low rank multivariate fusion mechanism are developed to enable the pre-trained univariate time-series representation backbone model to fully exploit the multivariate relationships in degradation data for downstream RUL prediction task. Additionally, we introduce a zero-initialized regressor that stabilizes the fine-tuning process under few-shot conditions. Experiments on aero-engine and industrial bearing datasets demonstrate that our method can achieve effective RUL prediction even when less than 1% of samples of target equipment are used. Meanwhile, it substantially outperforms conventional supervised and few-shot approaches while markedly reducing the data required to achieve high predictive accuracy. Our code is available at https://github.com/fuen1590/PEFT-MuTS . [style=chinese, orcid=0009-0006-4837-6711] [style=chinese, orcid=0000-0003-3578-7598] [style=chinese] [style=chinese, orcid=0000-0002-7491-9103] [style=chinese, orcid=0000-0001-8314-3047] † † highlights: Cross-domain time-series priors enable accurate few-shot RUL prediction. PEFT-MuTS efficiently adapts pretrained model to multivariate RUL prediction. A 0-initialized regressor is proposed to stabilize fine-tuning in RUL prediction. keywords Remaining Useful Life ,Transfer Learning ,Parameter-Efficient Fine-Tuning ,Few-shot Learning † † titlenote: This work is supported by the National Natural Science Foundation of China (Grant 62273038), the Open Fund of Intelligent Control Laboratory (Grant 2024-ZKSYS-KF03-05) and the Ningbo Young Technological Innovation Leading Talent Project of China (Grant 2025QL047) † † credit: Methodology, Software, Writing † † credit: Methodology, Revision † † credit: Validation, Revision † † credit: Revision † † credit: Revision † † corresponding: Corresponding author 1 Introduction Remaining Useful Life (RUL) prediction aims to quantitatively estimates the remaining effective time of equipment, providing objective basis for maintenance decisions or replacement plans [ 22 , 41 , 17 ] . As a key means of avoiding maintenance surplus and deficiency, RUL prediction constitutes the core function of the new generation of Prognostics and Health Management (PHM) [ 3 ] . In recent years, deep-learning based RUL prediction methods have attracted increasing attention for their ability to establish accurate end-to-end mapping between monitoring signals and the RUL label without reliance on any expert knowledge. What these methods primarily rely on is a substantial amount of full-lifecycle degradation data for sufficient model training. However, collecting such run-to-failure full-lifecycle data in real industrial settings is always costly and challenging, which significantly hinders the practical adoption of deep-learning based RUL prediction methods. To solve the RUL prediction problem under few-shot domains, transfer learning, represented by domain adaptation [ 40 , 4 , 6 , 20 , 23 , 27 , 33 ] and meta-learning [ 26 , 1 , 2 , 28 , 5 , 43 ] , has becoming as a mainstream approach. The core idea of transfer learning is to leverage the prior knowledge of source domain to target domain by constructing an effective transfer pathway. Although extensive transfer learning-based methods have been developed for few-shot RUL prediction, the majority are limited to transfer across different operating conditions of similar equipment. In other words, the focus of existing methods is on identifying consistent degradation pattern of similar devices under distinct operation conditions. Thus, a prerequisite of these methods is sufficient degradation data from similar equipment can be available to construct the source domain for transfer, which is still a stringent requirement in many practical applications. When historical data of the target equipment is scarce, it may be equally difficult to collect a substantial amount of data from similar equipment. For example, the operational lifespan of many types of industrial assets extends for decades, making full lifecycle data collection a long process and time-consuming. Another example is the newly developed or small batch customized equipment domain. The historical degradation data of such kinds of equipment is considerably limited due to the short service time and small quantity. To sum up, existing few-shot RUL prediction methods based on the idea of device-specific degradation pattern transfer will become infeasible when sufficient degradation data with similar degradation pattern from homogeneous equipment cannot be obtained, which significantly undermines their values in practical application. As we known, degradation data for RUL prediction are predominantly time series data, thereby recent advances in time-series representation learning offer a promising way to overcome above limitations. Time series representation models trained in a self-supervised manner can learn generalizable temporal feature representations from large-scale time series datasets. It has been proved that the pre-trained time series representation models have strong generalization ability in cross-domain downstream classification and prediction tasks [ 7 , 39 , 10 ] . Consequently, leveraging the excellent generalization ability of time series representation model to RUL prediction has the potential to significantly improving the accuracy and robustness of prediction result, especially in few-shot scenes. Moreover, the pre-training process of representation model is not tied to a specific downstream task. This decouples the transfer process from the requirement for equipment-specific degradation data in existing few-shot RUL prediction methods, enabling the transfer of knowledge between domains from diverse and heterogeneous time series. Nevertheless, time-series representation models for few-shot RUL prediction faces the following critical challenges: • How to leverage widely used univariate time-series representation model to multivariate RUL prediction task? Currently, cross-domain time-series representation learning methods are often designed to capture temporal or spectral features of a single variable [ 7 , 10 , 36 ] , where down-stream cross-variable dependencies are not and difficult to defined during pre-training. However, in practical applications, complex equipment status is typically characterized by multiple correlated sensor variables. This mismatch between pre-training and down-stream task requirements gives rise to the first challenge that must be addressed. • How to design an effective fine-tuning strategy that guarantees stable convergence with extremely limited samples from target equipment for RUL prediction task? Current time-series representation models are parameter-intensive. In few-shot RUL prediction domain, natively fine-tuning all parameters not only leads to severe overfitting but may also substantially degrade the generalizable priors acquired during pre-training. The application of parameter-efficient finetuning approaches to multivariate RUL prediction has never been explored, which constitutes the second key challenge addressed. Building on above discussion, this paper proposes PEFT-MuTS, a novel Parameter-Efficient Fine-Tuning framework for few-shot Multivariate Time-Series RUL prediction. PEFT-MuTS is built on a general time series representation model, which can be pre-trained on large-scale cross-domain time series data. Then, the pre-trained model is fine-tuned to adopt to the downstream RUL prediction task through an Independent Feature Tuning Network and Meta-Variable-based Low Rank Feature Fusion mechanism with minimal parameters. The main contributions of this paper are as follows: • This paper demonstrates that cross-domain time-series

Read the complete text