A Causal Convolutional Low-rank Representation Model for Imputation of Water Quality Data

Xin Liao, Bing Yang, Tan Dongli, Cai Yu* · 2025

Read A Causal Convolutional Low-rank Representation Model for Imputation of Water Quality Data by Xin Liao, Bing Yang, Tan Dongli, Cai Yu* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15209.txt.

Introduction

Xin Liao, Bing Yang, Tan Dongli, and Cai Yu propose a model that fills in missing values in water quality records. Sensors that watch rivers and lakes often fail, so the data arrives with gaps across many measures at once. Filling those gaps poorly leads to wrong choices in environmental protection. The model aims to guess the missing values with high accuracy and low time cost.

The method rests on two ideas. First, it treats the data as low-rank and applies causal filters that respect the order of time, so past readings inform each guess. Second, it tunes its own settings during training, which removes slow hand adjustment. Tests on three real water quality data sets show the model beats several leading methods on both accuracy and speed. The authors argue it gives monitoring teams stronger support for decisions.

Catalog record

CREATORXin Liao, Bing Yang, Tan Dongli, Cai Yu*
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-15209

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Causal Convolutional Low-rank Representation Model for Imputation of Water Quality Data Xin Liao, Bing Yang, Tan Dongli, Cai Yu* Abstract The monitoring of water quality is a crucial part of environmental protection, and a large number of monitors are widely deployed to monitor water quality. Due to unavoidable factors such as data acquisition breakdowns, sensors and communication failures, water quality monitoring data suffers from missing values over time, resulting in High-Dimensional and Sparse (HDS) Water Quality Data (WQD). The simple and rough filling of the missing values leads to inaccurate results and affects the implementation of relevant measures. Therefore, this paper proposes a Causal convolutional Low-rank Representation (CLR) model for imputing missing WQD to improve the completeness of the WQD, which employs a two-fold idea: a) applying causal convolutional operation to consider the temporal dependence of the low-rank representation, thus incorporating temporal information to improve the imputation accuracy; and b) implementing a hyperparameters adaptation scheme to automatically adjust the best hyperparameters during model training, thereby reducing the tedious manual adjustment of hyper-parameters. Experimental studies on three real-world water quality datasets demonstrate that the proposed CLR model is superior to some of the existing state-of-the-art imputation models in terms of imputation accuracy and time cost, as well as indicating that the proposed model provides more reliable decision support for environmental monitoring. I Introduction Water quality monitoring plays a key role in environmental protection, public health and sustainable development. With the advancement of industrialization and intensification of human activities, water resource management becomes more and more important, and accurate Water Quality Data (WQD) provide a scientific basis for water resource management, pollution prevention and ecological protection [ 1 ] . By collecting WQD regularly, water quality trends are effectively identified and timely measures are taken to ensure water quality. However, the data recorded by widely deployed monitors are missing data due to equipment and transmission failures during data collection, and the High-Dimensional and Sparse (HDS) [ 2 , 3 , 4 , 5 , 6 , 7 , 8 ] WQD seriously affects data completeness, reliability, and hinders the accurate assessment of water quality monitoring. Therefore, how to precisely impute HDS data to provide subsequent analysis becomes a tricky task [ 9 , 10 , 11 ] . In recent years, researchers propose a variety of missing data imputation models to effectively impute missing values in data, such as K-Nearest Neighbors (KNN) imputation models, decision trees methods, Support Vector Machines (SVM) imputation, and deep learning approaches. Specifically, Murti et al. [ 12 ] adopt the KNN imputation to capture complex relationships in data and thus impute missing data, but it is difficult to effectively identify the true neighbors for high-dimensional data to provide accurate imputation. Rahman et al. [ 13 ] utilize decision trees to model complex relationships between features and capture nonlinear relationships to offer accurate imputation. However, this approach is easily suffer from the risk of overfitting. Brand et al. [ 14 ] apply SVM imputation to inscribe high-dimensional nonlinear relationships in the data and maintain robustness by regularizing the parameters, however it suffers from high computational complexity for large datasets. Samad et al. [ 15 ] propose an integrated learning-based imputation method that utilizes Deep Neural Networks (DNN) to replace linear regressors to improve the accuracy of imputing missing data. Unfortunately, deep learning approaches require considerable computational and time cost due to the large number of parameters computed [ 16 , 17 , 18 ] . Fig. 1: An illustration of water quality data constructed as an HDS tensor. Previous studies demonstrate that the Tensor Low-rank Representation (TLR) model can effectively deal with HDS data by modeling the features of the data via compact vector representations in the low-rank space to impute missing values in the HDS tensor [ 19 , 20 , 21 , 22 ] . On the other hand, the WQD can be represented as an HDS tensor presented in Fig. 1 . Specifically, widely distributed sampling stations recorded monitoring data for each time slot, i.e., the monitoring values of the sampling stations for water quality parameters. By matrixizing the WQD for each time slot, a series of matrices arranged by time are obtained. Finally, an HDS tensor is constructed by stacking the above matrices, and its an elements denotes the monitoring value of the sampling station i\in I for the water quality parameter j\in J at the time slot k\in K . Therefore, we propose a Causal convolutional Low-rank Representation (CLR) model for imputing the WQD, which employs the causal convolutional operation and a Particle Swarm Optimization (PSO)-based [ 23 , 24 , 25 , 26 ] hyperparameters adaptation scheme to offer high imputation accuracy and low time cost [ 27 , 28 , 29 , 30 , 31 , 32 ] . The main contributions of this paper are listed as follows: • A causal convolutional operator. It considers the temporal correlation of low-rank representations and efficiently models temporal features via causal characterization on the time, thereby providing accurate imputation accuracy. • A PSO-based hyperparameters adaptation scheme. It avoids the tedious hyperparameters tuning process and adaptively adjusts the best hyperparameters during model training to reduce the model’s time overhead. • An empirical study on three datasets. It demonstrates that the proposed CLR model outperforms several state-of-the-art imputation models in terms of imputation accuracy and time cost. The remaining Sections are organized as follows: Section II presents the background, Section III introduces the proposed CLR model, Section IV and V provide experimental comparisons and conclusions, respectively. II Background II-A Notation system TABLE I: The description for the notation Notation Description I A Set of sampling stations. J A set of water quality parameters. K A set of time slots. X An HDS tensor constructed via the WQD. \tilde{\textbf{X}} The low-rank approximation tensor of X . D rank-one tensors for \tilde{\textbf{X}} . x_{ijk},\tilde{x}_{ijk},d_{ijk} A single element of \textbf{X},\tilde{\textbf{X}} , and R . R The number of rank-one tensors. \mathrm{S},\mathrm{U},\mathrm{V} Three feature matrices correspond to I,J,K . \textbf{{s}}_{r},\textbf{{u}}_{r},\textbf{{v}}_{r} The r -th column vectors of S, U, and V. s_{ir},u_{jr},v_{kr} An single element of S, U, and V. \mathrm{W} The weights of causal convolutional operator. w_{cr} An single weight of W. \textbf{{a}},\textbf{{e}},\textbf{{o}} Three linear bias vectors. a_{i},e_{j},o_{k} The single element of a , e , and o . The notations employed in this paper are summarized in Table I . The tensor is denoted in uppercase bold, the matrix is denoted in uppercase, the vector is denoted in lowercase bold italic, and the scalar is denoted in lowercase italic. II-B Problem formulation As presented in Fig. 1 , the WQD can be represented by an HDS tensor, which is defined as: Definition 1. (HDS tensor). For a given tensor \textbf{X}\in\mathbb{R}^{|I|\times|J|\times|K|} , let \Omega and \Upsilon denote the observed and unobserved element sets in the tensor, respectively. If |\Upsilon|\gg|\Omega| , the tensor X is an HDS tensor, where a element x_{ijk} denotes a quantized value determined by the subscript (i,j,k) . Following the CPD principle [ 33 , 34 , 35 , 36 ] , the HDS tensor X is decomposed into three low-rank feature matrices {\rm{S}}\in\mathbb{R}^{|I|\times R} , {\rm{U}}\in\mathbb{R}^{|J|\times R} , and {\rm{V}}\in\mathbb{R}^{|K|\times R} to represent the

Read the complete text