A Nonlinear Low-rank Representation Model with Convolutional Neural Network for Imputing Water Quality Data
Xin Liao, Bing Yang, Cai Yu* · 2025
Read A Nonlinear Low-rank Representation Model with Convolutional Neural Network for Imputing Water Quality Data by Xin Liao, Bing Yang, Cai Yu* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23629.txt.
Introduction
Xin Liao, Bing Yang, and Cai Yu propose a neural method for filling gaps in water quality records. Their 2025 paper addresses monitoring data that arrive with many holes from sensor failures and transmission delays. The resulting records are wide and sparse, and older filling methods miss the dynamics hidden in them.
Their model pairs a low-rank view of the data with a convolutional network. The network mixes information across time slots to capture how readings depend on their neighbors. It also extracts nonlinear local patterns, joining features across many measured quantities. Tests on three real monitoring data sets beat leading imputation models on accuracy. Reliable filled records support the decisions that protect rivers and drinking water.
Catalog record
| CREATOR | Xin Liao, Bing Yang, Cai Yu* |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-23629
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Nonlinear Low-rank Representation Model with Convolutional Neural Network for Imputing Water Quality Data Xin Liao, Bing Yang, Cai Yu* Abstract The integrity of Water Quality Data (WQD) is critical in environmental monitoring for scientific decision-making and ecological protection. However, water quality monitoring systems are often challenged by large amounts of missing data due to unavoidable problems such as sensor failures and communication delays, which further lead to water quality data becoming High-Dimensional and Sparse (HDS). Traditional data imputation methods are difficult to depict the potential dynamics and fail to capture the deep data features, resulting in unsatisfactory imputation performance. To effectively address the above issues, this paper proposes a Nonlinear Low-rank Representation model (NLR) with Convolutional Neural Networks (CNN) for imputing missing WQD, which utilizes CNNs to implement two ideas: a) fusing temporal features to model the temporal dependence of data between time slots, and b) Extracting nonlinear interactions and local patterns to mine higher-order relationships features and achieve deep fusion of multidimensional information. Experimental studies on three real water quality datasets demonstrate that the proposed model significantly outperforms existing state-of-the-art data imputation models in terms of estimation accuracy. It provides an effective approach for handling water quality monitoring data in complex dynamic environments. I Introduction In the field of environmental monitoring, the integrity of Water Quality Data (WQD) is crucial for scientific decision-making and ecological protection [ 1 ] . By collecting WQD regularly, water quality trends are effectively identified and timely measures are taken to ensure water quality. However, water quality monitoring systems in practice frequently face the problem of missing data due to various factors such as sensor failures, aging equipment, and communication delays. This problem has become more prominent with the increasing number of sensor deployments and the High-Dimensional and Sparse (HDS) [ 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 ] nature of monitoring data. Missing data not only affects the accuracy and reliability of the water quality monitoring system but also makes the subsequent data analysis and decision-making process complex and difficult. Therefore, how to accurately impute the missing values in the HDS WQD has become a thorny task [ 16 , 17 , 18 , 19 , 20 , 21 ] . In recent years, researchers have proposed a variety of missing data imputation models to effectively fill in the missing values in the WQD, Murti et al. [ 22 ] use K-Nearest Neighbours (KNN) imputation to capture the complex relationships in the data, but accurately identifying the true neighbours becomes difficult when dealing with HDS data, which results in the accuracy of the imputation results being affected. Rahman et al. [ 23 ] utilize a decision tree to model the inter-feature of complex interaction relationships to improve the imputation accuracy. However, this method is prone to the risk of overfitting. Brand et al. [ 24 ] portray the nonlinear relationships in the WQD data by Support Vector Machines (SVM) imputation and improve the robustness by regularizing the parameters, but for large-scale datasets, the method is challenging in terms of computational complexity [ 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 ] . Fig. 1: An instance of a TLR model representing the HDS tensor constructed from WQD. Previous studies have shown that the Tensor Low-rank Representation (TLR) model [ 36 , 37 , 38 , 39 ] is highly effective in handling high-dimensional sparse data by providing compact vector representations of data features in a low-rank latent space. By exploiting the underlying low-rank structure of multi-dimensional data, TLR enables efficient extraction of discriminative information and facilitates accurate recovery of missing values. On the other hand, WQD can be naturally modeled as HDS tensors due to its multi-source heterogeneity, temporal continuity, and missing values. Moreover, the convolutional neural network (CNN) [ 40 , 41 , 42 ] is particularly effective in modeling sequential dependencies, making it well-suited for temporal data owing to its local receptive fields and shared weights [ 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 ] . Based on the above observation, this paper proposes a novel Nonlinear Low-rank Representation model with CNN (CLR-CNN). Overall, the main contributions are as follows: • Integrating time-series features through convolutional operations to model the temporal dependencies between different time slices of water quality data, thereby more accurately recovering missing values and capturing potential dynamic trends; • Leveraging the advantages of convolutional networks in extracting local patterns and nonlinear interactions, the method uncovers high-order associative features between different variables, enabling deep fusion of multi-dimensional information and significantly improving the model’s ability to express complex data structures and its imputation accuracy; and. • An experimental study on three datasets. It demonstrates that the proposed NLR-CNN model significantly outperforms several state-of-the-art imputation models in terms of estimation accuracy for missing values in the WQD. Section II introduces the background, Section III describes the proposed NLR-CNN model, Section IV provides the experimental study, and Section V concludes this paper. II Background II-A Notation system TABLE I: The definition of the notation Notation Description I Set of sampling stations. J Set of WQD parameters. K A set of time slots. X The HDS tensor. Z The low-rank approximation tensor. A Rank-one tensors. \mathrm{S},\mathrm{U},\mathrm{V} Feature matrices for I,J,K . \circ Outer product. The notation adopted in this paper is listed in Table I . Specifically, tensors are represented by bold uppercase letters, matrices are represented by standard uppercase letters, vectors are represented by bold italic lowercase letters, and scalars are represented by italic lowercase letters II-B Problem formulation Fig. 1 presents the flow of data imputation of a TRL model for an HDS tensor constituted by the WQD, where the HDS tensor is defined as: Definition 1. (HDS tensor of the WQD). The water quality parameters of the sampling stations are recorded via the sampling stations. By constructing the matrix of sampling records for each time slot and arranging them over time, a tensor \textbf{X}\in\mathbb{R}^{|I|\times|J|\times|K|} is constructed. Let \Omega and \Upsilon be known and unknown data sets. The tensor is an HDS tensor if |\Upsilon|\gg|\Omega| , where an element x_{ijk} denotes the quantized value of the index (i,j,k) . By the Canonical Polyadic Decomposition (CPD) [ 56 , 57 , 58 , 59 , 60 ] principle, the HDS tensor X is decomposed into three low-rank feature matrices, {\rm{S}}\in\mathbb{R}^{|I|\times R} , {\rm{U}}\in\mathbb{R}^{|J|\times R} , and {\rm{V}}\in\mathbb{R}^{|K|\times R} , to represent the three modes. To get the r -th rank-one tensor \textbf{A}_{r} , the r -th column vector of the three feature matrices performs the outer product [ 61 , 62 , 63 , 64 ] as follows: \tilde{\textbf{A}}_{r}=\textbf{s}_{:r}\circ\textbf{u}_{:r}\textbf{v}_{:r}. (1) Further, the low-rank approximation tensor Z is constructed [ 65 , 66 , 67 , 68 , 69 ] as below: \textbf{Z}=\sum\limits_{r=1}^{R}{\textbf{{s}}_{:r}\circ\textbf{{u}}_{:r}\circ\textbf{{v}}_{:r}}. (2) To measure the discrepancy between the original HDS tensor and the approximation tensor, the Euclidean distance [ 70 , 71 , 72 ] is typically employed, and