Stabilization of industrial processes with time series machine learning
Matvei Anoshin, Olga Tsurkan, Vadim Lopatkin, Leonid Fedichkin · 2025
Read Stabilization of industrial processes with time series machine learning by Matvei Anoshin, Olga Tsurkan, Vadim Lopatkin, Leonid Fedichkin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-22502.txt.
Introduction
Matvei Anoshin and others stabilize industrial processes by replacing a classic optimizer with two neural networks working as predictor and optimizer. Keeping quantities like temperature steady is a standing problem across industry, and conventional solvers spend heavily on pointwise optimization. Writing in twenty twenty-five, the team reframes the job. An oracle network learns to predict the process, and an optimizer network learns control actions, converting repeated pointwise solving into network training. Once trained, control is read off the networks rather than computed fresh at each step.
On their temperature control tests, the pipeline improved stability about threefold compared with ordinary solvers, while demanding fewer computational resources. The authors present the approach as a general template for steadying time series processes in factories, where both quality and compute cost matter.
Catalog record
| CREATOR | Matvei Anoshin, Olga Tsurkan, Vadim Lopatkin, Leonid Fedichkin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-22502
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stabilization of industrial processes with time series machine learning Matvei Anoshin, Olga Tsurkan, Vadim Lopatkin, Leonid Fedichkin Abstract The stabilization of time series processes is a crucial problem that is ubiquitous in various industrial fields. The application of machine learning to its solution can have a decisive impact, improving both the quality of the resulting stabilization with less computational resources required. In this work, we present a simple pipeline consisting of two neural networks: the oracle predictor and the optimizer, proposing a substitution of the point-wise values optimization to the problem of the neural network training, which successfully improves stability in terms of the temperature control by about 3 3 times compared to ordinary solvers. Introduction An application of machine learning to the industrial processes stabilization is an open problem which promises a huge potential benefit to the such critical industries as metals and energy development if solved. Classical optimization methods, such as finite-horizon markov decision processes Mundhenk_Goldsmith_Lusena_Allender_2000 , non-linear programming reformulation of control Trierweiler_2014 and point-wise optimization Niegodajew_Marek_Elsner_Kowalczyk_2020 are frequently employed in order to achieve better stability of time series process, successfully improving production quality, minimizing expenses and manufacturing devices deficiency with near-future planing or real-time optimization. Machine learning, known for its prominent results in solution of enterprise problems Cruz_Villalonga_Castaño_Rivas_Haber_2023 , became widely applied to the time series prediction and generation after recent advances in such fields as natural language processing, due to the similarity aforementioned tasks in their time dependent recurrent nature Dalal_Verma_Chahar_2024 . Thus, contemporary time series modeling is performed with long short-term memory (LSTM) models Hochreiter_Schmidhuber_1997 and Transformers vaswani2023attentionneed , incorporating different attention strategies. Currently, state-of-the-art approaches to ML-driven optimization include an application of reinforcement learning, but for time series problems, the usual focus stays on approximation of the industrial process as a dynamic system on the basis of recurrent neural network (RNN), with such methods as recurrent stabilization control Kulawski_Brdyś_2000 ; gu2021recurrentneuralnetworkcontrollers . After dynamical model is obtained, any classical approaches such as proportional–integral–derivative (PID) pid controller may be applied, resulting in the stabilization of the process. In the following work we present simple, yet powerful solution to the problem of ML-driven optimization of the ongoing physical process, showing its vices over ordinary point-wise optimization through different solvers application and PID regulation via substitution of controllable values optimization problem, to the problem of the weights approximation in the optimizer neural network. This substitution yields the better results in both terms of the work-time efficiency and optimization accuracy. Results .1 Classical Optimization Methodology Let’s consider an industrial process as multi-modal time series data with inner correlations X\left(t\right)=\left(x^{1}\left(t\right),x^{2}\left(t\right),...,x^{n}\left(t\right)\right) recorded with a given discretization time step \Delta t and containing K controlled, M controlling and 1 target time-series \left(K+M+1=n\right) . For the sake of generalization, controlled features may be denoted as non-adjustable x^{i}_{\mathrm{non-adjustable}}\left(t\right) , controlling as x^{i}_{\mathrm{adjustable}}\left(t\right) and target as x_{\mathrm{target}}\left(t\right) . An optimization problem statement is prescribed as follows: • Dataset contains a historical data of the response of x_{\mathrm{target}}\left(t\right) and x^{i}_{\mathrm{non-adjustable}}\left(t\right) on change of x^{i}_{\mathrm{adjustable}}\left(t\right) parameters from t_{\mathrm{min}} to t_{1} • The final goal of the optimization is to devise a method, which allows to stabilize x_{\mathrm{target}}\left(t\right) from t\geq t_{1}+t_{\mathrm{range}} by changing x^{i}_{\mathrm{adjustable}}\left(t\right) values on [t_{1},t_{1}+t_{\mathrm{range}}] as it is illustrated on Fig. 1 . That means what for any arbitrary chosen interval [t_{2},t_{3}]\in[t_{1}+t_{\mathrm{range}},+\infty] \sum_{t=t_{2}}^{t=t_{3}}|x_{\mathrm{target}}\left(t\right)-x_{\mathrm{ideal}}|\rightarrow\mathrm{min} Figure 1: A time axis illustrating scales of t_{\mathrm{range}} and \Delta t . It is assumed that optimization policy on t_{\mathrm{range}}-\Delta t mostly determines target value. The classical optimization paradigm, which is specified in Alg. 1 , thrives to optimize values for x_{\mathrm{target}}\left(t\right) point-wise (w.r.t to x^{i}_{\mathrm{adjustable}}\left(t\right) ), assuming that local minimum on the i -th step will result in the minimum on every arbitrary chosen interval. This approach, generally speaking, an exponentially hard on each i -th step, thus both resources and time consuming, what is especially inconvenient in case of the industrial process optimization, as industrial data usual span a vast amount of sensors with high discretization step. Algorithm 1 Classical point-wise target control 1. On the i -th step of the optimization, M\cdot t_{\mathrm{range}}/\Delta t values x^{j}_{\mathrm{adjustable}}\left(t\right)|_{t=t_{i}}^{t=t_{i}-\Delta t+t_{\mathrm{range}}} are optimized with the cost function \mathrm{Cost}(x_{t_{i}})=|x_{\mathrm{target}}\left(t_{i}+t_{\mathrm{range}}\right)-x_{\mathrm{ideal}}| 2. Then, only x^{j}_{\mathrm{adjustable}}\left(t\right)|_{t=t_{i}} are set 3. On the i+1 -th step of the optimization, steps 1-2 are applied to x^{j}_{\mathrm{adjustable}}\left(t\right)|_{t=t_{i}+\Delta t}^{t=t_{i}+t_{\mathrm{range}}} .2 ML-driven Optimization Methodology To solve the inconveniency of the point-wise classical optimization and reduce a necessity of the iterative solution of the NP-hard problem for any t_{\mathrm{range}} data snippet requiring optimization, a ML-driven approach for target control is proposed. The key idea of the following section is that training a machine learning model M_{\mathrm{optim}}\left(x,w\right):X\left(t\right)|_{t}^{t-\Delta t+t_{\mathrm{range}}}\rightarrow x^{j}_{\mathrm{adjustable}}\left(t\right)|_{t}^{t-\Delta t+t_{\mathrm{range}}} to mimic the best optimization policy of the industrial process target control, substitutes the point-wise optimization of x^{i}_{\mathrm{adjustable}} values to the problem of finding the best approximation of the model’s weights w . The training of M_{\mathrm{optim}}\left(x,w\right) involves the Oracle function f , capable of predicting the resulting x_{\mathrm{target}}\left(t_{i}+t_{\mathrm{range}}\right) on the basis of X\left(t\right)|_{t_{i}}^{t_{i}+t_{\mathrm{range}}-\Delta t} and required for weights tuning through a loss-function backpropagation in Stochastic Gradient Descent (SGD). Algorithm 2 ML-driven target control training 1. On the i -th step of the algorithm, optimizer M_{\mathrm{optim}}\left(x,w\right) maps \left(K+1\right)\cdot t_{\mathrm{range}}/\Delta t values of \left(x^{j}_{\mathrm{non-adjustable}},\;x_{\mathrm{target}}\right) into the best optimization policy values \hat{x}^{j}_{\mathrm{adjustable}} 2. Then, the Oracle function f predicts the value of x_{\mathrm{target}}\left(t_{i}+t_{\mathrm{range}}\right)=f\left[\left(\hat{x}^{j}_{\mathrm{adjustable}},\;x^{j}_{\mathrm{non-adjustable}},\;x_{\mathrm{target}}\right)\right] 3. Loss function \mathrm{Loss}\left(x_{t_{i}}\right)=\left|x_{\mathrm{target}}\left(t_{i}+t_{\mathrm{range}}\right)-x_{\mathrm{ideal}}\right| is used to tune weights w of M_{\mathrm{optim}}\left(x,w\right) through backpropagation: w^{(i+1)}:=w^{i}-\alpha\frac{\partial Loss}{\partial w^{i}} 4. On the i+1 -th step of the training, steps 1-3 are repeated to x^{j}_{\mathrm{adjustable}}\left(t\right)|_{t=t_{i}+\Delta t}^{t=t_{i}+t_{\mathrm{range}}} and so on In Alg. 2 , the training of the M_{\mathrm{optim}}\left(x,w\right) is iteratively explained for each of \left\lceil{(t_{1}-t_{\mathrm{min}})/t_{\mathrm{range}}}\right\rceil windows of historical data. After training is performed, same M_{\mathrm{optim}}\left(x,w\right) may be applied to the stabilization of some industrial process on any unseen data, which we propose to do autoregressively (Section .5 ). Key advantages of the novel methodology include its time-resources efficiency, which is shown in Section .5 and scaling possibility, as the Oracle expressivity defines quality of the optimization policy in its prediction of the system feedback. .3 Dataset Figure 2: An explicit comparison of a) point-wise optimization to the b) ml-driven optimization, based on the proposed variables to weights optimization substitution (Alg. 2 ) To comprehensively test proposed methodology, a synthetic dataset based on a thermal conductivity problem is assembled. A key idea is to simulate a practically relevant problem of room temperature T\left(t\right) control with a change of the heater current I\left(t\right) based on the real experimental measurements. For that purpose, air properties (absolute humidity \mathrm{AH}\left(t\right) and pressure p\left(t\right) ) in the room and environmental temperature data T_{0} is collected. The differential equation describing the interaction between room and external environment presented as Newton’s law of cooling with constant of losses k Davidzon_2012 with an addition of the Joules heating term I\left(t\right)^{2}\cdot R \left(R=10\ \Omega\right) : \frac{\partial T}{\partial t}=\frac{I\left(t\right)^{2}\cdot R}{C_{p}}-\frac{k}{C_{p}}\left(T\left(t\right)-T_{0}\left(t\right)\right) (1) With C_{p}=C_{0}+\alpha\cdot\text{SH}\left(t\right) , \alpha=1.82\ \frac{\mathrm{kJ}}{\mathrm{kg}\cdot^{\mathrm{\circ}}\mathrm{C}} — an impact factor of the special humidity (which can be obtained from \mathrm{AH}\left(t\right) and p\left(t\right) ) on the heat capacity of moist air, C_{0}=1.005\ \frac{\mathrm{kJ}}{\mathrm{kg}\cdot^{\mathrm{\circ}}\mathrm{C}} - constant corresponding to the normal air heat capacity Wong_Embleton_1984 . A historical current data I\left(t\right) is modeled as: I\left(t\right)=C_{0}\sin\left(\Omega_{0}t\right)+\sum_{i=1}^{2}C_{i}\exp\left(-\omega_{i}t\right)\left|\sin(\Omega_{i}t)\right|+\mathcal{N}\left(0,0.2\right) With randomly sampled \left\{C_{i},\;\omega_{i},\;\Omega_{i}\right\} such a way, to satisfy characteristic time of the exterior temperature