Deep Reinforcement Learning-Enhanced Event-Triggered Data-Driven Predictive Control for a 3D Cable-Driven Soft Robotic Arm
Cheng Ouyang, Moeen Ul Islam, Kaixiang Zhang, Zhaojian Li, Xiaobo Tan, Dong Chen · 2026
Read Deep Reinforcement Learning-Enhanced Event-Triggered Data-Driven Predictive Control for a 3D Cable-Driven Soft Robotic Arm by Cheng Ouyang, Moeen Ul Islam, Kaixiang Zhang, Zhaojian Li, Xiaobo Tan, Dong Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26048.txt.
Introduction
Cheng Ouyang and colleagues cut the computing cost of controlling a soft robotic arm. Soft robots bend in complex, shifting ways, so model-free control is attractive. Data-enabled predictive control builds forecasts straight from measured input-output data. Its catch is solving a hard optimization at every time step. Small robot hardware struggles to keep up.
A reinforcement learning policy learns when the optimizer is truly needed. The event-triggered design skips needless calls and preserves tracking quality. In simulation, optimizer calls fall by up to sixty-six percent. Accuracy stays comparable to running the optimizer every step. Hardware tests use a three-dimensional cable-driven soft arm. The controller transfers from simulation with no retraining. Optimizer calls fall by thirty-four percent there. Performance also beats a fixed threshold rule for triggering, giving smoother and more consistent control.
Catalog record
| CREATOR | Cheng Ouyang, Moeen Ul Islam, Kaixiang Zhang, Zhaojian Li, Xiaobo Tan, Dong Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26048
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deep Reinforcement Learning-Enhanced Event-Triggered Data-Driven Predictive Control for a 3D Cable-Driven Soft Robotic Arm Cheng Ouyang, Moeen Ul Islam, Kaixiang Zhang, Zhaojian Li, Xiaobo Tan, Dong Chen Abstract Soft robots are challenging to control due to their nonlinear and time-varying dynamics. Data-enabled predictive control (DeePC) offers a model-free alternative by directly leveraging measured input–output trajectories to construct a predictive controller. However, its receding-horizon formulation requires solving a constrained optimization problem at every sampling instant, which can be computationally demanding for real-time deployment on resource-limited robotic platforms. To address this limitation, we propose an adaptive reinforcement-learning-based event-triggered DeePC (RL-ET-DeePC) framework for soft robotic control. A model-free RL policy is trained to determine when to invoke the DeePC optimizer based on the current system state representation, thereby reducing unnecessary optimization calls while preserving closed-loop performance. Simulation results show that RL-ET-DeePC reduces optimization frequency by up to 66% compared to periodic DeePC, while maintaining comparable tracking accuracy. Hardware experiments on a three-dimensional cable-driven soft robotic arm demonstrate zero-shot transfer, achieving a 34% reduction in optimization frequency with tracking accuracy comparable to periodic DeePC and more consistent performance than a static threshold-based event-triggered baseline. I INTRODUCTION Soft robots have attracted significant attention due to their inherent compliance and safety, enabling applications in minimally invasive surgery [ 16 ] , deep-sea exploration of fragile biological specimens [ 6 ] , and safe human-robot interaction in shared environments [ 13 ] . Their ability to undergo continuous deformation allows them to adapt effectively to unstructured and contact-rich tasks [ 17 ] . Despite their versatility, controlling soft robotic arms remains a significant challenge due to the difficulty of developing accurate yet computationally tractable models [ 19 ] . Unlike rigid robots, which can be described using standard rigid-body dynamics, soft robots exhibit theoretically infinite degrees of freedom and complex behaviors such as strong nonlinearity and time-varying deformation [ 21 ] . Fig. 1 : Illustration of the proposed RL-ET-DeePC framework. The upper block shows pre-data collection and SVD-based Hankel matrix reduction. The lower block depicts the real-time event-triggered control loop, where the RL policy determines whether to trigger the SVD-DeePC optimizer or reuse buffered inputs under supervisory constraints. Traditional approaches, such as Finite Element Methods (FEM) or analytical formulations based on continuum mechanics (e.g., Cosserat rods), can capture soft-robot deformations with high fidelity [ 20 , 15 , 1 ] . However, these methods typically require solving high-dimensional partial differential equations (PDEs), making them computationally prohibitive for real-time control, particularly on embedded platforms [ 5 ] . To overcome the limitations of explicit physical modeling, data-driven control strategies have emerged as an attractive alternative. Among them, data-enabled predictive control (DeePC) [ 3 ] has gained significant attention. By directly leveraging measured input-output trajectories to characterize system behavior, DeePC eliminates the need for parametric model identification while retaining the constraint-handling capabilities of optimization-based control methods, such as model predictive control (MPC) [ 9 ] . Recent studies have explored the application of DeePC to soft robotic control [ 23 , 22 , 12 ] . For instance, Wang et al. [ 23 ] applied DeePC to a planar soft robot, demonstrating safe and optimal control directly from input–output data without requiring explicit system identification. In subsequent work, Wang et al. [ 22 ] proposed an incremental data-driven formulation that achieves robust and optimal control under unknown payload variations, mitigating performance degradation without relying on weighted datasets or disturbance estimators. Extending DeePC to spatial manipulation, Ouyang et al. [ 12 ] applied the framework to a three-dimensional (3D) cable-driven soft robotic arm, achieving both fixed-point regulation and trajectory tracking in 3D space. Despite these advances, DeePC operates in a receding-horizon manner, requiring the solution of a constrained optimization problem, typically a quadratic program, at every sampling instant [ 3 ] . For soft robotic systems that demand high sampling rates to capture fast transient behaviors and nonlinear deformation dynamics, this repeated re-optimization imposes a substantial computational burden, limiting real-time deployment on resource-constrained platforms. To mitigate the computational burden in receding-horizon control frameworks, event-triggered control (ETC) mechanisms have been widely explored in optimization-based approaches, including MPC [ 4 ] and Koopman-based predictive control [ 8 ] . Recently, this paradigm has been extended to data-driven frameworks. For example, Wang et al. [ 24 ] proposed an aperiodic data-driven predictive control scheme with terminal ingredients that guarantees recursive feasibility and stability. Similarly, Yang et al. [ 26 ] developed an event-triggered strategy for multirate systems, where optimization updates are activated based on an accumulated error threshold. However, existing event-triggered methods typically rely on static, heuristic triggering rules, such as fixed error thresholds or manually tuned performance factors [ 24 , 26 ] . For soft robotic arms characterized by strongly nonlinear and time-varying dynamics, determining a globally optimal static threshold is inherently challenging. A conservative threshold often yields limited computational savings, whereas a relaxed threshold may lead to degraded tracking performance. Moreover, event-triggered DeePC remains relatively underexplored, particularly in scenarios that require adaptive and state-dependent update strategies to balance control accuracy and computational efficiency. To address these challenges, we propose a r einforcement- l earning-based e vent- t riggered DeePC (RL-ET-DeePC) framework for soft robotic control. The proposed method integrates singular value decomposition (SVD)-based dimensionality reduction with a learned state-dependent triggering mechanism, where an RL agent determines whether to invoke the computationally expensive DeePC optimization or reuse previously computed control inputs (Fig. 1 ). By adaptively balancing tracking accuracy and computational cost, the framework transforms conventional periodic DeePC into an event-driven predictive controller. The approach is validated through extensive simulations and hardware experiments on a 3D cable-driven soft robotic arm. Results demonstrate substantial reductions in optimization frequency compared to periodic DeePC, while achieving superior performance over static threshold-based event-triggered baselines. To promote reproducibility, the complete hardware design, source code, and simulation environment are publicly available online 1 1 1 Codes and designs: https://github.com/chengoy30/RL-ET-DeePC-for-soft-robotic-arm-control.git . II Hardware Design To evaluate the proposed RL-ET-DeePC framework, a 3D cable-driven soft robotic arm is employed, as depicted in Fig. 2 . The mandrels utilized during the casting process, the fabricated silicone module, and the completed prototype are shown in Fig. 2(a) , Fig. 2(b) , and Fig. 2(c) , respectively. The platform consists of a single soft continuum module (29 mm diameter, 93 mm length) constructed from 3D-printed rigid end caps, a flexible PVC backbone, and a cast silicone elastomer body (Ecoflex 00-50). Three Kevlar tendons are routed through internal helical channels embedded in the silicone body and anchored to the distal end cap. Their proximal ends exit the base and are actuated by stepper motors through a pulley transmission system. Differential cable actuation induces bending deformation, enabling continuous curvature motion in three-dimensional space. The soft continuum structure exhibits pronounced nonlinear, hysteretic, and configuration-dependent dynamics due to material elasticity and tendon–structure coupling. These characteristics make accurate physics-based modeling difficult and computationally intensive for real-time control, thereby providing a representative benchmark for evaluating data-driven predictive control strategies. (a) (b) (c) Fig. 2 : 3D cable-driven soft robotic arm: (a) casting molds and mandrels; (b) fabricated silicone module with embedded helical tendon-routing channels; (c) fully fabricated soft robotic arm. From a control perspective, we formulate the