Coordinating Spinal and Limb Dynamics for Enhanced Sprawling Robot Mobility
Merve Atasever, Ali Okhovat, Azhang Nazaripouya, John Nisbet, Omer Kurkutlu, Jyotirmoy Deshmukh, Yasemin Ozkan-Aydin · 2025
Read Coordinating Spinal and Limb Dynamics for Enhanced Sprawling Robot Mobility by Merve Atasever, Ali Okhovat, Azhang Nazaripouya, John Nisbet, Omer Kurkutlu, Jyotirmoy Deshmukh, Yasemin Ozkan-Aydin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-14103.txt.
Introduction
Merve Atasever and co-authors published a 2025 paper on a salamander-inspired robot that walks by wiggling its spine and limbs together. Sprawling animals undulate their bodies as they step, gaining stability and grip on rough ground. Robots copying only the legs, or learning everything from scratch, fall short: fixed gaits cannot adapt, and pure machine learning is data-hungry and erratic on real hardware.
The team fused the two approaches. A classical gait design, grounded in how sprawlers actually move, supplies the skeleton of the motion. Deep reinforcement learning then tunes the coordination of spine and limbs on top of it. The hybrid aims for the biologist's reliability with the learner's adaptability. Tests target mobility across complex terrain, where the spine's contribution should pay off most. The work argues that animal movement is a control strategy, not just a shape, and robots inherit it best in layers.
Catalog record
| CREATOR | Merve Atasever, Ali Okhovat, Azhang Nazaripouya, John Nisbet, Omer Kurkutlu, Jyotirmoy Deshmukh, Yasemin Ozkan-Aydin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 8 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-14103
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Coordinating Spinal and Limb Dynamics for Enhanced Sprawling Robot Mobility
Merve Atasever, Ali Okhovat, Azhang Nazaripouya, John Nisbet, Omer Kurkutlu, Jyotirmoy Deshmukh, Yasemin Ozkan-Aydin
Abstract
I
INTRODUCTION
Among vertebrates, salamanders, with their unique ability to transition between walking and swimming gaits, highlight the role of spinal mobility in locomotion
[
1
]
. A flexible spine enables undulation of the body through a wavelike motion along the spine, aiding navigation over uneven terrains and obstacles
[
2
]
. Yet environmental uncertainties, such as surface irregularities and variations in friction, can significantly disrupt body-limb coordination and cause discrepancies between predictions from mathematical models and real-world outcomes. Addressing this challenge requires the development of sophisticated control strategies capable of dynamically adapting to uncertain conditions while maintaining efficient locomotion. Deep reinforcement learning (DRL) offers a promising framework for handling non-deterministic environments and enabling robotic systems to adapt effectively and perform robustly under challenging conditions
[
3
,
4
,
5
,
6
,
7
]
.
In this study, we comparatively examine learning-based control strategies and biologically inspired gait design methods on a salamander-like robot (Fig.
1
). We evaluate two distinct robot configurations: one employing a fixed spinal joint and another featuring an active spinal joint. Specifically, we train and evaluate the robot under various scenarios and compare these results in our experimental section. Building on these findings, we observed that integrating biologically inspired approaches such as the Hildebrand gait model with learning-based methods can yield robust and efficient locomotion patterns. Motivated by this, our ongoing work explores the combination of deep reinforcement learning with central pattern generators (CPGs), aiming to leverage the adaptability of DRL and the rhythmic stability of CPGs. We have successfully developed a modular Hopf oscillator-based CPG framework and tested it on our salamander-like robot, demonstrating its potential to generate coordinated locomotion patterns across multiple limbs.
Fig. 1:
(left) The fire salamander (
Salamandra salamandra
) is a common species of salamander found in Europe. (middle) The robot model in the Mujoco simulation world. (right) 3D printed robotic salamander.
II
Methods
II-A
Open-Loop Hildebrand Gait Design Method.
In this study, we utilized the Hildebrand gait analysis method
[
8
,
9
]
, a well-established technique employed in studying four-legged animal locomotion. The prior analytical method
[
10
]
, employing Hildebrand gait analysis, offers a robust framework for comprehensively grasping the dynamics of body undulation alongside limb movements during terrestrial locomotion. Their findings indicate that incorporating an active spinal joint and utilizing geometric mechanics significantly enhances the robot’s speed and flexibility compared to a passive spinal joint. In the open-loop gait pattern, one walking cycle represents the complete motion of the robot’s legs from a specific starting position to the next occurrence of that same position. Throughout this cycle, each leg spends 25% of the time in the air and 75% of the time on the ground. Figure
2
illustrates the position of each joint while following the Hildebrand-style gait within one walking cycle. This gait pattern iterated until the robot reached its designated goal position.
Fig. 2:
Joint positions during one walking cycle following the Hildebrand-style gait for both the passive and active spinal joint scenarios. Each leg spends 25% of the cycle in the air and 75% on the ground.
II-B
Deep Reinforcement Learning
Reinforcement learning (RL) provides a formulation to solve sequential decision-making problems in which robot learning lies
[
11
,
12
,
13
]
. In our work, we leverage Soft Actor-Critic (SAC) algorithm which is an off-policy reinforcement learning algorithm improving traditional actor-critic methods by adding entropy regularization to incentive exploration:
\pi^{*}=\arg\max_{\pi}\mathbb{E}_{\tau\sim\pi}\left[\sum_{t=0}^{\infty}\gamma^{t}\left(R(s_{t},a_{t},s_{t+1})+\alpha H\left(\pi(\cdot|s_{t})\right)\right)\right]
(1)
where
H(X)=-\sum_{x\in\mathcal{X}}P(x)\log P(x)
(2)
represents the entropy term. Here,
\alpha>0
is a trade-off parameter that balances the reward function and the entropy term, and hence exploration and exploitation
[
12
]
. The SAC algorithm is capable of handling high dimensional observation and continuous action spaces while maintaining stability during learning.
Fig. 3:
(Left) Observation space for the 8-joint and 9-joint robot configurations. (Right) RL Learning Curves
Fig.
3
(left) presents the observation space for both the 8-joint (no spinal joint) and 9-joint robot configurations, while the action space consists of joint angles (in radians) in our setup. The reward function is inspired by MuJoCo’s ant environment as well as previous work on quadruped robots
[
14
,
15
]
to encourage efficient moves towards the goal while maintaining stability. It consists of multiple components:
\textbf{R(s, a) }=w_{1}\cdot\Delta x+w_{2}\cdot\Delta d+w_{3}\cdot\Delta y+w_{4}\cdot C+H,
where
\Delta x
represents the change in the x-direction to incentive forward movement,
\Delta d
indicates the change in distance to the goal,
\Delta y
is the change in the y-direction to incentivize the stability and ensure smooth movement,
C
is control cost term to punish the robot for taking excessively large actions, and
H
represents the constant healthy reward (to prevent the robot from jumping or flipping), and
w_{1},w_{2},w_{3},w_{4}
are the corresponding weights.
III
Experimental Results and Discussion
Table
I
compares performance across various robot configurations using three metrics: MDB (minimum distance to goal), ATB (average timesteps to reach goal), and DY (deviation from the y-direction). We evaluated three control approaches -Hildebrand gaits, RL-based control, and a hybrid of the two- each tested with and without torque limits, making a total of six versions. While pure RL achieves the fastest times, it produces aggressive, cheetah-like movements unsuitable for real hardware. Adding torque limits yields smoother behavior, making it more applicable for real-world use. The most promising results are observed when combining Hildebrand-based joint control with RL for the spinal joint.
TABLE I:
Performance comparison across robot versions via
MDB (min. distance to ball), ATB (avg. timesteps
to reach ball), and DY (deviation from y-dir).
Values are presented as mean
\pm
std. over 5 seeds.
Version of the Robot
MDB
\downarrow
ATB
\downarrow
DY
\downarrow
8-joints Hildebrand
0.1
6103
0.03
8-joints RL
0.04
\pm
0.002
104
\pm
1
0.02
\pm
0.001
8-joints RL with torque limit on shoulder and leg joints
0.13
\pm
0.039
334
\pm
17
0.02
\pm
0.001
8-joints Hildebrand + 1 joint RL
0.05
\pm
0.001
1518
\pm
6
0.03
\pm
0.0008
9-joints RL
0.07
\pm
0.008
196
\pm
2
0.04
\pm
0.001
9-joints RL with torque limit on shoulder and leg joints
0.10
\pm
0.004
1931
\pm
1
0.05
\pm
0.002
IV
Conclusion and Future Work
This work explored the effects of spinal mobility and control strategies on a salamander-like robot. Our experiments demonstrated that reinforcement learning (RL) enables the robot to achieve goal-directed locomotion, though often resulting in overly aggressive, cheetah-like gaits. In contrast, biologically inspired gaits, such as the Hildebrand pattern, produce smoother and more stable movement. A hybrid approach, using fixed joint trajectories for the limbs and RL for the spine, yielded more robust and realistic locomotion.