Efficient Hybrid SE(3)-Equivariant Visuomotor Flow Policy via Spherical Harmonics for Robot Manipulation

Qinglun Zhang, Shen Cheng, Tian Dan, Haoqiang Fan, Guanghui Liu, Shuaicheng Liu · 2026

Read Efficient Hybrid SE(3)-Equivariant Visuomotor Flow Policy via Spherical Harmonics for Robot Manipulation by Qinglun Zhang, Shen Cheng, Tian Dan, Haoqiang Fan, Guanghui Liu, Shuaicheng Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23227.txt.

Introduction

Zhang and five co-authors present E3Flow, a robot policy built on SE(3)-equivariant flow. Past equivariant methods save training data but cost much compute and often use one input type. E3Flow pairs rectified flow with stable equivariant learning over mixed inputs. Spherical harmonics give it rotation symmetry. A feature module fuses point clouds and images into those features. On eight MimicGen tasks and four real trials, it gains 3.12 percent in success rate over the prior best. It also runs seven times faster.

Catalog record

CREATORQinglun Zhang, Shen Cheng, Tian Dan, Haoqiang Fan, Guanghui Liu, Shuaicheng Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44788
LICENSEhttp://creativecommons.org/publicdomain/zero/1.0/
RIGHTSCC0
SOURCEarXiv

Source: https://arxiv.org/abs/2603.23227

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Efficient Hybrid SE(3)-Equivariant Visuomotor Flow Policy via Spherical Harmonics for Robot Manipulation Qinglun Zhang, Shen Cheng, Tian Dan, Haoqiang Fan, Guanghui Liu, Shuaicheng Liu Abstract While existing equivariant methods enhance data efficiency, they suffer from high computational intensity, reliance on single-modality inputs, and instability when combined with fast-sampling methods. In this work, we propose E3Flow , a novel framework that addresses the critical limitations of equivariant diffusion policies. E3Flow overcomes these challenges, successfully unifying efficient rectified flow with stable, multi-modal equivariant learning for the first time. Our framework is built upon spherical harmonic representations to ensure rigorous SO(3) equivariance. We introduce a novel invariant Feature Enhancement Module (FEM) that dynamically fuses hybrid visual modalities (point clouds and images), injecting rich visual cues into the spherical harmonic features. We evaluate E3Flow on 8 manipulation tasks from the MimicGen and further conduct 4 real-world experiments to validate its effectiveness in physical environments. Simulation results show that E3Flow achieves a 3.12% improvement in average success rate over the state-of-the-art Spherical Diffusion Policy (SDP) while simultaneously delivering a 7 × \times inference speedup. E3Flow thus demonstrates a new and highly effective trade-off between performance, efficiency, and data efficiency for robotic policy learning. Code: https://github.com/zql-kk/E3Flow . Figure 1 : (a) Diagram of the E3Flow equivariant policy. E3Flow can learn equivariant trajectories under unseen scene transformations, whereas DP fails due to the lack of symmetry priors. (b) Comparison of average success rates and inference efficiency between state-of-the-art equivariant and non-equivariant policies on MimicGen tasks. 1 Introduction Diffusion-based policies 2 ; 46 ; 33 ; 34 have significantly advanced robotic policy learning, adeptly modeling complex, multimodal action distributions through behavior cloning 25 ; 6 . However, their reliance on large, high-quality expert datasets, which are costly and labor-intensive to acquire, hinders their real-world practicality. Consequently, enhancing data efficiency remains a critical challenge for robotic agents. A highly effective strategy for improving data efficiency and generalization is leveraging symmetries inherent in robotic tasks. Since the physical world is replete with symmetries, this property, known as equivariant learning 3 ; 9 ; 11 , can drastically reduce data requirements. For instance, as shown in Fig. 1 (a), when the toy on the table is rotated to an unseen pose, the non-equivariant network (DP) 2 fails to grasp it due to the absence of symmetry priors, whereas our equivariant network (E3Flow) can successfully derive the correct grasping trajectory by correspondingly rotating the original one, without requiring any additional expert demonstrations. Extensive studies confirm that embedding such symmetry priors into diffusion models significantly boosts performance and data efficiency 35 ; 31 ; 46 ; 28 ; 27 . Despite their promise, existing equivariant diffusion policies face two major hurdles. First, they are computationally intensive 18 ; 19 , limiting real-time use. Second, they typically rely on single-modality visual inputs (e.g., point clouds or images), which often miss the fine-grained details crucial for complex manipulation. These challenges restrict the potential of equivariant diffusion policies in real-world applications. While fast sampling methods, such as one-step diffusion or flow-based models, have been proposed, they have not been successfully integrated with equivariant policies 10 ; 7 ; 37 ; 8 . Current imitation learning–based fast-sampling methods like FlowPolicy 40 and Consistency Policy 26 generally ignore symmetry priors. Meanwhile, as we demonstrate in Sec. 4.3 , directly applying these methods to equivariant policy learning leads to instability and performance degradation, particularly as task complexity increases. This leaves a critical gap: a method that combines the data efficiency of equivariance with the speed of fast sampling. In this work, we address these limitations by proposing E3Flow, a unified framework for multi-modality equivariant policy learning that is also highly sample efficient. Firstly, our method employs spherical harmonic representations 19 to achieve stable and rigorous SO(3)-equivariant embeddings, ensuring feature consistency under rotational transformations. Next, we integrate point clouds and images as two complementary visual modalities to enable fine-grained perception of complex scenes. To fuse these modalities, we further propose a feature enhancement module (FEM) that dynamically adjusts the weights between modalities, injecting fine-grained semantic cues from images into the spherical harmonic representations of point clouds, thereby significantly enhancing the expressiveness and visual sensitivity of the equivariant features. We evaluate E3Flow on 8 manipulation tasks from the MimicGen benchmark, as illustrated in Fig. 1 (b). Our method achieves a 3.12% improvement in average success rate over the strongest baseline, Spherical Diffusion Policy (SDP) 46 , while simultaneously delivering a 7 \times speedup in inference. Real-robot experiments further validate E3Flow’s substantial progress toward practical deployment of equivariant policies. In summary, our key contributions are as follows: • We present E3Flow, the first flow matching policy based on spherical harmonic representations, which generates high-quality actions through stable SO(3) embeddings and efficient flow modeling. • We design an invariant feature enhancement module (FEM) under hybrid visual modalities, dynamically injecting fine-grained visual cues into 3D invariant features for more expressive representations. • We conduct extensive experiments on both the MimicGen benchmark and in the real-world to demonstrate the effectiveness of E3Flow. 2 Related Work Figure 2 : Overall pipeline. E3Flow encodes multimodal inputs through equivariant and non-equivariant visual encoders, aligns invariant visual features across modalities, and constructs a spherical harmonic–equivariant representation to efficiently guide flow matching for generating high-quality equivariant actions. 2.1 Imitation Learning with Diffusion Models Imitation learning (IL) 14 , particularly through behavioral cloning (BC), faces two primary challenges: cumulative errors 43 and limited generalization due to the multimodality of expert demonstrations. Action chunking can address the former 43 , diffusion and flow-based models are increasingly used to handle the latter, proving effective for modeling multimodal actions in robotics 2 ; 40 ; 41 . However, the performance of these generative models is fundamentally constrained by the expert dataset. Specifically, data quality determines the fidelity of the generated actions, while data diversity dictates the model’s generalization ability. Therefore, enhancing data efficiency emerges as a key factor in improving an agent’s generalization. 2.2 Equivariant Learning in Robotics Enhancing data inputs and refining architectures boosts data efficiency 23 . Prior work has leveraged richer 3D information 38 ; 30 ; 5 , powerful foundation models 16 ; 1 ; 15 , and hybrid visual 3D representations 44 . Alternatively, learning the abundant 3D symmetries in the physical world can significantly boost efficiency and generalization to unseen object poses. In robotics, equivariant learning has been applied to pose estimation 29 ; 4 , grasp detection 45 ; 20 , reinforcement learning (RL) 32 ; 42 , and imitation learning 35 ; 31 ; 36 ; 46 . However, most equivariant policies still rely on supervised or RL frameworks, requiring large-scale interaction data and heavy computation. By contrast, combining equivariant representations with generative modeling offers an efficient, symmetry-consistent approach. Our work integrates SE(3)-equivariant modeling and multi-modal enhanced representations with flow-based policy learning to achieve both data efficiency and fast visuomotor inference. 2.3 Equivariant Diffusion Policy Learning Recent generative models have become popular in robotics for their strong multimodal action generation capabilities. One critical line of research has focused on equivariant learning to ensure policies generalize across different 3D poses. This has led to several diffusion-based methods, including EquiBot 35 (using vector neurons), EquiDiff 31 (discrete SO(2)

Read the complete text