UniCon: A Unified System for Efficient Robot Learning Transfers

Yunfeng Lin, Li Xu, Yong Yu, Jiangmiao Pang, Weinan Zhang · 2026

Read UniCon: A Unified System for Efficient Robot Learning Transfers by Yunfeng Lin, Li Xu, Yong Yu, Jiangmiao Pang, Weinan Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14617.txt.

Introduction

Yunfeng Lin, Li Xu, Yong Yu, Jiangmiao Pang, and Weinan Zhang present a robot software system in this 2026 paper. Deploying learning-based controllers across heterogeneous robots is challenging. Platform differences, inconsistent interfaces, and inefficient middleware all get in the way. A controller tuned on one robot rarely drops cleanly onto another.

Their system, UniCon, is a lightweight framework that standardizes states, control flow, and instrumentation across platforms. It decomposes workflows into execution graphs with reusable components. It also separates system states from control logic, which enables plug-and-play deployment across various robot morphologies. Readers get a path to move learned controllers between robots without rebuilding the stack each time.

Catalog record

CREATORYunfeng Lin, Li Xu, Yong Yu, Jiangmiao Pang, Weinan Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-14617

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

UniCon: A Unified System for Efficient Robot Learning Transfers Yunfeng Lin, Li Xu, Yong Yu, Jiangmiao Pang, Weinan Zhang Abstract Deploying learning-based controllers across heterogeneous robots is challenging due to platform differences, inconsistent interfaces, and inefficient middleware. To address these issues, we present UniCon, a lightweight framework that standardizes states, control flow, and instrumentation across platforms. It decomposes workflows into execution graphs with reusable components, separating system states from control logic to enable plug-and-play deployment across various robot morphologies. Unlike traditional middleware, it prioritizes efficiency through batched, vectorized data flow, minimizing communication overhead and improving inference latency. This modular, data-oriented approach enables seamless sim-to-real transfer with minimal re-engineering. We demonstrate that UniCon reduces code redundancy when transferring workflows and achieves higher inference efficiency compared to ROS-based systems. Deployed on over 12 robot models from 7 manufacturers, it has been successfully integrated into ongoing research projects, proving its effectiveness in real-world scenarios. Figure 1 : Representative use cases of UniCon: Left: synchronized and reusable locomotion across heterogeneous robots. Middle: Modular interoperation of RL policies with VR teleoperation. Right: Real - to - sim data recording and analysis for diagnosing transfer gaps. Data and control flow are standardized across platforms, reducing integration effort and improving efficiency. 1 Introduction Deploying learning - based controllers across heterogeneous robots remains costly due to platform differences and tightly coupled interfaces. These incompatibilities force developers to repeatedly re-implement the same functionalities for each combination of algorithms, robots and simulators. While domain randomization and related sim-to-real techniques ( 57 ; 68 ) shrink the dynamics gap, they do not simplify this last-mile integration. Widely used middleware such as ROS and ROS 2 ( 61 ; 46 ) attempt to provide a standardized communication layer between customized components, but their general - purpose design introduces latency and overhead that hinder high - frequency policy inference ( 56 ; 2 ; 5 ) . At the same time, robot manufacturers complicate the ecosystem further by shipping inconsistent interfaces , making integration and transferability difficult. To address above challenges, we present UniCon, a lightweight framework for robot learning deployments that provides the unifying infrastructure needed to standardize states, control flow, and instrumentation across platforms. UniCon decomposes workflows into execution graphs with reusable basic units, and separates system states – such as proprioceptive, exteroceptive, and control signals – from the logic that consumes them. This enables plug - and - play deployment across diverse morphologies including quadrupeds, humanoids, and manipulators, while unifying hardware with simulators for seamless transfer. Compared to ROS, our architecture adopt a data-oriented modular paradigm with separation between runtime states and control logic. To maximize efficiency, we favor single-threaded computing ( 45 ) over multiprocessing, and vectorized data flow over message passing. On the other hand, interoperability with existing software is still guaranteed by extending the underlying states storage to multiple communication backends ( 20 ; 26 ) . We show that this reduces code redundancy and improves inference latency in our cross-embodiment experiments. Our contributions are threefold: • Unified control framework: We introduce UniCon, a lightweight and efficient framework that bridges mainstream simulators and physical hardware for robot learning. • Modular, data-oriented design: We demonstrate that UniCon enables efficient sim-to-real transfer across diverse robot embodiments with little to no re-engineering effort. • Improved inference efficiency: We show that UniCon achieves higher inference efficiency compared to ROS-based and ad-hoc framework stacks by reducing interfacing and communication overhead. UniCon has already been deployed on over 12 robot models spanning 7 manufacturers , and has supported 3 research projects ongoing in the Shanghai Artificial Intelligence Laboratory, demonstrating its versatility in real research scenarios. We release our framework as open-source at https://github.com/creeperlin/unicon . 2 Framework A key obstacle in sim - to - real and cross-embodiment transfer is the tight coupling of system data flows with customized control logic. Middleware such as ROS enforce a message passing pattern but incurs latency, making it unsuitable for learning - based controllers. Our design instead adopts a modular, data - oriented paradigm that cleanly separates states from logic, emphasizing reusability and efficiency. This approach contrasts with object - oriented programming practices ( 6 ) , where data and routines are encapsulated together, and instead aligns more closely with the Entity Component System architecture widely used in the game industry ( 25 ) and modern simulation engines ( 62 ) . Figure 2 : Architecture of UniCon: (a) global system states with switchable storage backends; (b) modular control blocks covering platform and inference; (c) control flow graph primitives for workflow composition; and (d) unified integration with simulators and hardware. 2.1 Vectorized States We formulate all runtime states of a robot workflow as global array objects of numerical data types under different labels. This comes from the fact that the data passed in structured messages often take a fixed format for each channel if the hardware participants remains constant. Therefore, rather than transmitting full self - describing objects, only the essential multidimensional data are exchanged, eliminating unnecessary encapsulation and aligning with contiguous memory layouts favored by simulators and hardware interfaces. Typically, the states includes robot sensory inputs such as motor position and velocities, as well as orientation and angular velocity reported by the IMU. Similarly, motor commands such as position and torque controls are also states which are written to by controllers and read from by hardware interfaces. In the case where state definitions of custom components differ from the actual hardware, transparent mappings with efficient vectorized indexing operations is inserted to align properties such as joint order. 2.2 Modularized Logic Following the vectorized formulation, we break down workflows into reusable Control Blocks (CB) bridged by global states. For example, operations like receiving hardware states, executing policy inference, handling user inputs, and sending hardware commands are split into individual blocks and connected into an execution graph through standardized control flow. This grants users the ability to shift between controllers, policies and hardware by switching between CBs, without changing the rest of the graph. Formally, we assume the global state space S=\{s_{a},s_{b},\dots,s_{n}\},s_{i}\in{\mathcal{R}}^{k_{i}} is the common domain of all operating logic. Then we define a CB as a pure function with regard to S . It can read a subset of S as inputs and outputs updated values of some other elements in S , and a boolean r indicating its termination. f:S_{in}\mapsto S_{out}\times\{0,1\},S_{in},S_{out}\subseteq S. (1) Stepping the function results in a sequence of calls: T_{f}=(f_{1},f_{2},\dots,f_{n}). (2) A workflow is then constructed by nesting the CBs, forming an execution graph. We provide basic control flow components in similar fasion to functional programming ( 35 ) for composing customized workflows. For example, loop terminates the inner block when the predicate is satisfied, zip executes multiple blocks in sequence, and chain exhausts nested blocks in order until they all halts. \displaystyle\operatorname{loop}(T_{g},p) \displaystyle=(g_{1},g_{2},\dots,g_{k}),p(k)=1, (3) \displaystyle\operatorname{zip}(T_{g},T_{h}) \displaystyle=((g_{1},h_{1}),(g_{2},h_{2}),\dots,(g_{n},h_{n})), \displaystyle\operatorname{chain}(T_{g},T_{h}) \displaystyle=(g_{1},\dots,g_{m},h_{1},\dots,h_{n}). This enables configurations via text formats and possibly GUIs, while also leaves directives for code generation. 2.3 Software Interoperability Communications. UniCon connects its state storage backend to external clients with consistent semantics: writing to arrays publishes data, reading retrieves the latest values. Multiple backends provide flexible performance: lock - free local or shared memory for zero - copy access ( 59 ) , message

Read the complete text