HOIST: Humanoid Optimization with Imitation and Sample-efficient Tuning for Manipulating Suspended Loads

Songyang LiuDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Shunyu Yao Department of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Dingyuan HuangDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Shuai LiDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] · 2026

Read HOIST: Humanoid Optimization with Imitation and Sample-efficient Tuning for Manipulating Suspended Loads by Songyang LiuDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Shunyu Yao Department of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Dingyuan HuangDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Shuai LiDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00252.txt.

Introduction

Liu and co-authors help humanoid robots haul loads that hang and swing. A hung load can be steered just by whole-body moves and brief touches. It swings on its own, past the robot's full grasp. Copy-based learning gives a safe start but poor end place marks.

Their frame, HOIST, starts from shows given through a VR rig. A sight-and-word policy learns from those shows first. A whole-body steer tool runs its calls on the real bot. Roll-outs from the policy then feed rounds of batch reward learning. That stage hones place skill and stop skill. Tests in sims and on a real bot beat copy-only runs. Place miss drops by a clear span in both shift and turn.

Catalog record

CREATORSongyang LiuDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Shunyu Yao Department of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Dingyuan HuangDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Shuai LiDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00252

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HOIST: Humanoid Optimization with Imitation and Sample-efficient Tuning for Manipulating Suspended Loads Songyang LiuDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Shunyu Yao Department of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Dingyuan HuangDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Shuai LiDepartment of Civil and Coastal EngineeringUniversity of Florida United States [email protected] Abstract Manipulating suspended payloads with humanoid robots is challenging because the robot can only influence an underactuated, oscillatory load through whole-body motion and intermittent contact. Imitation learning provides safe initial behavior but does not directly optimize final placement, while reinforcement learning from scratch is unsafe and sample-inefficient on real humanoids. We present HOIST – H umanoid O ptimized with I mitation and S ample-efficient T uning for manipulating suspended loads. HOIST first finetunes a high-level vision-language-action (VLA) policy from virtual-reality (VR) teleoperation demonstrations and executes its commands through a whole-body controller. It then uses VLA rollouts and iterative batched RL to improve placement accuracy and stopping behavior. Experiments in simulation and on a real humanoid show that HOIST improves over imitation-only and additional-demonstration baselines; compared with pure VLA rollouts, HOIST reduces translational placement error by 19.9 c ​ m cm and raw angular error by 3.56 ∘ , demonstrating the potential of humanoids for underactuated material-handling tasks. Keywords: Robot manipulation, Reinforcement learning for physical robot control Figure 1: Motivation and task setup for humanoid hoisting. Left: workers manually guide a suspended payload during construction hoisting, exposing them to struck-by and caught-between hazards. Right: our lab setup studies a humanoid robot pushing an externally suspended payload toward a target region, requiring whole-body balance, contact-rich pushing, and accurate stopping. Left image adapted from online material [ 11 ] . 1 Introduction Material handling often involves underactuated systems: payloads are not rigidly grasped or directly actuated, but are influenced through cables, hooks, slings, cranes, carts, or intermittent human contact. Such systems are common in construction, manufacturing, shipbuilding, logistics, and warehousing, where heavy payloads are transported by lifting equipment and then manually guided into their final positions. Hoisting is a representative example. Although cranes provide the primary lifting capability, final placement often still requires workers to stand near suspended loads and guide, stabilize, or push them by hand. Because suspended payloads can swing, respond with delay, and keep moving after contact, this stage creates struck-by and caught-between hazards [ 16 , 25 , 15 , 17 ] . Fig. 1 illustrates both real hoisting operations and our lab setup, motivating the question: can humanoid robots safely operate around underactuated material-handling systems that are currently handled by human workers? We study this question through humanoid hoisting : using a humanoid robot to position an externally suspended payload through whole-body motion and contact-rich manipulation. Unlike standard pick-and-place or tabletop manipulation, the robot cannot directly control the payload pose or velocity; it can only influence the payload through base motion, arm motion, body posture, and contact forces. The payload therefore behaves like an underactuated pendulum, a structure widely studied in crane modeling and anti-sway control [ 1 , 22 , 20 , 14 ] . It may continue moving after the robot stops, overshoot the target, or retain residual oscillation. We therefore position humanoid hoisting as a new whole-body loco-manipulation problem, where success depends not only on feasible humanoid motion, but also on contact timing and stopping behavior for a dynamically active payload. VR teleoperation offers a practical way to collect demonstrations for initializing humanoid hoisting behaviors [ 29 , 23 , 9 ] . However, imitation learning does not directly optimize final placement accuracy and may accumulate errors during closed-loop execution [ 24 ] . Conversely, training from scratch with RL on a real humanoid is unsafe and sample-inefficient in this contact-rich setting [ 21 , 26 ] . We present HOIST – H umanoid O ptimized with I mitation and S ample-efficient T uning for manipulating suspended loads. HOIST first uses VR whole body teleoperation collected demonstrations to finetune a high-level vision-language-action (VLA) policy, whose planner-level commands are executed by a whole-body controller. It then collects autonomous rollouts and applies iterative batched RL refinement with hoisting-specific rewards to improve placement accuracy and stopping behavior. This combines safe imitation initialization with task-level reward optimization, avoiding unsafe tabula-rasa exploration while addressing objectives not captured by imitation alone. Our contributions are: • We introduce humanoid hoisting , a whole-body loco-manipulation problem involving an externally suspended, indirectly driven, and oscillatory payload, opening a direction for humanoids to operate underactuated material-handling systems. • We present HOIST , which combines VR teleoperation, supervised VLA finetuning, fixed whole-body execution, and sample-efficient RL refinement for suspended-payload manipulation. • We evaluate suspended-payload positioning in simulation and on a real humanoid, comparing additional demonstrations with RL refinement and analyzing how rollout count and input modalities affect placement accuracy. 2 Related Work Robotic hoisting and suspended-payload control. Robotic systems have been widely studied for construction automation and material handling [ 4 , 27 ] , where hoisting heavy payloads is common. Because suspended loads exhibit pendulum-like dynamics, prior work has studied modeling, trajectory planning, input shaping, and anti-sway control for crane and cable-suspended systems [ 1 , 22 , 20 , 10 ] . These methods typically control the lifting mechanism directly, whereas humanoid hoisting can only influence an externally suspended payload through intermittent whole-body contact. Our work therefore reformulates suspended-payload positioning as humanoid-assisted local manipulation, where the robot acts as an external contact-rich agent rather than part of the crane controller. Humanoid whole-body control and loco-manipulation. Humanoid whole-body control has advanced from motion tracking to real humanoid systems with richer high-level interfaces [ 18 , 19 , 2 , 12 , 3 , 13 ] . Humanoid loco-manipulation further studies coordinated locomotion, balance, and contact-rich interaction through motion priors, residual policies, and compliance regulation [ 28 , 30 , 31 , 5 ] . However, most prior tasks involve rigid or quasi-static objects whose motion is constrained by the robot or environment. In contrast, suspended payloads remain dynamically active after contact, making success depend on contact timing, accurate placement, and stopping behavior. Reinforcement learning for robot control. Reinforcement learning can optimize robot behavior from task rewards and environment interaction, including high-dimensional contact-rich manipulation [ 21 , 6 ] . However, applying RL directly to humanoid hoisting is unsafe and sample-inefficient: early exploration may cause unstable motion, hard contacts, over-pushing, or large residual swing, motivating safety-aware and demonstration-guided learning [ 7 , 8 ] . Our approach avoids tabula-rasa exploration by starting from a teleoperation-finetuned VLA policy and using RL to refine high-level commands from limited rollouts, optimizing placement and stopping while preserving safe demonstrated behavior [ 26 ] . 3 Methodology This section describes the technical formulation and implementation of HOIST . We first define the humanoid hoisting problem, then present the teleoperation data collection, high-level VLA policy, whole-body controller, and RL refinement procedure used to improve final payload placement. Figure 2: Overview of humanoid hoisting. Left: in standard pick-and-place, the robot directly actuates the object and receives an immediate object response. Middle: in humanoid hoisting, the payload is externally suspended and underactuated, so the robot can only influence it through whole-body contact; this

Read the complete text