TWIST: Teleoperated Whole Body Imitation System for Humanoid Robots

There are plenty of teleoperation systems available these days. Most of these robots are limited to basic manipulation tasks. TWIST (Teleoperated Whole-Body Imitation System) allows for teleoperation of humanoids through whole-body motion imitation. To do this, researchers generated “reference motion clips by retargeting human motion capture data to the humanoid robot.” They then generated a responsive whole-body controller with reinforcement learning and behavior cloning.

Thanks to this approach, humanoid robots can achieve more dynamic movement when teleoperated. They will be able to open a fridge, clean a cabinet, pick up boxes, reach down, dance, and box.

[HT]