OpenAI’s Robots Learn From Humans In VR

Teaching robots complex tasks is going to be much easier in the future. There are already various methods to do it. OpenAi has developed a robotic system that allows robots to learn from humans by just watching tasks done in a VR environment. The  one-shot imitation learning allows humans to show new tasks to robots.

The system is powered by two neural networks: a vision and an imitation network. Here is how it works:

The vision network ingests an image from the robot’s camera and outputs state representing the positions of the objects. The imitation network observes a demonstration, processes it to infer the intent of the task, and then accomplishes the intent starting from another starting configuration. The network learns this from the distribution of training examples. It is trained on dozens of different tasks with thousands of demonstrations for each task. Each training example is a pair of demonstrations that perform the same task.

More info is available here.

*some of our articles have aff links. Please read our disclaimer on how we fund Exxponent.
Read more:
CUFF Lisa Smart Necklace

Meet the CUFF Lisa Smart Necklace: a stylish smart wearable device that allows you to stay safe and connected. When...

Paralyzed Woman Controls Robotic Arm with Thoughts

In the past few months, we have covered plenty of advanced prosthetic limbs and robotic arms for amputees. These solutions...

Leap’s Interaction Engine: Grab & Interact with VR Objects

Meet Leap's Interaction Engine: an innovative solution that allows developers to develop more dynamic VR experiences. Users will be able...

Close