Dual-arm VR teleoperation

2× Elite Robots CS66 Meta Quest 3 Real-time C++ ROS 2 Anchor/clutch control

Two arms, following my hands

Both industrial arms follow my hand movements live, streamed from Meta Quest 3 controllers. Here they pass a block from one gripper to the other, every motion driven by me. Built at Nferent AI; the clip is narrated, so sound on.

Teleoperation, seen through the headset

The same rig from my side of it — recorded through the Quest: a controller in hand and both CS66 arms tracking it in real time. Roughly what I'm looking at while I drive them.

How it works

A real-time C++ control loop maps controller poses to end-effector targets through SE(3) transforms.
A clutch lets me "let go" mid-task: release to freeze the robots, re-position my hands comfortably, re-engage and continue — like lifting a mouse off the desk.
A safety layer clamps workspace limits, end-effector velocity, and command rates before anything reaches the hardware.

Links

Demo on YouTube