← All work

Dual-arm VR teleoperation

2× Elite Robots CS66 Meta Quest 3 Real-time C++ ROS 2 Anchor/clutch control

Two arms, following my hands

Both industrial arms follow my hand movements live, streamed from Meta Quest 3 controllers — no scripted trajectory. Here they pass a block from one gripper to the other, every motion driven by me. Built during the Nferent AI internship; the clip is narrated, so sound on.

Teleoperation, seen through the headset

The same rig from my side of it — recorded through the Quest: a controller in hand and both CS66 arms tracking it in real time. Roughly what I'm looking at while I drive them.

How it works

  • A real-time C++ control loop maps controller poses to end-effector targets through SE(3) transforms.
  • A clutch lets me "let go" mid-task: release to freeze the robots, re-position my hands comfortably, re-engage and continue — like lifting a mouse off the desk.
  • A safety layer clamps workspace limits, end-effector velocity, and command rates before anything reaches the hardware.

What broke, honestly

Reserved for the failure log: what broke on this rig and how it got fixed. Write-up in progress.

Links

Demo on YouTube