← All work

Robot hand plays rock-paper-scissors

Tesollo DG-5F 20 motors RealSense + MediaPipe

Reads your hand, plays its move

A 20-motor Tesollo DG-5F hand plays rock-paper-scissors against people. Tesollo's own SDK drives the motors over Modbus-TCP. Mine is the vision layer, and the fix for a crash in the SDK's connect path.

How it works

  • A RealSense feeds MediaPipe hand landmarks. A finger-extension classifier turns them into one of three gestures, in real time.
  • The gesture maps to a target pose, sent through Tesollo's SDK over Modbus-TCP.
  • Every pose is twenty joint angles: five fingers, four motors each.

Why classify by extension

Counting extended fingers off the MediaPipe skeleton needs no training data, and when it fails you can see which fingertip landmark drifted. Rock is none extended, scissors two, paper five.