PLATE 01 · ZENDO
Teleoperate your robot with your own body.
Zendo captures your body and hands from ordinary RGB cameras and streams them live. The Zendo SDK brings that stream into your controller in a few lines of Python, Rust or C++, so you decide how human motion drives your robot: an arm, a hand or a humanoid.
Talk to usAvailable · macOS and Linux
Tasks controllers cannot reach
Two-handed and whole-body work, where handhelds and leader arms run out of degrees of freedom.
Nothing to wear
No suit, no markers, no gloves. Operators step in front of the cameras and move.
Yours to build on
The SDK delivers typed joint orientations, landmarks and hands. Your retargeting and your controller stay yours.
WHAT YOU GET
Outputs that fit the tools you already use.
- Body
- Orientation of 13 body joints as quaternions, 19 3D keypoints with confidence, and joint angles.
- Hands
- Per-hand finger tracking: 16 joint orientations or 21 landmarks for each side.
- SDK
- Python, Rust and C/C++ clients. Several clients can read the same stream at once.
- Runs where
- On your machine. Video never leaves it.
PROOF
- 30–60 fps
- tracking on standard hardware
HOW TO START
- Get set up with usWe install Zendo with you, point your cameras and run one-click calibration.
- Connect the SDKInstall zendo-sdk, connect to the running session and read typed frames.
- Map it to your robotFeed the stream into your own retargeting and controller.
QUESTIONS
- Which robots?
- Any robot you can command from your own code: arms, hands, humanoids. Zendo provides the human motion and you map it to your embodiment. Our demo drives a NEURA MAiRA arm.
- Does Zendo include retargeting?
- Not today. Zendo streams anatomically valid human motion and the SDK hands it to your code. If you want motion solved onto a robot for you from recorded video, Yume does that.
- How many cameras?
- One works. Two or more give you a calibrated capture volume with millimeter-range accuracy.
- Does video leave my machine?
- No. Zendo runs on-device.
Want to try it with your own robot?
Talk to usAlsoYume