I built an autonomous robot using a Meta Quest 3 as its brain. The Quest handles spatial mapping, pathfinding, and voice commands — using on-device Whisper for speech recognition and its built-in sensors to map the environment and plan navigation routes. Motor commands are sent over Wi-Fi via UDP to an ESP32 microcontroller on a chassis built from LEGO. The idea is simple: speak a destination, and the robot drives itself there.

The project was featured on Hackster.io , and the full source code is available on GitHub.