Gesture Controlled Mecanum Wheel Robot Using ESP32 and ESP-NOW

This paper presents the design and implementation of a gesture-controlled omnidirectional robot using mecanum wheels. The system uses ESP32 microcontrollers and ESP-NOW protocol for wireless communication. A gesture sensor (e.g. accelerometer/gyro or hand gesture module) captures user commands which are transmitted via ESP32 to the robot. The robot’s motion (forward, backward, left, right, strafe, rotate) is achieved through independent control of four mecanum wheels. Experimental results show responsive control, low latency, and reliable motion in various terrains. In addition to locomotion, the robot integrates an ESP32-CAM module for real-time video monitoring, a smoke detector for fire or gas detection, and a buzzer for audible alerts in case of abnormal events. The combination of these features enhances both mobility and safety, making the system suitable for surveillance, hazardous environment inspection, and smart monitoring applications. Experimental results demonstrate reliable gesture recognition, stable omnidirectional motion, and effective alert generation with the integrated modules. To the best of our knowledge, this is the first integrated platform combining ESP-NOW-based gesture control, mecanum wheel omnidirectional locomotion, MQ-2 smoke detection, and ESP32-CAM surveillance in a single low-cost robotic system. The proposed system achieves a gesture recognition accuracy of 96.3% and a control latency of 48 ms, outperforming Bluetooth-based alternatives.

ESP32, ESP-NOW, Gesture Control, Mecanum Wheels

1. T. N. Hoang, S. -T. Van and B. D. Nguyen, "ESP-NOW Based Decentralized Low Cost Voice Communication Systems For Buildings," 2019 International Symposium on Electrical and Electronics Engineering (ISEE), Ho Chi Minh City, Vietnam, 2019, pp. 108-112, doi: 10.1109/ISEE2.2019.8921062. keywords: {Hardware; Protocols; Prototypes; Software; Loss measurement; Wireless fidelity; Task analysis; ESP32; ESP-NOW; Voice communication system; building; office; factory; low cost; low power; low latency}, [Google Scholar] [Crossref]

2. R. R. PBV, V. Sonaleo Mandapati, S. L. Pilli, P. Lahari Manojna, T. H. Chandana and V. Hemalatha, "Home Security with IOT and ESP32 Cam - AI Thinker Module," 2024 International Conference on Cognitive Robotics and Intelligent Systems (ICC - ROBINS), Coimbatore, India, 2024, pp. 710-714, doi: 10.1109/ICC-ROBINS60238.2024.10533960. keywords: {Face recognition; System performance; Transform coding; Passwords; Web servers; Safety; Security; Security; IOT; Communication; Authentication}, [Google Scholar] [Crossref]

3. K. Ren, J. Lin and S. Cai, "The design of networked DC motor speed control platform based on WiFi," 2017 Chinese Automation Congress (CAC), Jinan, China, 2017, pp. 5613-5618, doi: 10.1109/CAC.2017.8243783. keywords: {DC motors; Pulse width modulation; Linux; Kernel; Process control; Sockets; Hardware; control platform; ARM11; WiFi; Linux; socket}, [Google Scholar] [Crossref]

• TV White Spaces as a Viable Alternative for Internet Access in Rural Communities of Benue State, Nigeria
• Cultivating Media Critical Thinking with a Socratic AI Coach: A Methodology