Gesture Detection System for Drone Control
Abstract
This article explores the development and implementation of a drone control system using gesture detection, highlighting the use of computer vision techniques. The proposed system employs the use of tools for capturing and interpreting manual gestures, which are associated with action commands for the drone. The solution aims to facilitate human interaction with drones, offering intuitive control and without the need for traditional physical controls. Experiments carried out demonstrated the functionality of the system, which responds in real time to gesture commands. The study also discusses challenges such as calibration for gesture detection and the influence of environmental variables, such as lighting and visual background. The work concludes that gesture detection for drone control is a viable approach with the capacity for expansion in future applications.References
Chen, B.; Hua, C.; Li, D.; He, Y.; Han, J. Intelligent Human–UAV interaction system with joint cross-validation over Action–Gesture recognition and scene understanding. Appl. Sci. 2019, 9, 3277.
Kainz, O.; Jakab, F. Approach to Hand Tracking and Gesture Recognition Based on Depth-Sensing Cameras and EMG Monitoring. Acta Informatica Pragensia, v. 3, n. 1, p. 104-112, 2014.
Khaksar, S. et al. Design and Evaluation of an Alternative Control for a Quad-Rotor Drone Using Hand-Gesture Recognition. Sensors, v. 23, n. 12, p. 5462, 2023.
Liu, C.; Szirányi, T. Real-Time Human Detection and Gesture Recognition for On-Board UAV Rescue. Sensors, v. 21, n. 6, p. 2180, 2021.
Silva, E. S. et al. A preliminary evaluation of the leap motion sensor as controller of new digital musical instruments. In: Proceedings of a conference, 2013.
Singha, J.; Das, K. Hand gesture recognition based on Karhunen-Loeve transform. arXiv preprint arXiv:1306.2599, 2013.
Tezza, D.; Andujar, M. The state-of-the-art of human–drone interaction: A survey. IEEE Access 2019, 9, 167438–167454.
Yoo, M. et al. Motion Estimation and Hand Gesture Recognition-Based Human–UAV Interaction Approach in Real Time. Sensors, v. 22, n. 7, p. 2513, 2022.
Kainz, O.; Jakab, F. Approach to Hand Tracking and Gesture Recognition Based on Depth-Sensing Cameras and EMG Monitoring. Acta Informatica Pragensia, v. 3, n. 1, p. 104-112, 2014.
Khaksar, S. et al. Design and Evaluation of an Alternative Control for a Quad-Rotor Drone Using Hand-Gesture Recognition. Sensors, v. 23, n. 12, p. 5462, 2023.
Liu, C.; Szirányi, T. Real-Time Human Detection and Gesture Recognition for On-Board UAV Rescue. Sensors, v. 21, n. 6, p. 2180, 2021.
Silva, E. S. et al. A preliminary evaluation of the leap motion sensor as controller of new digital musical instruments. In: Proceedings of a conference, 2013.
Singha, J.; Das, K. Hand gesture recognition based on Karhunen-Loeve transform. arXiv preprint arXiv:1306.2599, 2013.
Tezza, D.; Andujar, M. The state-of-the-art of human–drone interaction: A survey. IEEE Access 2019, 9, 167438–167454.
Yoo, M. et al. Motion Estimation and Hand Gesture Recognition-Based Human–UAV Interaction Approach in Real Time. Sensors, v. 22, n. 7, p. 2513, 2022.
Published
2025-07-20
How to Cite
SANTOS, João P. S. S.; CRUZ, Benicio B.; ANDRADE, Maria C. A. de; PRUDENTE, Fábio L. S.; SOUSA, Stephanie K. A.; SANTOS, Phillipe C..
Gesture Detection System for Drone Control. In: INTEGRATED SOFTWARE AND HARDWARE SEMINAR (SEMISH), 52. , 2025, Maceió/AL.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2025
.
p. 215-226.
ISSN 2595-6205.
DOI: https://doi.org/10.5753/semish.2025.8257.
