OAK-D as a Platform for Human Movement Analysis: A Case Study

• Daniel Perazzo Federal University of Pernambuco - UFPE
• Natalia Souza Soares Federal University of Pernambuco - UFPE
• Victor Gouveia de Menezes Lyra Federal University of Pernambuco - UFPE
• Gustavo Camargo Rocha Lima Federal University of Pernambuco - UFPE
• Alana Elza Fontes da Gama Federal University of Pernambuco - UFPE
• Joao Marcelo Xavier Natario Teixeira Federal University of Pernambuco - UFPE
• Veronica Teichrieb Federal University of Pernambuco - UFPE

Abstract

3D interaction is an essential manner of interaction in VR environments. Many devices enable analysis and use of human inputs in these settings, such as the Kinect™ from Microsoft. One of the latest additions is the OpenCV AI Kit with Depth or OAK-D. This paper analyzes the OAK-D and proposes a case study based on a Motion Analysis framework created for at-home workouts to explore its capabilities in a 3D interaction setting. Our results show that the OAK-D is well suited for this kind of task, achieving 7 FPS with a Raspberry Pi 4 and 15 FPS with a laptop. Furthermore, it could detect and correct wrong movements while the user was doing it and count repetitions for the squat and side lateral raise.

Keywords: Human-computer interaction, Spatial AI, Motion Analysis, 3D Interaction, Embedded AI, Pose Estimation