Upper Limb Motion Tracking and Classification: A Smartphone Approach

• Luis. G. S. Rodrigues UNESP
• Diego R. C. Dias UFSJ / BRAINN
• Marcelo P. Guimarães UNIFESP / UNIFACCAMP / BRAINN
• Alexandre F. Brandão BRAINN
• Leonardo C. D. Rocha UFSJ
• Rogério L. Iope UNESP
• José R. F. Brega UNESP / BRAINN

Resumo

Due to the evolution of motion capture devices, natural user interfaces have been applied in several areas, such as neuromotor rehabilitation supported by virtual environments. This paper presents a smartphone application that allows the user to interact with the virtual environment and enables the captured data to be stored, processed, and used in machine learning models. The application submits the recordings to the remote database with information about the movement and in order to apply supervised machine learning. As a proof of concept, we generated a dataset capturing movement data using our application with 232 instances divided into 8 classes of movements. Moreover, we used this dataset for training models that classifies these movements. The remarkable accuracy of the models shows the feasibility of using body articulation data for a classification task after some data transformations.

Palavras-chave: Computer vision, motion capture, augmented reality, supervised machine learning