Gesture Recognition Methods Using Sensors Integrated into Smartwatches: Results of a Systematic Literature Review
Resumo
This work addresses the importance of gesture recognition in smartwatches and aims to conduct a systematic literature review to identify the most commonly used methods and sensors in this field. The selected works were obtained from renowned databases, such as ACM Digital Library, IEEE Xplore, Scopus, and ScienceDirect. Initially, 265 articles were identified, and after applying inclusion and quality criteria, 43 articles were selected for detailed analysis. The systematic review allowed for the consolidation of existing knowledge and the identification of the most relevant approaches in this area. The results revealed a diversity of algorithms employed, such as Naïve Bayes, Artificial Neural Network, Support Vector Machine, Dynamic Time Warping, Symbolic Aggregate approXimation, Long Short-Term Memory, Random Forest, Multiple Dimensional Dynamic Time Warping, Gated Recurrent Unit, K-nearest Neighbors, Hidden Markov Model, Latent Dirichlet Allocation, and Convolutional Neural Network. Additionally, we found that accelerometers were the most commonly used sensors, followed by gyroscopes, magnetometers, barometers, vital sensors (EMG, FMG, PPG), and infrared sensors. The findings highlight the relevance of gesture recognition in smartwatches and provide valuable insights for researchers and professionals interested in this constantly evolving field.
Palavras-chave:
Smartwatch, Wearable Devices, Gesture Recognition, Systematic Literature Review
Referências
Amr Alanwar, Moustafa Alzantot, Bo-Jhang Ho, Paul Martin, and Mani Srivastava. 2017. Selecon: Scalable iot device selection and control using hand gestures. In Proceedings of the Second International Conference on Internet-of-Things Design and Implementation. 47–58.
Hongliang Bi, Jian Zhang, Yanjiao Chen, Chaoyang Zhou, and Zhibo Wang. 2021. Magic-hand: Turn a smartwatch into a mouse. Pervasive and Mobile Computing 78 (2021), 101487.
Vikram Cannanure, Xiang’Anthony’Chen, and Jennifer Mankoff. 2016. Twist’n’Knock: A One-handed Gesture for Smart Watches.. In Graphics Interface. 189–193.
Feiyu Chen, Jia Deng, Zhibo Pang, Majid Baghaei Nejad, Huayong Yang, and Geng Yang. 2018. Finger angle-based hand gesture recognition for smart infrastructure using wearable wrist-worn camera. Applied Sciences 8, 3 (2018), 369.
Feiyu Chen, Honghao Lv, Zhibo Pang, Junhui Zhang, Yonghong Hou, Ying Gu, Huayong Yang, and Geng Yang. 2018. WristCam: A wearable sensor for hand trajectory gesture recognition and intelligent human–robot interaction. IEEE Sensors Journal 19, 19 (2018), 8441–8451.
Gabriele Costante, Lorenzo Porzi, Oswald Lanz, Paolo Valigi, and Elisa Ricci. 2014. Personalizing a smartwatch-based gesture interface with transfer learning. In 2014 22nd European Signal Processing Conference (EUSIPCO). 2530–2534.
Yufeng Deng, Dong Wang, Qian Zhang, Run Zhao, and Bo Chen. 2018. ReaderTrack: Reader-Book Interaction Reasoning Using RFID and Smartwatch. In 2018 27th International Conference on Computer Communication and Networks (ICCCN). IEEE, 1–9.
Paul Dourish. 2001. Where the action is: the foundations of embodied interaction. MIT press.
Assaf Feldman, Emmanuel Munguia Tapia, Sajid Sadi, Pattie Maes, and Chris Schmandt. 2005. ReachMedia: On-the-move interaction with everyday objects. In Ninth IEEE International Symposium on Wearable Computers (ISWC’05). IEEE, 52–59.
Alan Ferrari, Vanni Galli, Daniele Puccinelli, and Silvia Giordano. 2017. On the usage of smart devices to augment the user interaction with multimedia applications. In 2017 IEEE 18th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM). IEEE, 1–9.
Thamer Horbylon Nascimento, Fabrizzio Alphonsus Alves De Melo Nunes Soares, Marcos Alves Vieira, Juliana Paula Felix, Jaline Gonçalves Mombach, Livia Mancine Coelho De Campos, Wellington Galvão Rodrigues, Wesley Flavio De Miranda, and Ronaldo Martins Da Costa. 2019. Using Smartwatches as an Interactive Movie Controller: A Case Study with the Bandersnatch Movie. In 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC), Vol. 2. 263–268. DOI: 10.1109/COMPSAC.2019.10217
Thamer Horbylon Nascimento, Cristiane B. R. Ferreira, Wellington G. Rodrigues, and Fabrizzio Soares. 2020. Interaction with Smartwatches Using Gesture Recognition: A Systematic Literature Review. In 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC). 1661–1666. DOI: 10.1109/COMPSAC48688.2020.00-17
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’97). Association for Computing Machinery, New York, NY, USA, 234–241. DOI: 10.1145/258549.258715
Shahram Jalaliniya, Jeremiah Smith, Miguel Sousa, Lars Büthe, and Thomas Pederson. 2013. Touch-less interaction with medical images using hand & foot gestures. In Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication. 1265–1274.
Avnish Singh Jat and Tor-Morten Grønli. 2022. Smart watch for smart health monitoring: A literature review. In International Work-Conference on Bioinformatics and Biomedical Engineering. Springer, 256–268.
Shuo Jiang, Bo Lv, Weichao Guo, Chao Zhang, Haitao Wang, Xinjun Sheng, and Peter B. Shull. 2018. Feasibility of Wrist-Worn, Real-Time Hand, and Surface Gesture Recognition via sEMG and IMU Sensing. IEEE Transactions on Industrial Informatics 14, 8 (2018), 3376–3385. DOI: 10.1109/TII.2017.2779814
Mauri Kaipainen, Niklas Ravaja, Pia Tikka, Rasmus Vuori, Roberto Pugliese, Marco Rapino, and Tapio Takala. 2011. Enactive Systems and Enactive Media: Embodied Human-Machine Coupling beyond Interfaces. Leonardo 44, 5 (10 2011), 433–438. DOI: 10.1162/LEON_a_00244 arXiv: [link]
Peiqi Kang, Jinxuan Li, Bingfei Fan, Shuo Jiang, and Peter B Shull. 2021. Wrist-worn hand gesture recognition while walking via transfer learning. IEEE Journal of Biomedical and Health Informatics 26, 3 (2021), 952–961.
Victor Kartsch, Simone Benatti, Mattia Mancini, Michele Magno, and Luca Benini. 2018. Smart wearable wristband for EMG based gesture recognition powered by solar energy harvester. In 2018 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, 1–5.
Keiko Katsuragawa, Krzysztof Pietroszek, James R Wallace, and Edward Lank. 2016. Watchpoint: Freehand pointing with a smartwatch in a ubiquitous display environment. In Proceedings of the International Working Conference on Advanced Visual Interfaces. 128–135.
Keiko Katsuragawa, James R Wallace, and Edward Lank. 2016. Gestural text input using a smartwatch. In Proceedings of the International Working Conference on Advanced Visual Interfaces. 220–223.
Hyung-il Kim, Juyoung Lee, Hui Shyong Yeo, Aaron John Quigley, and Woontack Woo. 2019. SWAG demo: Smart watch assisted gesture interaction for mixed reality head-mounted displays. In Adjunct Proceedings-2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018. Institute of Electrical and Electronics Engineers Inc.
Barbara Kitchenham. 2004. Procedures for performing systematic reviews. Keele, UK, Keele University 33, 2004 (2004), 1–26.
Jonathan Knighten, Stephen McMillan, Tori Chambers, and Jamie Payton. 2015. Recognizing social gestures with a wrist-worn smartband. In 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops). IEEE, 544–549.
Ce Li, Chunyu Xie, Baochang Zhang, Chen Chen, and Jungong Han. 2018. Deep Fisher discriminant learning for mobile hand gesture recognition. Pattern Recognition 77 (2018), 276–288.
Gen Li and Hiroyuki Sato. 2022. Sensing In-Air Signature Motions Using Smartwatch: A High-Precision Approach of Behavioral Authentication. IEEE Access 10 (2022), 57865–57879.
Yande Li, Taiqian Wang, Lian Li, Caihong Li, Yi Yang, Li Liu, 2018. Hand gesture recognition and real-time game control based on a wearable band with 6-axis sensors. In 2018 international joint conference on neural networks (IJCNN). IEEE, 1–6.
Yubing Li, Kun Zhao, Meichen Duan, Wei Shi, Liangliang Lin, Xinyi Cao, Yang Liu, and Jizhong Zhao. 2020. Control your home with a smartwatch. IEEE Access 8 (2020), 131601–131613.
Mateus M Luna, Thyago P Carvalho, Fabrizzio Alphonsus AMN Soares, Hugo AD Nascimento, and Ronaldo M Costa. 2017. Wrist player: a smartwatch gesture controller for smart TVs. In 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC), Vol. 2. IEEE, 336–341.
Steven McGuckin, Soumyadeb Chowdhury, and Lewis Mackenzie. 2016. Tap’n’shake: gesture-based smartwatch-smartphone communications system. In Proceedings of the 28th Australian Conference on Computer-Human Interaction. 442–446.
Antigoni Mezari and Ilias Maglogiannis. 2017. Gesture recognition using symbolic aggregate approximation and dynamic time warping on motion data. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare. 342–347.
Antigoni Mezari and Ilias Maglogiannis. 2018. An easily customized gesture recognizer for assisted living using commodity mobile devices. Journal of Healthcare Engineering 2018 (2018).
Danial Moazen, Seyed A Sajjadi, and Ani Nahapetian. 2016. AirDraw: Leveraging smart watch motion sensors for mobile human computer interactions. In 2016 13th IEEE Annual Consumer Communications & Networking Conference (CCNC). 442–446. DOI: 10.1109/CCNC.2016.7444820
David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G Altman, and the PRISMA Group*. 2009. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine 151, 4 (2009), 264–269.
Dania Murad, Fenyi Ye, Michael Barone, and Ye Wang. 2017. Motion initiated music ensemble with sensors for motor rehabilitation. In 2017 international conference on orange technologies (icot). IEEE, 87–90.
Kyeong-Beom Park and Jae Yeol Lee. 2019. New design and comparative analysis of smartwatch metaphor-based hand gestures for 3D navigation in mobile virtual reality. Multimedia Tools and Applications 78 (2019), 6211–6231.
Krzysztof Pietroszek, Liudmila Tahai, James R Wallace, and Edward Lank. 2017. Watchcasting: Freehand 3D interaction with off-the-shelf smartwatch. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 172–175.
Blaine Reeder and Alexandria David. 2016. Health at hand: A systematic review of smart watch uses for health and wellness. Journal of biomedical informatics 63 (2016), 269–276.
Felix Schüssel, Frank Honold, Nikola Bubalo, and Michael Weber. 2016. Increasing robustness of multimodal interaction via individual interaction histories. In Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction. 56–63.
Chao Shen, Yufei Chen, Gengshan Yang, and Xiaohong Guan. 2018. Toward hand-dominated activity recognition systems with wristband-interaction behavior analysis. IEEE Transactions on Systems, Man, and Cybernetics: Systems 50, 7 (2018), 2501–2511.
Alexandru-Ionut Siean and Radu-Daniel Vatavu. 2021. Wearable Interactions for Users with Motor Impairments: Systematic Review, Inventory, and Research Implications. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (Virtual Event, USA) (ASSETS ’21). Association for Computing Machinery, New York, NY, USA, Article 7, 15 pages. DOI: 10.1145/3441852.3471212
Thanh-Hai Tran, Hoang-Nhat Tran, Hong-Quan Nguyen, Trung-Hieu Le, Van-Thang Nguyen, Trung-Kien Tran, Cuong Pham, Thi-Lan Le, Hai Vu, Thanh Phuong Nguyen, 2021. A pilot study on hand posture recognition from wrist-worn camera for human machine interaction. In 2021 International Conference on Advanced Technologies for Communications (ATC). IEEE, 201–206.
Ayush Tripathi, Arnab Kumar Mondal, Lalan Kumar, and AP Prathosh. 2022. ImAiR: Airwriting Recognition Framework Using Image Representation of IMU Signals. IEEE Sensors Letters 6, 10 (2022), 1–4.
Francisco J Varela, Evan Thompson, and Eleanor Rosch. 1992. The embodied mind: Cognitive science and human experience. MIT press.
Valeria Villani, Lorenzo Sabattini, Nicola Battilani, and Cesare Fantuzzi. 2016. Smartwatch-enhanced interaction with an advanced troubleshooting system for industrial machines. IFAC-PapersOnLine 49, 19 (2016), 277–282.
Valeria Villani, Lorenzo Sabattini, Giuseppe Riggio, Cristian Secchi, Marco Minelli, and Cesare Fantuzzi. 2017. A natural infrastructure-less human–robot interaction system. IEEE Robotics and Automation Letters 2, 3 (2017), 1640–1647.
Hong Wang, Peiqi Kang, Qinghua Gao, Shuo Jiang, and Peter B Shull. 2022. A Novel PPG-FMG-ACC Wristband for Hand Gesture Recognition. IEEE journal of biomedical and health informatics 26, 10 (2022), 5097–5108.
Mark Weiser. 1991. The Computer for the 21 st Century. Scientific American 265, 3 (1991), 94–105. [link]
Yuki Yamato, Yutaro Suzuki, Kodai Sekimori, Buntarou Shizuki, and Shin Takahashi. 2020. Hand gesture interaction with a low-resolution infrared image sensor on an inner wrist. In Proceedings of the International Conference on Advanced Visual Interfaces. 1–5.
Geng Yang, Honghao Lv, Feiyu Chen, Zhibo Pang, Jin Wang, Huayong Yang, and Junhui Zhang. 2018. A novel gesture recognition system for intelligent interaction with a nursing-care assistant robot. Applied sciences 8, 12 (2018), 2349.
Hui-Shyong Yeo, Juyoung Lee, Andrea Bianchi, Alejandro Samboy, Hideki Koike, Woontack Woo, and Aaron Quigley. 2020. WristLens: Enabling Single-Handed Surface Gesture Interaction for Wrist-Worn Devices Using Optical Motion Sensor. In Proceedings of the Augmented Humans International Conference. 1–8.
Yufei Zhang, Bin Liu, and Zhiqiang Liu. 2019. Recognizing hand gestures with pressure-sensor-based motion sensing. IEEE transactions on biomedical circuits and systems 13, 6 (2019), 1425–1436.
Yidi Zhang, Mengyuan Ran, Jun Liao, Guoxin Su, Ming Liu, and Li Liu. 2021. Stacked LSTM-Based Dynamic Hand Gesture Recognition with Six-Axis Motion Sensors. In 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 2568–2575.
Han Zhou, Yi Gao, Xinyi Song, Wenxin Liu, and Wei Dong. 2019. Limbmotion: Decimeter-level limb tracking for wearable-based human-computer interaction. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 4 (2019), 1–24.
Hongliang Bi, Jian Zhang, Yanjiao Chen, Chaoyang Zhou, and Zhibo Wang. 2021. Magic-hand: Turn a smartwatch into a mouse. Pervasive and Mobile Computing 78 (2021), 101487.
Vikram Cannanure, Xiang’Anthony’Chen, and Jennifer Mankoff. 2016. Twist’n’Knock: A One-handed Gesture for Smart Watches.. In Graphics Interface. 189–193.
Feiyu Chen, Jia Deng, Zhibo Pang, Majid Baghaei Nejad, Huayong Yang, and Geng Yang. 2018. Finger angle-based hand gesture recognition for smart infrastructure using wearable wrist-worn camera. Applied Sciences 8, 3 (2018), 369.
Feiyu Chen, Honghao Lv, Zhibo Pang, Junhui Zhang, Yonghong Hou, Ying Gu, Huayong Yang, and Geng Yang. 2018. WristCam: A wearable sensor for hand trajectory gesture recognition and intelligent human–robot interaction. IEEE Sensors Journal 19, 19 (2018), 8441–8451.
Gabriele Costante, Lorenzo Porzi, Oswald Lanz, Paolo Valigi, and Elisa Ricci. 2014. Personalizing a smartwatch-based gesture interface with transfer learning. In 2014 22nd European Signal Processing Conference (EUSIPCO). 2530–2534.
Yufeng Deng, Dong Wang, Qian Zhang, Run Zhao, and Bo Chen. 2018. ReaderTrack: Reader-Book Interaction Reasoning Using RFID and Smartwatch. In 2018 27th International Conference on Computer Communication and Networks (ICCCN). IEEE, 1–9.
Paul Dourish. 2001. Where the action is: the foundations of embodied interaction. MIT press.
Assaf Feldman, Emmanuel Munguia Tapia, Sajid Sadi, Pattie Maes, and Chris Schmandt. 2005. ReachMedia: On-the-move interaction with everyday objects. In Ninth IEEE International Symposium on Wearable Computers (ISWC’05). IEEE, 52–59.
Alan Ferrari, Vanni Galli, Daniele Puccinelli, and Silvia Giordano. 2017. On the usage of smart devices to augment the user interaction with multimedia applications. In 2017 IEEE 18th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM). IEEE, 1–9.
Thamer Horbylon Nascimento, Fabrizzio Alphonsus Alves De Melo Nunes Soares, Marcos Alves Vieira, Juliana Paula Felix, Jaline Gonçalves Mombach, Livia Mancine Coelho De Campos, Wellington Galvão Rodrigues, Wesley Flavio De Miranda, and Ronaldo Martins Da Costa. 2019. Using Smartwatches as an Interactive Movie Controller: A Case Study with the Bandersnatch Movie. In 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC), Vol. 2. 263–268. DOI: 10.1109/COMPSAC.2019.10217
Thamer Horbylon Nascimento, Cristiane B. R. Ferreira, Wellington G. Rodrigues, and Fabrizzio Soares. 2020. Interaction with Smartwatches Using Gesture Recognition: A Systematic Literature Review. In 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC). 1661–1666. DOI: 10.1109/COMPSAC48688.2020.00-17
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’97). Association for Computing Machinery, New York, NY, USA, 234–241. DOI: 10.1145/258549.258715
Shahram Jalaliniya, Jeremiah Smith, Miguel Sousa, Lars Büthe, and Thomas Pederson. 2013. Touch-less interaction with medical images using hand & foot gestures. In Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication. 1265–1274.
Avnish Singh Jat and Tor-Morten Grønli. 2022. Smart watch for smart health monitoring: A literature review. In International Work-Conference on Bioinformatics and Biomedical Engineering. Springer, 256–268.
Shuo Jiang, Bo Lv, Weichao Guo, Chao Zhang, Haitao Wang, Xinjun Sheng, and Peter B. Shull. 2018. Feasibility of Wrist-Worn, Real-Time Hand, and Surface Gesture Recognition via sEMG and IMU Sensing. IEEE Transactions on Industrial Informatics 14, 8 (2018), 3376–3385. DOI: 10.1109/TII.2017.2779814
Mauri Kaipainen, Niklas Ravaja, Pia Tikka, Rasmus Vuori, Roberto Pugliese, Marco Rapino, and Tapio Takala. 2011. Enactive Systems and Enactive Media: Embodied Human-Machine Coupling beyond Interfaces. Leonardo 44, 5 (10 2011), 433–438. DOI: 10.1162/LEON_a_00244 arXiv: [link]
Peiqi Kang, Jinxuan Li, Bingfei Fan, Shuo Jiang, and Peter B Shull. 2021. Wrist-worn hand gesture recognition while walking via transfer learning. IEEE Journal of Biomedical and Health Informatics 26, 3 (2021), 952–961.
Victor Kartsch, Simone Benatti, Mattia Mancini, Michele Magno, and Luca Benini. 2018. Smart wearable wristband for EMG based gesture recognition powered by solar energy harvester. In 2018 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, 1–5.
Keiko Katsuragawa, Krzysztof Pietroszek, James R Wallace, and Edward Lank. 2016. Watchpoint: Freehand pointing with a smartwatch in a ubiquitous display environment. In Proceedings of the International Working Conference on Advanced Visual Interfaces. 128–135.
Keiko Katsuragawa, James R Wallace, and Edward Lank. 2016. Gestural text input using a smartwatch. In Proceedings of the International Working Conference on Advanced Visual Interfaces. 220–223.
Hyung-il Kim, Juyoung Lee, Hui Shyong Yeo, Aaron John Quigley, and Woontack Woo. 2019. SWAG demo: Smart watch assisted gesture interaction for mixed reality head-mounted displays. In Adjunct Proceedings-2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018. Institute of Electrical and Electronics Engineers Inc.
Barbara Kitchenham. 2004. Procedures for performing systematic reviews. Keele, UK, Keele University 33, 2004 (2004), 1–26.
Jonathan Knighten, Stephen McMillan, Tori Chambers, and Jamie Payton. 2015. Recognizing social gestures with a wrist-worn smartband. In 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops). IEEE, 544–549.
Ce Li, Chunyu Xie, Baochang Zhang, Chen Chen, and Jungong Han. 2018. Deep Fisher discriminant learning for mobile hand gesture recognition. Pattern Recognition 77 (2018), 276–288.
Gen Li and Hiroyuki Sato. 2022. Sensing In-Air Signature Motions Using Smartwatch: A High-Precision Approach of Behavioral Authentication. IEEE Access 10 (2022), 57865–57879.
Yande Li, Taiqian Wang, Lian Li, Caihong Li, Yi Yang, Li Liu, 2018. Hand gesture recognition and real-time game control based on a wearable band with 6-axis sensors. In 2018 international joint conference on neural networks (IJCNN). IEEE, 1–6.
Yubing Li, Kun Zhao, Meichen Duan, Wei Shi, Liangliang Lin, Xinyi Cao, Yang Liu, and Jizhong Zhao. 2020. Control your home with a smartwatch. IEEE Access 8 (2020), 131601–131613.
Mateus M Luna, Thyago P Carvalho, Fabrizzio Alphonsus AMN Soares, Hugo AD Nascimento, and Ronaldo M Costa. 2017. Wrist player: a smartwatch gesture controller for smart TVs. In 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC), Vol. 2. IEEE, 336–341.
Steven McGuckin, Soumyadeb Chowdhury, and Lewis Mackenzie. 2016. Tap’n’shake: gesture-based smartwatch-smartphone communications system. In Proceedings of the 28th Australian Conference on Computer-Human Interaction. 442–446.
Antigoni Mezari and Ilias Maglogiannis. 2017. Gesture recognition using symbolic aggregate approximation and dynamic time warping on motion data. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare. 342–347.
Antigoni Mezari and Ilias Maglogiannis. 2018. An easily customized gesture recognizer for assisted living using commodity mobile devices. Journal of Healthcare Engineering 2018 (2018).
Danial Moazen, Seyed A Sajjadi, and Ani Nahapetian. 2016. AirDraw: Leveraging smart watch motion sensors for mobile human computer interactions. In 2016 13th IEEE Annual Consumer Communications & Networking Conference (CCNC). 442–446. DOI: 10.1109/CCNC.2016.7444820
David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G Altman, and the PRISMA Group*. 2009. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine 151, 4 (2009), 264–269.
Dania Murad, Fenyi Ye, Michael Barone, and Ye Wang. 2017. Motion initiated music ensemble with sensors for motor rehabilitation. In 2017 international conference on orange technologies (icot). IEEE, 87–90.
Kyeong-Beom Park and Jae Yeol Lee. 2019. New design and comparative analysis of smartwatch metaphor-based hand gestures for 3D navigation in mobile virtual reality. Multimedia Tools and Applications 78 (2019), 6211–6231.
Krzysztof Pietroszek, Liudmila Tahai, James R Wallace, and Edward Lank. 2017. Watchcasting: Freehand 3D interaction with off-the-shelf smartwatch. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 172–175.
Blaine Reeder and Alexandria David. 2016. Health at hand: A systematic review of smart watch uses for health and wellness. Journal of biomedical informatics 63 (2016), 269–276.
Felix Schüssel, Frank Honold, Nikola Bubalo, and Michael Weber. 2016. Increasing robustness of multimodal interaction via individual interaction histories. In Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction. 56–63.
Chao Shen, Yufei Chen, Gengshan Yang, and Xiaohong Guan. 2018. Toward hand-dominated activity recognition systems with wristband-interaction behavior analysis. IEEE Transactions on Systems, Man, and Cybernetics: Systems 50, 7 (2018), 2501–2511.
Alexandru-Ionut Siean and Radu-Daniel Vatavu. 2021. Wearable Interactions for Users with Motor Impairments: Systematic Review, Inventory, and Research Implications. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (Virtual Event, USA) (ASSETS ’21). Association for Computing Machinery, New York, NY, USA, Article 7, 15 pages. DOI: 10.1145/3441852.3471212
Thanh-Hai Tran, Hoang-Nhat Tran, Hong-Quan Nguyen, Trung-Hieu Le, Van-Thang Nguyen, Trung-Kien Tran, Cuong Pham, Thi-Lan Le, Hai Vu, Thanh Phuong Nguyen, 2021. A pilot study on hand posture recognition from wrist-worn camera for human machine interaction. In 2021 International Conference on Advanced Technologies for Communications (ATC). IEEE, 201–206.
Ayush Tripathi, Arnab Kumar Mondal, Lalan Kumar, and AP Prathosh. 2022. ImAiR: Airwriting Recognition Framework Using Image Representation of IMU Signals. IEEE Sensors Letters 6, 10 (2022), 1–4.
Francisco J Varela, Evan Thompson, and Eleanor Rosch. 1992. The embodied mind: Cognitive science and human experience. MIT press.
Valeria Villani, Lorenzo Sabattini, Nicola Battilani, and Cesare Fantuzzi. 2016. Smartwatch-enhanced interaction with an advanced troubleshooting system for industrial machines. IFAC-PapersOnLine 49, 19 (2016), 277–282.
Valeria Villani, Lorenzo Sabattini, Giuseppe Riggio, Cristian Secchi, Marco Minelli, and Cesare Fantuzzi. 2017. A natural infrastructure-less human–robot interaction system. IEEE Robotics and Automation Letters 2, 3 (2017), 1640–1647.
Hong Wang, Peiqi Kang, Qinghua Gao, Shuo Jiang, and Peter B Shull. 2022. A Novel PPG-FMG-ACC Wristband for Hand Gesture Recognition. IEEE journal of biomedical and health informatics 26, 10 (2022), 5097–5108.
Mark Weiser. 1991. The Computer for the 21 st Century. Scientific American 265, 3 (1991), 94–105. [link]
Yuki Yamato, Yutaro Suzuki, Kodai Sekimori, Buntarou Shizuki, and Shin Takahashi. 2020. Hand gesture interaction with a low-resolution infrared image sensor on an inner wrist. In Proceedings of the International Conference on Advanced Visual Interfaces. 1–5.
Geng Yang, Honghao Lv, Feiyu Chen, Zhibo Pang, Jin Wang, Huayong Yang, and Junhui Zhang. 2018. A novel gesture recognition system for intelligent interaction with a nursing-care assistant robot. Applied sciences 8, 12 (2018), 2349.
Hui-Shyong Yeo, Juyoung Lee, Andrea Bianchi, Alejandro Samboy, Hideki Koike, Woontack Woo, and Aaron Quigley. 2020. WristLens: Enabling Single-Handed Surface Gesture Interaction for Wrist-Worn Devices Using Optical Motion Sensor. In Proceedings of the Augmented Humans International Conference. 1–8.
Yufei Zhang, Bin Liu, and Zhiqiang Liu. 2019. Recognizing hand gestures with pressure-sensor-based motion sensing. IEEE transactions on biomedical circuits and systems 13, 6 (2019), 1425–1436.
Yidi Zhang, Mengyuan Ran, Jun Liao, Guoxin Su, Ming Liu, and Li Liu. 2021. Stacked LSTM-Based Dynamic Hand Gesture Recognition with Six-Axis Motion Sensors. In 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 2568–2575.
Han Zhou, Yi Gao, Xinyi Song, Wenxin Liu, and Wei Dong. 2019. Limbmotion: Decimeter-level limb tracking for wearable-based human-computer interaction. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 4 (2019), 1–24.
Publicado
16/10/2023
Como Citar
GOMES, Pedro Raphael Inácio; CASTRO, Murillo Santos de; NASCIMENTO, Thamer Horbylon.
Gesture Recognition Methods Using Sensors Integrated into Smartwatches: Results of a Systematic Literature Review. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 22. , 2023, Maceió/AL.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
