Augmented Reality for Assembly Training in Industry: A Systematic Literature Mapping
Resumo
Training as a basis for professional development contributes to the dissemination of knowledge in organizations. This Systematic Literature Mapping (SLM) aims to identify the approaches and instruments of corporate training for manual assembly with Augmented Reality (AR) in industries. The SLM was carried out in the ACM Digital Library and IEEE Xplore database with a total of 151 papers found and after applying the selection criteria, 28 papers were analyzed. We found that most systems were tested in simulated environment and not always assessed by users perspective. Task completion time and number of errors are two very frequent measurements. No theoretical pedagogical approach was found which suggests that the research is still focused on system´s design issues such as interface, information and graphics. Existing AR-based manual assembly training systems simply reproduce the intended task as a basis for training. The results show that AR supports the training process, but it is still in the development phase and it is necessary to investigate approaches that demonstrate the pedagogical practices used. The aspects of the AR-based learning processes are yet to be fully explored.
Palavras-chave:
Augmented Reality, Training, Assembly
Referências
Bassi, Willian Di Gaetano, Elvio Carlos da Costa, and Angelita Moutin Segoria Gasparotto. 2019. A Study on Employee Training Processes In Industries of The Century XXI. Revista Interface Tecnológica 16.2: 169-179. (In Portuguese).
Tori, Romero, and Marcelo da Silva Hounsell. 2020. Introduction to virtual and augmented reality. Sociedade Brasileira de Computação. (In Portuguese).
Moreira, Lorena, and Regina Ruschel. 2017. Realidade Aumentada para a montagem, manutenção e operação da edificação: revisão sistemática de literatura. SBTIC+ SIBRAGEC 10: 186-195. (In Portuguese).
Moghaddam, Mohsen, et al. 2021. Exploring augmented reality for worker assistance versus training. Advanced Engineering Informatics. v. 50, p. 101410
Gattullo, Michele, et al. 2019. Informing the use of visual assets in industrial augmented reality. International Conference of the Italian Association of Design Methods and Tools for Industrial Engineering. Cham: Springer International Publishing.
Gélio, Lucas Gomes, and Francisco Ignácio Giocondo César. 2022. Use of Augmented Reality In Industrial Maintenance. Revista Científica Acertte-ISSN 2763-8928, v. 2, n. 2, p. e2262-e2262. (In Portuguese).
Martins, Bruno Rodrigo, Joaquim Armando Jorge, and Ezequiel Roberto Zorzal. 2021. Towards augmented reality for corporate training. Interactive Learning Environments, v. 31, n. 4, p. 2305-2323.
Wang, Zhuo, et al. 2022. A comprehensive review of augmented reality-based instruction in manual assembly, training and repair. Robotics and ComputerIntegrated Manufacturing, v. 78, p. 102407.
Cerdan Justimiano, Andresa, et al. 2021. Augmented Reality System for Teaching and Training People Regarding the Execution of Equipment Assembly and Maintenance Services. TE & ET: Revista Iberoamericana de Tecnología en Educación y Educación en Tecnología 28. (In Portuguese).
Bottani, Eleonora, and Giuseppe Vignali. 2019. Augmented reality technology in the manufacturing industry: A review of the last decade. Iise Transactions 51.3: 284-310.
Kitchenham, Barbara. 2004. Procedures for performing systematic reviews. Keele, UK, Keele University 33.2004: 1-26.
Buchinger, Diego, Gustavo Andriolli de Siqueira Cavalcanti, and Marcelo da Silva Hounsell. 2014. Mecanismos de busca acadêmica: uma análise quantitativa. Revista brasileira de computação aplicada 6.1: 108-120. (In Portuguese).
Yin, Xuyue, et al. 2014. VR&AR combined manual operation instruction system on industry products: a case study. International Conference on Virtual Reality and Visualization. IEEE, p. 65-72.
Princle, Andrew, et al. 2018. [Poster] Using an industry-ready AR HMD on a real maintenance task: AR benefits performance on certain task steps more than others. International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, p. 236-241.
Cachada, Ana, et al. 2019. Using AR interfaces to support industrial maintenance procedures. IECON 2019-45th Annual Conference of the IEEE Industrial Electronics Society. Vol. 1. IEEE, p. 3795-3800.
Patibandla, Jaya Sai Kiran, Sunit Kumar Adhikary, and Janmesh Ukey. 2020. Augmented reality for assistive maintenance and real-time failure analysis in industries. 2nd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA). IEEE.
Lavric, Traian, et al. 2021. Exploring low-cost visual assets for conveying assembly instructions in AR. International Conference on INnovations in Intelligent SysTems and Applications (INISTA). IEEE, p. 149-153.
Werrlich, Stefan, Phuc-Anh Nguyen, and Gunther Notni. 2018. Evaluating the training transfer of Head-Mounted Display based training for assembly tasks. Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference, p. 297-302.
Funk, Markus, Mareike Kritzler, and Florian Michahelles. 2017. HoloCollab: a shared virtual platform for physical assembly training using spatially-aware head-mounted displays. Proceedings of the Seventh International Conference on the Internet of Things, p. 1-7.
Bosch, Tim, et al. 2020. Spatial augmented reality: a tool for operator guidance and training evaluated in five industrial case studies. Proceedings of the 13th ACM International Conference on PErvasive technologies related to assistive environments, p. 1-7.
Arige, Abhaya Dhathri, et al. 2022. Evaluation of simplified 3D CAD data for conveying industrial assembly instructions via Augmented reality. Proceedings of the 27th International Conference on 3D Web Technology, p. 1-6.
Wilschut, Ellen S., et al. 2019. Evaluating learning approaches for product assembly: using chunking of instructions, spatial augmented reality and display based work instructions. Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments, p. 376-381.
Zhu, Zhiwei, et al. 2014. AR-mentor: Augmented reality based mentoring system. International symposium on mixed and augmented reality (ISMAR). IEEE, p. 17-22.
Pantoja, Gabriel, Luis Eduardo Garza, and Eduardo Gonzalez Mendivil. 2014. Augmented reality in pneumatic conveying system: Fuller pump dry material line charger. 2014 9th Iberian Conference on Information Systems and Technologies (CISTI). IEEE, p. 1-5.
Su, Xia, Zheng Cheng, and Bin Luo. 2021. An auxiliary industrial equipment maintenance system using mixed reality. 8th International Conference on Industrial Engineering and Applications (ICIEA). IEEE, p. 503-508.
Angel, Nikolaus, Horst Orsolits, and Jose Garcia. 2022. Developing an AR Based Tool for Teaching Motion Analysis on Assembly Tasks. 8th International Conference of the Immersive Learning Research Network (iLRN). IEEE, p. 1-7.
Constâncio, Diogo, Daniel Casanova, and António Ramires Fernandes. 2017. MARS: Mobile augmented reality script framework. 2017 24º Encontro Português de Computação Gráfica e Interação (EPCGI). IEEE, p. 1-8.
de Araujo, Thiago Alves Costa, Francisco CMB Oliveira, and Cecilia Lis Costa. 2019. Creating job opportunities in computer assembly line for people with disabilities through augmented reality. Frontiers in Education Conference (FIE). IEEE, p. 1-7.
Li, Bin, et al. 2018. Instruction manual for product assembly process based on augmented visualization. 2018 Chinese Automation Congress (CAC). IEEE, p. 3248-3253.
Han, Peng-Fei, Feng-Kui Zhao, and Gang Zhao. 2022. Using Augmented Reality to Improve Learning Efficacy in a Mechanical Assembly Course. IEEE Transactions on Learning Technologies, v. 15, n. 2, p. 279-289.
Alptekin, Mesut, and Katrin Temmen. 2018. Design concept and prototype for an augmented reality based virtual preparation laboratory training in electrical engineering. Global Engineering Education Conference (EDUCON). IEEE, p. 963-968.
Tadeja, Sławomir K., et al. 2022. Design of ARQ: An Augmented Reality System for Assembly Training Enhanced with QR-Tagging and 3D Engineering Asset Model. Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, p. 466-471.
Bastes, Arthur, et al. 2021. Augmented Reality for Training and Maintenance of Reclosers: A Case Study of a Wearable Application. 45th Annual Computers, Software, and Applications Conference (COMPSAC). IEEE, p. 532-537.
Peng, Chao-Chung, Ai-Chi Chang, and Yu-Lun Chu. 2022. Application of augmented reality for aviation equipment inspection and maintenance training. 2022 8th International Conference on Applied System Innovation (ICASI). IEEE, p. 58-63.
Werrlich, Stefan, et al. 2018. Comparing HMD-based and paper-based training. International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, p. 134-142.
Lavric, Traian, et al. 2020. An AR work instructions authoring tool for humanoperated industrial assembly lines. International Conference on Artificial Intelligence and Virtual Reality (AIVR). IEEE, p. 174-183.
Su, Kang, et al. 2022. A natural bare-hand interaction method with augmented reality for constraint-based virtual assembly. IEEE Transactions on Instrumentation and Measurement, v. 71, p. 1-14
Hořejší, Petr, Konstantin Novikov, and Michal Šimon. 2020. A smart factory in a Smart City: virtual and augmented reality in a Smart assembly line. IEEE Access 8: 94330-94340, v. 8, p. 94330-94340
Hoffmann, Clemens, Sebastian Büttner, and Michael Prilla. 2022. Conveying procedural and descriptive knowledge with augmented reality. Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments, p. 40-49.
Büttner, Sebastian, Michael Prilla, and Carsten Röcker. 2020. Augmented reality training for industrial assembly work-are projection-based ar assistive systems an appropriate tool for assembly training?. Proceedings of the 2020 CHI conference on human factors in computing systems, p. 1-12.
Tori, Romero, and Marcelo da Silva Hounsell. 2020. Introduction to virtual and augmented reality. Sociedade Brasileira de Computação. (In Portuguese).
Moreira, Lorena, and Regina Ruschel. 2017. Realidade Aumentada para a montagem, manutenção e operação da edificação: revisão sistemática de literatura. SBTIC+ SIBRAGEC 10: 186-195. (In Portuguese).
Moghaddam, Mohsen, et al. 2021. Exploring augmented reality for worker assistance versus training. Advanced Engineering Informatics. v. 50, p. 101410
Gattullo, Michele, et al. 2019. Informing the use of visual assets in industrial augmented reality. International Conference of the Italian Association of Design Methods and Tools for Industrial Engineering. Cham: Springer International Publishing.
Gélio, Lucas Gomes, and Francisco Ignácio Giocondo César. 2022. Use of Augmented Reality In Industrial Maintenance. Revista Científica Acertte-ISSN 2763-8928, v. 2, n. 2, p. e2262-e2262. (In Portuguese).
Martins, Bruno Rodrigo, Joaquim Armando Jorge, and Ezequiel Roberto Zorzal. 2021. Towards augmented reality for corporate training. Interactive Learning Environments, v. 31, n. 4, p. 2305-2323.
Wang, Zhuo, et al. 2022. A comprehensive review of augmented reality-based instruction in manual assembly, training and repair. Robotics and ComputerIntegrated Manufacturing, v. 78, p. 102407.
Cerdan Justimiano, Andresa, et al. 2021. Augmented Reality System for Teaching and Training People Regarding the Execution of Equipment Assembly and Maintenance Services. TE & ET: Revista Iberoamericana de Tecnología en Educación y Educación en Tecnología 28. (In Portuguese).
Bottani, Eleonora, and Giuseppe Vignali. 2019. Augmented reality technology in the manufacturing industry: A review of the last decade. Iise Transactions 51.3: 284-310.
Kitchenham, Barbara. 2004. Procedures for performing systematic reviews. Keele, UK, Keele University 33.2004: 1-26.
Buchinger, Diego, Gustavo Andriolli de Siqueira Cavalcanti, and Marcelo da Silva Hounsell. 2014. Mecanismos de busca acadêmica: uma análise quantitativa. Revista brasileira de computação aplicada 6.1: 108-120. (In Portuguese).
Yin, Xuyue, et al. 2014. VR&AR combined manual operation instruction system on industry products: a case study. International Conference on Virtual Reality and Visualization. IEEE, p. 65-72.
Princle, Andrew, et al. 2018. [Poster] Using an industry-ready AR HMD on a real maintenance task: AR benefits performance on certain task steps more than others. International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, p. 236-241.
Cachada, Ana, et al. 2019. Using AR interfaces to support industrial maintenance procedures. IECON 2019-45th Annual Conference of the IEEE Industrial Electronics Society. Vol. 1. IEEE, p. 3795-3800.
Patibandla, Jaya Sai Kiran, Sunit Kumar Adhikary, and Janmesh Ukey. 2020. Augmented reality for assistive maintenance and real-time failure analysis in industries. 2nd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA). IEEE.
Lavric, Traian, et al. 2021. Exploring low-cost visual assets for conveying assembly instructions in AR. International Conference on INnovations in Intelligent SysTems and Applications (INISTA). IEEE, p. 149-153.
Werrlich, Stefan, Phuc-Anh Nguyen, and Gunther Notni. 2018. Evaluating the training transfer of Head-Mounted Display based training for assembly tasks. Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference, p. 297-302.
Funk, Markus, Mareike Kritzler, and Florian Michahelles. 2017. HoloCollab: a shared virtual platform for physical assembly training using spatially-aware head-mounted displays. Proceedings of the Seventh International Conference on the Internet of Things, p. 1-7.
Bosch, Tim, et al. 2020. Spatial augmented reality: a tool for operator guidance and training evaluated in five industrial case studies. Proceedings of the 13th ACM International Conference on PErvasive technologies related to assistive environments, p. 1-7.
Arige, Abhaya Dhathri, et al. 2022. Evaluation of simplified 3D CAD data for conveying industrial assembly instructions via Augmented reality. Proceedings of the 27th International Conference on 3D Web Technology, p. 1-6.
Wilschut, Ellen S., et al. 2019. Evaluating learning approaches for product assembly: using chunking of instructions, spatial augmented reality and display based work instructions. Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments, p. 376-381.
Zhu, Zhiwei, et al. 2014. AR-mentor: Augmented reality based mentoring system. International symposium on mixed and augmented reality (ISMAR). IEEE, p. 17-22.
Pantoja, Gabriel, Luis Eduardo Garza, and Eduardo Gonzalez Mendivil. 2014. Augmented reality in pneumatic conveying system: Fuller pump dry material line charger. 2014 9th Iberian Conference on Information Systems and Technologies (CISTI). IEEE, p. 1-5.
Su, Xia, Zheng Cheng, and Bin Luo. 2021. An auxiliary industrial equipment maintenance system using mixed reality. 8th International Conference on Industrial Engineering and Applications (ICIEA). IEEE, p. 503-508.
Angel, Nikolaus, Horst Orsolits, and Jose Garcia. 2022. Developing an AR Based Tool for Teaching Motion Analysis on Assembly Tasks. 8th International Conference of the Immersive Learning Research Network (iLRN). IEEE, p. 1-7.
Constâncio, Diogo, Daniel Casanova, and António Ramires Fernandes. 2017. MARS: Mobile augmented reality script framework. 2017 24º Encontro Português de Computação Gráfica e Interação (EPCGI). IEEE, p. 1-8.
de Araujo, Thiago Alves Costa, Francisco CMB Oliveira, and Cecilia Lis Costa. 2019. Creating job opportunities in computer assembly line for people with disabilities through augmented reality. Frontiers in Education Conference (FIE). IEEE, p. 1-7.
Li, Bin, et al. 2018. Instruction manual for product assembly process based on augmented visualization. 2018 Chinese Automation Congress (CAC). IEEE, p. 3248-3253.
Han, Peng-Fei, Feng-Kui Zhao, and Gang Zhao. 2022. Using Augmented Reality to Improve Learning Efficacy in a Mechanical Assembly Course. IEEE Transactions on Learning Technologies, v. 15, n. 2, p. 279-289.
Alptekin, Mesut, and Katrin Temmen. 2018. Design concept and prototype for an augmented reality based virtual preparation laboratory training in electrical engineering. Global Engineering Education Conference (EDUCON). IEEE, p. 963-968.
Tadeja, Sławomir K., et al. 2022. Design of ARQ: An Augmented Reality System for Assembly Training Enhanced with QR-Tagging and 3D Engineering Asset Model. Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, p. 466-471.
Bastes, Arthur, et al. 2021. Augmented Reality for Training and Maintenance of Reclosers: A Case Study of a Wearable Application. 45th Annual Computers, Software, and Applications Conference (COMPSAC). IEEE, p. 532-537.
Peng, Chao-Chung, Ai-Chi Chang, and Yu-Lun Chu. 2022. Application of augmented reality for aviation equipment inspection and maintenance training. 2022 8th International Conference on Applied System Innovation (ICASI). IEEE, p. 58-63.
Werrlich, Stefan, et al. 2018. Comparing HMD-based and paper-based training. International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, p. 134-142.
Lavric, Traian, et al. 2020. An AR work instructions authoring tool for humanoperated industrial assembly lines. International Conference on Artificial Intelligence and Virtual Reality (AIVR). IEEE, p. 174-183.
Su, Kang, et al. 2022. A natural bare-hand interaction method with augmented reality for constraint-based virtual assembly. IEEE Transactions on Instrumentation and Measurement, v. 71, p. 1-14
Hořejší, Petr, Konstantin Novikov, and Michal Šimon. 2020. A smart factory in a Smart City: virtual and augmented reality in a Smart assembly line. IEEE Access 8: 94330-94340, v. 8, p. 94330-94340
Hoffmann, Clemens, Sebastian Büttner, and Michael Prilla. 2022. Conveying procedural and descriptive knowledge with augmented reality. Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments, p. 40-49.
Büttner, Sebastian, Michael Prilla, and Carsten Röcker. 2020. Augmented reality training for industrial assembly work-are projection-based ar assistive systems an appropriate tool for assembly training?. Proceedings of the 2020 CHI conference on human factors in computing systems, p. 1-12.
Publicado
06/11/2023
Como Citar
CIM, Vanessa S.; HOUNSELL, Marcelo Da Silva.
Augmented Reality for Assembly Training in Industry: A Systematic Literature Mapping. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 25. , 2023, Rio Grande/RS.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
p. 77–87.
