Solução de rastreamento com três graus de liberdade para o Project North Star utilizando tecnologias abertas
Resumo
A realidade aumentada está cada vez mais presente na sociedade, porém óculos como o Hololens da Microsoft possuem preços demasiadamente proibitivo. Desta forma o projeto aberto com licença GLP 3.0, Project North Star é uma alternativa acessível deste tipo de tecnologia. A modularidade do projeto permite que diversas outras tecnologias sejam associadas a ele. Dentre elas pode-se citar um sistema de rastreamento baseado em um MIMU (Magnetic and Inertial Measurement Unit) que permite o usuário se movimentar utilizando o dispositivo com três graus de liberdade. O presente trabalho apresenta a implementação de uma solução de sistema de rastreamento baseado em MIMU para uma das versões do Project North Star, montado conforme descrito em Fracaro, Frata e Mauricio [1], utilizando um Arduino Nano como apoio.
Palavras-chave:
Realidade Aumentada, Rastreamento, Magnetic and Inertial Measurement Unit (MIMU)
Referências
F. Fracaro, F. F. F. Peres, and C. R. M. Mauricio, “Montando o Project North Star: Um Dispositivo de Visualização de Baixo Custo Baseado em Visão Óptica Direta,” in XXI SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA, 2019.
Microsoft, “Microsoft HoloLens | Mixed Reality Technology for Business”, Microsoft.com, 2020. [Online]. Available: https://www.microsoft.com/en-us/hololens. [Accessed: 20-Nov-2020].
Magic Leap, “Magic Leap | Reality is just beginning”, Magicleap.com, 2020. [Online]. Available: https://www.magicleap.com/en-us. [Accessed: 20-Nov-2020].
man and J. Swan II, “A Systematic view of Usability Studies in Augmented Reality between 2005 and 2014”, 2016 IEEE International Symposium on Mixed and AugmentedReality (ISMAR-Adjunct), 2016.
R. Azuma, ”The road to ubiquitous consumer augmented reality systems”, Human Behavior and Emerging Technologies, vol. 1, no. 1, pp.26-32, 2019.
R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier and B. MacIntyre,”Recent advances in augmented reality”, IEEE Computer Graphics andApplications, vol. 21, no. 6, pp. 34-47, 2001.
R. Azuma, ”A Survey of Augmented Reality”, Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355-385, 1997.
M. Billinghurst, A. Clark and G. Lee, ”A Survey of Augmented Reality”, tions and Trends® in Human–Computer Interaction, vol. 8, no.2-3, pp. 73-272, 2015.
O. Bimber and R. Raskar, ”Modern approaches to augmented reality”, ACM SIGGRAPH 2005 Courses on - SIGGRAPH ’05, 2005.
R. Roberto and V. Teichrieb, "Desenvolvimento de Sistema de Realidade Aumentada Projetiva com Aplicação em Educação", M.S. thesis, Universidade Federal de Pernambuco, 2012.
R. Tori and M. S. Hounsell, Eds. Introdução a Realidade Virtual e Aumentada. Porto Alegre: Editora SBC, 2020.
L. Motion, ”Project North Star—Leap Motion Developer”, Leap Motion Developer, 2019. [Online]. Available: https://developer.leapmotion.com/northstar. [Accessed: 20-Nov-2020].
Free Software Foundation, ”The GNU General Public License v3.0 - GNU Project - Free Software Foundation”, Gnu.org, 2019. [Online]. Available: https://www.gnu.org/licenses/gpl-3.0.html. [Accessed: 20-Nov-2020].
L. Motion, "Project North Star is Now Open Source - Leap Motion Blog", Leap Motion Blog, 2019. [Online]. Available: http://blog.leapmotion.com/north-star-open-source/. [Accessed: 20-Nov-2020].
L. Motion, "Leap Motion", Leap Motion, 2019. [Online]. Available: https://www.leapmotion.com/. [Accessed: 20-Nov-2020].
Ultraleap, "Digital worlds that feel human | Ultraleap", Ultraleap.com, 2020. [Online]. Availa-ble: https://www.ultraleap.com/. [Accessed: 20-Nov-2020].
D. Holz and D. Holz, "Our Journey to the North Star", Leap Motion Blog, 2019. [Online]. Available: http://blog.leapmotion.com/our-journey-to-the-north-star/. [Accessed: 20-Nov-2020].
"How to Build Project North Star Simplified Version", exiii | Haptic Wearable Technology for XR, 2019. [Online]. Available: https://exiii.jp/2018/07/25/project_north_star_en/. [Accessed: 20-Nov-2020].
"How to Build Project North Star Simplified ver.2", exiii | Haptic Wearable Technology for XR, 2019. [Online]. Available: https://exiii.jp/2018/12/07/project-north-star-simplified-v2-en/. [Accessed: 20-Nov-2020].
"Project North Star Headsets & Components | CombineReality", Combine Reality, 2020. [Online]. Available: https://combinereality.com/. [Accessed: 20-Nov-2020].
"Triton", Leap-27, 2020. [Online]. Available: https://leap-27.github.io/TritonProject-Guide/#. [Accessed: 20-Nov-2020].
F. Maurer, "Project North Star: Mechanical Update 1 - Leap Motion Blog", Leap Motion Blog, 2019. [Online]. Available: http://blog.leapmotion.com/project-north-star-mechanical-update-1/. [Accessed: 20-Nov-2020].
F. Maurer, "Project North Star: Mechanical Update 3 - Leap Motion Blog", Leap Motion Blog, 2019. [Online]. Available: http://blog.leapmotion.com/project-north-star-mechanical-update-3/. [Accessed: 20-Nov-2020].
"leapmotion/ProjectNorthStar", GitHub, 2019. [Online]. Available: https://github.com/leapmotion/ProjectNorthStar. [Accessed: 20-Nov-2020].
U. Technologies, "Unity - Unity", Unity, 2020. [Online]. Available: https://unity.com/. [Accessed: 20-Nov-2020].
F. Zhou, H. Duh and M. Billinghurst, "Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR," 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, Cambridge, 2008, pp. 193-202.
G. Koulieris, K. Aksit, M. Stengel, R. Mantiuk, K. Mania and C. Richardt, "Near-Eye Display and Tracking Technologies for Virtual and Augmented Reality", Computer Graphics Forum, vol. 38, no. 2, pp. 493-519, 2019.
E. Diaz, F. Müller, A. Jiménez and F. Zampella, "Evaluation of AHRS algorithms for inertial personal localization in industrial environments," 2015 IEEE International Conference on Industrial Technology (ICIT), Seville, 2015, pp. 3412-3417.
M. Nazarahari , H. Rouhani, “40 Years of Sensor Fusion for Orientation Tracking via Magnetic and Inertial Measurement Units: Methods, Lessons Learned, and Future Challenges”, Information Fusion (2020).
R. Bhardwaj, N. Kumar and V. Kumar, "Errors in micro-electro-mechanical systems inertial measurement and a review on present practices of error modelling", Transactions of the Institute of Measurement and Control, vol. 40, no. 1, 2017.
S. Madgwick, “An efficient orientation filter for inertial and inertial / magnetic sensor arrays”. 2010.
R. Mahony, T. Hamel, J. Pflimlin, “Nonlinear Complementary Filters on the Special Orthogonal Group”. IEEE Transactions on Automatic Control, Institute of Electrical and Electronics Engineers, vol. 53, no. 5, pp.1203-1217.
I. Corporation, "Tracking Technology – Intel RealSense Depth and Tracking Cameras", Intel® RealSense™ Depth and Tracking Cameras, 2020. [Online]. Available: https://www.intelrealsense.com/tracking/. [Accessed: 20-Nov-2020].
R. Kosaka, "Project North Star?3DoF??? - ryokosaka blog", Ryokosaka.com, 2020. [Online]. Available: https://ryokosaka.com/blog/181201.html. [Accessed: 20-Nov-2020].
InvenSense, "MPU-9250 | TDK", Invensense.tdk.com. [Online]. Available: https://invensense.tdk.com/products/motion-tracking/9-axis/mpu-9250/. [Accessed: 20-Nov-2020].
K. Winer, "kriswiner/MPU9250", GitHub, 2020. [Online]. Available: https://github.com/kriswiner/MPU9250. [Accessed: 20-Nov-2020].
S. Cogswell, "scogswell/ArduinoSerialCommand", GitHub, 2020. [Online]. Available: https://github.com/scogswell/ArduinoSerialCommand. [Accessed: 20-Nov-2020].
Arduino, "Software | Arduino", Arduino, 2020. [Online]. Available: https://www.arduino.cc/en/software. [Accessed: 20-Nov-2020].
L. Motion, "leapmotion/ProjectNorthStar - Software", GitHub, 2020. [Online]. Available: https://github.com/leapmotion/ProjectNorthStar/tree/master/Software. [Accessed: 20-Nov-2020].
Microsoft, "Visual Studio Code - Code Editing Redefined", Code.visualstudio.com, 2020. [Online]. Available: https://code.visualstudio.com/. [Accessed: 20-Nov-2020].
Arduino, "Arduino - Arduino Board Nano", Arduino.cc, 2020. [Online]. Available: https://www.arduino.cc/en/pmwiki.php?n=Main/ArduinoBoardNano. [Accessed: 20-Nov-2020].
Microsoft, “Microsoft HoloLens | Mixed Reality Technology for Business”, Microsoft.com, 2020. [Online]. Available: https://www.microsoft.com/en-us/hololens. [Accessed: 20-Nov-2020].
Magic Leap, “Magic Leap | Reality is just beginning”, Magicleap.com, 2020. [Online]. Available: https://www.magicleap.com/en-us. [Accessed: 20-Nov-2020].
man and J. Swan II, “A Systematic view of Usability Studies in Augmented Reality between 2005 and 2014”, 2016 IEEE International Symposium on Mixed and AugmentedReality (ISMAR-Adjunct), 2016.
R. Azuma, ”The road to ubiquitous consumer augmented reality systems”, Human Behavior and Emerging Technologies, vol. 1, no. 1, pp.26-32, 2019.
R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier and B. MacIntyre,”Recent advances in augmented reality”, IEEE Computer Graphics andApplications, vol. 21, no. 6, pp. 34-47, 2001.
R. Azuma, ”A Survey of Augmented Reality”, Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355-385, 1997.
M. Billinghurst, A. Clark and G. Lee, ”A Survey of Augmented Reality”, tions and Trends® in Human–Computer Interaction, vol. 8, no.2-3, pp. 73-272, 2015.
O. Bimber and R. Raskar, ”Modern approaches to augmented reality”, ACM SIGGRAPH 2005 Courses on - SIGGRAPH ’05, 2005.
R. Roberto and V. Teichrieb, "Desenvolvimento de Sistema de Realidade Aumentada Projetiva com Aplicação em Educação", M.S. thesis, Universidade Federal de Pernambuco, 2012.
R. Tori and M. S. Hounsell, Eds. Introdução a Realidade Virtual e Aumentada. Porto Alegre: Editora SBC, 2020.
L. Motion, ”Project North Star—Leap Motion Developer”, Leap Motion Developer, 2019. [Online]. Available: https://developer.leapmotion.com/northstar. [Accessed: 20-Nov-2020].
Free Software Foundation, ”The GNU General Public License v3.0 - GNU Project - Free Software Foundation”, Gnu.org, 2019. [Online]. Available: https://www.gnu.org/licenses/gpl-3.0.html. [Accessed: 20-Nov-2020].
L. Motion, "Project North Star is Now Open Source - Leap Motion Blog", Leap Motion Blog, 2019. [Online]. Available: http://blog.leapmotion.com/north-star-open-source/. [Accessed: 20-Nov-2020].
L. Motion, "Leap Motion", Leap Motion, 2019. [Online]. Available: https://www.leapmotion.com/. [Accessed: 20-Nov-2020].
Ultraleap, "Digital worlds that feel human | Ultraleap", Ultraleap.com, 2020. [Online]. Availa-ble: https://www.ultraleap.com/. [Accessed: 20-Nov-2020].
D. Holz and D. Holz, "Our Journey to the North Star", Leap Motion Blog, 2019. [Online]. Available: http://blog.leapmotion.com/our-journey-to-the-north-star/. [Accessed: 20-Nov-2020].
"How to Build Project North Star Simplified Version", exiii | Haptic Wearable Technology for XR, 2019. [Online]. Available: https://exiii.jp/2018/07/25/project_north_star_en/. [Accessed: 20-Nov-2020].
"How to Build Project North Star Simplified ver.2", exiii | Haptic Wearable Technology for XR, 2019. [Online]. Available: https://exiii.jp/2018/12/07/project-north-star-simplified-v2-en/. [Accessed: 20-Nov-2020].
"Project North Star Headsets & Components | CombineReality", Combine Reality, 2020. [Online]. Available: https://combinereality.com/. [Accessed: 20-Nov-2020].
"Triton", Leap-27, 2020. [Online]. Available: https://leap-27.github.io/TritonProject-Guide/#. [Accessed: 20-Nov-2020].
F. Maurer, "Project North Star: Mechanical Update 1 - Leap Motion Blog", Leap Motion Blog, 2019. [Online]. Available: http://blog.leapmotion.com/project-north-star-mechanical-update-1/. [Accessed: 20-Nov-2020].
F. Maurer, "Project North Star: Mechanical Update 3 - Leap Motion Blog", Leap Motion Blog, 2019. [Online]. Available: http://blog.leapmotion.com/project-north-star-mechanical-update-3/. [Accessed: 20-Nov-2020].
"leapmotion/ProjectNorthStar", GitHub, 2019. [Online]. Available: https://github.com/leapmotion/ProjectNorthStar. [Accessed: 20-Nov-2020].
U. Technologies, "Unity - Unity", Unity, 2020. [Online]. Available: https://unity.com/. [Accessed: 20-Nov-2020].
F. Zhou, H. Duh and M. Billinghurst, "Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR," 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, Cambridge, 2008, pp. 193-202.
G. Koulieris, K. Aksit, M. Stengel, R. Mantiuk, K. Mania and C. Richardt, "Near-Eye Display and Tracking Technologies for Virtual and Augmented Reality", Computer Graphics Forum, vol. 38, no. 2, pp. 493-519, 2019.
E. Diaz, F. Müller, A. Jiménez and F. Zampella, "Evaluation of AHRS algorithms for inertial personal localization in industrial environments," 2015 IEEE International Conference on Industrial Technology (ICIT), Seville, 2015, pp. 3412-3417.
M. Nazarahari , H. Rouhani, “40 Years of Sensor Fusion for Orientation Tracking via Magnetic and Inertial Measurement Units: Methods, Lessons Learned, and Future Challenges”, Information Fusion (2020).
R. Bhardwaj, N. Kumar and V. Kumar, "Errors in micro-electro-mechanical systems inertial measurement and a review on present practices of error modelling", Transactions of the Institute of Measurement and Control, vol. 40, no. 1, 2017.
S. Madgwick, “An efficient orientation filter for inertial and inertial / magnetic sensor arrays”. 2010.
R. Mahony, T. Hamel, J. Pflimlin, “Nonlinear Complementary Filters on the Special Orthogonal Group”. IEEE Transactions on Automatic Control, Institute of Electrical and Electronics Engineers, vol. 53, no. 5, pp.1203-1217.
I. Corporation, "Tracking Technology – Intel RealSense Depth and Tracking Cameras", Intel® RealSense™ Depth and Tracking Cameras, 2020. [Online]. Available: https://www.intelrealsense.com/tracking/. [Accessed: 20-Nov-2020].
R. Kosaka, "Project North Star?3DoF??? - ryokosaka blog", Ryokosaka.com, 2020. [Online]. Available: https://ryokosaka.com/blog/181201.html. [Accessed: 20-Nov-2020].
InvenSense, "MPU-9250 | TDK", Invensense.tdk.com. [Online]. Available: https://invensense.tdk.com/products/motion-tracking/9-axis/mpu-9250/. [Accessed: 20-Nov-2020].
K. Winer, "kriswiner/MPU9250", GitHub, 2020. [Online]. Available: https://github.com/kriswiner/MPU9250. [Accessed: 20-Nov-2020].
S. Cogswell, "scogswell/ArduinoSerialCommand", GitHub, 2020. [Online]. Available: https://github.com/scogswell/ArduinoSerialCommand. [Accessed: 20-Nov-2020].
Arduino, "Software | Arduino", Arduino, 2020. [Online]. Available: https://www.arduino.cc/en/software. [Accessed: 20-Nov-2020].
L. Motion, "leapmotion/ProjectNorthStar - Software", GitHub, 2020. [Online]. Available: https://github.com/leapmotion/ProjectNorthStar/tree/master/Software. [Accessed: 20-Nov-2020].
Microsoft, "Visual Studio Code - Code Editing Redefined", Code.visualstudio.com, 2020. [Online]. Available: https://code.visualstudio.com/. [Accessed: 20-Nov-2020].
Arduino, "Arduino - Arduino Board Nano", Arduino.cc, 2020. [Online]. Available: https://www.arduino.cc/en/pmwiki.php?n=Main/ArduinoBoardNano. [Accessed: 20-Nov-2020].
Publicado
02/12/2020
Como Citar
FRACARO, Franklin Luiz do Nascimento; PERES, Fabiana Frata Furlan; MAURICIO, Claudio Roberto Marquetto.
Solução de rastreamento com três graus de liberdade para o Project North Star utilizando tecnologias abertas. In: CONGRESSO LATINO-AMERICANO DE SOFTWARE LIVRE E TECNOLOGIAS ABERTAS (LATINOWARE), 17. , 2020, Online.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2020
.
p. 126-133.
DOI: https://doi.org/10.5753/latinoware.2020.18619.
