A novel intelligent mobile application using human-centered AR: A case study in orange inspection

• Jonathan C. F. da Silva Federal University of Ouro Preto http://orcid.org/0000-0003-2214-397X
• Mateus Coelho Silva Federal University of Ouro Preto https://orcid.org/0000-0003-3717-1906
• Saul Delabrida Federal University of Ouro Preto https://orcid.org/0000-0002-8961-5313
• Eduardo Jose da Silva Luz Federal University of Ouro Preto https://orcid.org/0000-0001-5249-1559
• Ricardo A. R. Oliveira Federal University of Ouro Preto https://orcid.org/0000-0001-5167-1523

DOI: https://doi.org/10.5753/ihc_estendido.2022.224837

Abstract

The growing interest in Augmented Reality (AR) technologies is increasing due to their recent use by several productive industry sectors. Also, by Industry 4.0, one of the pillars is AR and artificial intelligence (AI) to support human-machine collaboration. Human-Centered AI is an emerging research area focusing on providing interactive solutions to support human activities. This paper presents an innovative mobile application (App) composed of an AR interface connected to an AI to assist a user in interactive decision-making in the orange inspection.

Keywords: AI, AR, App, orange, device

References

Azuma, R. T. (1997). A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments, 6(4):355–385.

Bottani, E. and Vignali, G. (2019). Augmented reality technology in the manufacturing industry: A review of the last decade. IISE Transactions, 51(3):284–310.

Caria, M., Sara, G., Todde, G., Polese, M., and Pazzona, A. (2019). Exploring smart glasses for augmented reality: A valuable and integrative tool in precision livestock farming. Animals, 9(11).

de Oliveira, M. E. and Corrêa, C. G. (2020). Virtual reality and augmented reality applications in agriculture: a literature review. In 2020 22nd Symposium on Virtual and Augmented Reality (SVR), pages 1–9.

Ferreira da Silva, J. C., Silva, M. C., and Oliveira, R. A. (2022). Towards a novel wearable solution for citrus inspection using edge ai. In 2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC), pages 966–971.

Fundecitrus (2021). Cancro cítrico.

Holzinger, A., Saranti, A., Angerschmid, A., Retzlaff, C. O., Gronauer, A., Pejakovic, V., Medel-Jimenez, F., Krexner, T., Gollob, C., and Stampfer, K. (2022). Digital transformation in smart farm and forest operations needs human-centered ai: Challenges and future directions. Sensors, 22(8):3043.

Labrie, A. and Cheng, J. (2020). Adapting usability heuristics to the context of mobile augmented reality. In Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology, UIST ’20 Adjunct, page 4–6, New York, NY, USA. Association for Computing Machinery.

Neves, M. F. and Trombin, V. G. (2017). Anuário da Citricultutura 2017. citrusbr, São Paulo, 1 edition.

Nielsen, J. (2006). How to conduct a heuristic evaluation.

Shneiderman, B. (2020). Human-centered artificial intelligence: Reliable, safe & trust-worthy. International Journal of Human–Computer Interaction, 36(6):495–504.

Velusamy, P., Rajendran, S., Mahendran, R. K., Naseer, S., Shafiq, M., and Choi, J.-G. (2022). Unmanned aerial vehicles (uav) in precision agriculture: Applications and challenges. Energies, 15(1).

Yang, X., Shu, L., Chen, J., Ferrag, M. A., Wu, J., Nurellari, E., and Huang, K. (2021). A survey on smart agriculture: Development modes, technologies, and security and privacy challenges. IEEE/CAA Journal of Automatica Sinica, 8(2):273–302.