Uso da Multimodal Learning Analytics (MMLA) no Ensino Superior e seus Impactos Pedagógicos: Uma Revisão Integrativa da Literatura

  • Jeffté L. Mendes Universidade de Pernambuco (UPE)
  • Gabriel O. Albuquerque Universidade de Pernambuco (UPE)
  • Daniel L. Dantas Universidade Federal Rural de Pernambuco (UFRPE)
  • Manoela M. O. da Silva Universidade de Pernambuco (UPE)

Resumo


Esta pesquisa tem como objetivo explorar como a Multimodal Learning Analytics (MMLA) vem sendo utilizada na educação superior, seus impactos pedagógicos, as tecnologias associadas ao seu uso, bem como o papel e o suporte oferecidos aos docentes nos processos de ensino e aprendizagem. Para tanto, foi conduzida uma revisão integrativa da literatura de artigos publicados entre 2020 e 2025, resultando em 39 estudos recuperados da base de dados ACM Digital Library. Resultados preliminares apontam aplicações da MMLA voltadas ao acompanhamento do engajamento, do desempenho e da colaboração, mediadas por tecnologias multimodais, embora com atenção limitada ao papel e ao suporte docente.
Palavras-chave: Multimodal Learning Analytics, Ensino Superior, Revisão Integrativa

Referências

Alfredo, R. et al. (2025). "TeamTeachingViz: Benefits, Challenges, and Ethical Considerations of Using a Multimodal Analytics Dashboard to Support Team Teaching Reflection - Proceedings of the 15th International Learning Analytics and Knowledge Conference". In LAK '25: Proceedings of the 15th International Learning Analytics and Knowledge Conference, March 3 - 7, 2025, Dublin Ireland, ACM, New York, NY, United States, p. 58 - 69.

Alfredo, R. D. et al. (2023). "That Student Should be a Lion Tamer!" StressViz: Designing a Stress Analytics Dashboard for Teachers". In LAK2023: LAK23: 13th International Learning Analytics and Knowledge Conference, March 13 - 17, 2023, Arlington TX USA, ACM, New York, NY, United States, p. 57 – 67.

Blikstein, P. (2013). "Multimodal Learning Analytics". In: Proceedings of the Third International Conference on Learning Analytics and Knowledge (LAK '13), Leuven, Belgium, Association for Computing Machinery, p. 102–106.

Chejara, P. et al. (2024). "Bringing Collaborative Analytics using Multimodal Data to Masses: Evaluation and Design Guidelines for Developing a MMLA System for Research and Teaching Practices in CSCL - Proceedings of the 14th Learning Analytics and Knowledge Conference". In LAK '24: Proceedings of the 14th Learning Analytics and Knowledge Conference, March 18 - 22, 2024, Kyoto Japan, ACM, New York, NY, United States, p. 800 - 806.

Ciordas-Hertel, G.-P. et al. (2022). "How can Interaction Data be Contextualized with Mobile Sensing to Enhance Learning Engagement Assessment in Distance Learning?". In LAK '22: Proceedings of the 12th Learning Analytics and Knowledge Conference, March 21–25, 2022, Online, ACM, New York, NY, United States, p. 177–188.

Cukurova, M. et al. (2020). "Modelling Collaborative Problem-solving Competence with Transparent Learning Analytics: Is Video Data Enough?". In LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, March 23 - 27, 2020, Frankfurt Germany, ACM, New York, NY, United States, p. 270 - 275.

Deng, J.; Zhao, Y. (2023). "A Literature Review of Data-Driven Multimodal Learning Analytics in Education Based on Citespace". In LAK '23: Proceedings of the 13th Learning Analytics and Knowledge Conference, March 13–17, 2023, Arlington, TX, United States, ACM, New York, NY, United States, p. 390–397.

Echeverria, V. et al. (2024). "TeamSlides: a Multimodal Teamwork Analytics Dashboard for Teacher-guided Reflection in a Physical Learning Space - Proceedings of the 14th Learning Analytics and Knowledge Conference". In LAK '24: Proceedings of the 14th Learning Analytics and Knowledge Conference, March 18 - 22, 2024, Kyoto Japan, ACM, New York, NY, United States, p. 112 - 122.

Echeverria, V. et al. (2025). "TeamVision: An AI-powered Learning Analytics System for Supporting Reflection in Team-based Healthcare Simulation". In CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, April 26-May 1, 2025, Yokohama Japan, ACM, New York, NY, United States, Article No.: 309, p. 1 - 22.

Emerson, A. et al. (2023). "Multimodal Predictive Student Modeling with Multi-Task Transfer Learning.". In LAK2023: LAK23: 13th International Learning Analytics and Knowledge Conference, March 13 - 17, 2023, Arlington TX USA, ACM, New York, NY, United States, p. 333 - 344.

Feng, S. et al. (2024). "Heterogenous Network Analytics of Small Group Teamwork: Using Multimodal Data to Uncover Individual Behavioral Engagement Strategies - Proceedings of the 14th Learning Analytics and Knowledge Conference.". In LAK '24: The 14th Learning Analytics and Knowledge Conference, March 18 - 22, 2024, Kyoto Japan, ACM, New York, NY, United States, p. 587 - 597.

Fernandez-Nieto, G. et al. (2022). "Classroom Dandelions: Visualising Participant Position, Trajectory and Body Orientation Augments Teachers' Sensemaking". In CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 29 April - 5 May, 2022, New Orleans LA USA, ACM, New York, NY, United States, Article No.: 564, p. 1 - 17.

Gan, W. et al. (2022). "IoT-based Multimodal Analysis for Smart Education: Current Status, Challenges and Opportunities". In ICDAR '22: Proceedings of the 3rd ACM Workshop on Intelligent Cross-Data Analysis and Retrieval, June 27–30, 2022, Newark, NJ, United States, ACM, New York, NY, United States, p. 32–40.

Heilala, V. et al. (2024). "Toward Scalable and Transparent Multimodal Analytics to Study Standard Medical Procedures: Linking Hand Movement, Proximity, and Gaze Data". In SAC '24: Proceedings of the 39th ACM/SIGAPP Symposium on Applied Computing, April 8 - 12, 2024, Avila Spain, ACM, New York, NY, United States, p. 3 - 10.

Joshi, V. et al. (2024). "Enhancing Collaboration and Performance Among EMS Students Through Multimodal Learning Analytics". In ICMI '24: Proceedings of the 26th International Conference on Multimodal Interaction, November 4 - 8, 2024, San Jose Costa Rica, ACM, New York, NY, United States, p. 607 - 611.

Klein, C. et al. (2019). "Technological Barriers and Incentives to Learning Analytics Adoption in Higher Education: Insights from Users". Journal of Computing in Higher Education, 31(3), p. 604–625.

Kollom, K. et al. (2021). "A Four-Country Cross-Case Analysis of Academic Staff Expectations About Learning Analytics in Higher Education". The Internet and Higher Education, 49, 100788.

Lewis, A. et al. (2023). "Instructor-in-the-Loop Exploratory Analytics to Support Group Work". In LAK '23: Proceedings of the 13th Learning Analytics and Knowledge Conference, March 13–17, 2023, Arlington, TX, United States, ACM, New York, NY, United States, p. 284–292.

Li, X. et al. (2023). "CVPE: A Computer Vision Approach for Scalable and Privacy Preserving Socio-spatial, Multimodal Learning Analytics - LAK23: 13th International Learning Analytics and Knowledge Conference". In LAK2023: LAK23: 13th International Learning Analytics and Knowledge Conference, March 13 - 17, 2023, Honolulu HI USA, ACM, New York, NY, United States, p. 175 - 185.

Maldonado, R. M. et al. (2020). "From Data to Insights: A Layered Storytelling Approach for Multimodal Learning Analytics - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems". In CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, April 25 - 30, 2020, Honolulu HI USA, ACM, New York, NY, United States, p. 1 - 15.

Méndez, G. G. et al. (2025). "The Hidden Workload: Student Data Work in Multimodal Algorithmic Evaluations.". In Proceedings of the ACM on Human-Computer Interaction, Volume 9, Issue 7, November, 2025, ACM, New York, NY, United States, Article No.: CSCW491, p. 1 - 30.

Ng, J. T. D. et al. (2022). "Needs Analysis and Prototype Evaluation of Student facing LA Dashboard for Virtual Reality Content Creation". In LAK22: LAK22: 12th International Learning Analytics and Knowledge Conference, March 21 - 25, 2022, Online, USA, ACM, New York, NY, United States, p. 444 - 450.

Ng, J. T. D. et al. (2022). "Towards Multimodal Evaluation of Eye-tracked Virtual Heritage Environment". In AK22: LAK22: 12th International Learning Analytics and Knowledge Conference, March 21 - 25, 2022, Online, USA, ACM, New York, NY, United States, p. 451 - 457.

Ngoon, T. J. et al. (2023). "An Instructor is [already] able to keep track of 30 students": Students' Perceptions of Smart Classrooms for Improving Teaching & Their Emergent Understandings of Teaching and Learning". In DIS '23: Proceedings of the 2023 ACM Designing Interactive Systems Conference, July 10 - 14, 2023, Pittsburgh PA USA, ACM, New York, NY, United States, p. 1277 – 1292.

Pastushenko, O. et al. (2020). "A Methodology for Multimodal Learning Analytics and Flow Experience Identification within Gamified Assignments - Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems". In CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, April 25 - 30, 2020, Honolulu HI USA, ACM, New York, NY, United States, p. 1 - 9.

Patidar, P. et al. (2024). "ClassID: Enabling Student Behavior Attribution from Ambient Classroom Sensing Systems". In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 8, Issue 2, June, 2024, ACM, New York, NY, United States, Article No.: 55, p. 1 - 28.

Praharaj, S. et al. (2022). "Towards Collaborative Convergence: Quantifying Collaboration Quality with Automated Co-located Collaboration Analytics". In LAK22: 12th International Learning Analytics and Knowledge Conference, March 21 - 25, 2022, Online, USA, ACM, New York, NY, United States, Article No.: 309, p. 358 - 369.

Pugh, S. L. et al. (2022). "Do Speech-Based Collaboration Analytics Generalize Across Task Contexts?". In LAK22: LAK22: 12th International Learning Analytics and Knowledge Conference, March 21 - 25, 2022, Online, USA, ACM, New York, NY, United States, p. 208 - 218.

Que, Y. et al. (2024). "Using Multimodal Learning Analytics to Examine Learners' Responses to Different Types of Background Music during Reading Comprehension - Proceedings of the 14th Learning Analytics and Knowledge Conference". In LAK '24: Proceedings of the 14th Learning Analytics and Knowledge Conference, March 18 - 22, 2024, Kyoto Japan, ACM, New York, NY, United States, p. 749 – 756.

Saqr, M. et al. (2020). "High resolution temporal network analysis to understand and improve collaborative learning". In LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, March 23 - 27, 2020, Frankfurt Germany, ACM, New York, NY, United States, p. 314 - 319.

Sharma, K. et al. (2020). "Predicting learners' effortful behaviour in adaptive assessment using multimodal data". In LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, March 23 - 27, 2020, Frankfurt Germany, ACM, New York, NY, United States, p. 480 - 489.

Shen, Y. (2025). "AI-Driven Scaffolding and Affective Support in ESL Argumentative Writing: A Multimodal Analytics Approach - Proceedings of the 2025 6th International Conference on Education, Knowledge and Information Management". In ICEKIM '25: Proceedings of the 2025 6th International Conference on Education, Knowledge and Information Management, June 20 - 22, 2025, Cambridge United Kingdom, ACM, New York, NY, United States, p. 604 - 608.

Souza, M. T., Silva, M. D., & Carvalho, R. (2010). "Revisão integrativa: O que é e como fazer." Einstein (São Paulo), 8(1, Pt. 1), 102–106.

Sun, T. et al. (2025). "A Video-Based Action Recognition Intelligent Assessment System for Art Education: A Case Study on Fundamentals of Sketching - Proceedings of the 2025 2nd International Symposium on Artificial Intelligence for Education". In ISAIE '25: Proceedings of the 2025 2nd International Symposium on Artificial Intelligence for Education, September 19 - 21, 2025, Changsha China, ACM, New York, NY, United States, p. 662 - 667.

Tsai, Y.-S. et al. (2022). "Charting Design Needs and Strategic Approaches for Academic Analytics Systems through Co-Design". In LAK '22: Proceedings of the 12th Learning Analytics and Knowledge Conference, March 21–25, 2022, Online, ACM, New York, NY, United States, p. 381–391.

Vrzakova, H. et al. (2020). "Focused or Stuck Together: Multimodal Patterns Reveal Triads' Performance in Collaborative Problem Solving". In LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, March 23 - 27, 2020, Frankfurt Germany, ACM, New York, NY, United States, p. 295 - 304.

Wang, Y.; Lu, S.; Harter, D. (2020). "Eye Tracking and Learning Analytics for Promoting Proactive Teaching and Learning in Classroom: A Survey". In LAK '20: Proceedings of the 10th International Conference on Learning Analytics & Knowledge, March 23–27, 2020, Frankfurt, Germany (Virtual Event), ACM, New York, NY, United States, p. 156–160.

Wang, Z. et al. (2024). "Unveiling Synchrony of Learners' Multimodal Data in Collaborative Maker Activities - Proceedings of the 14th Learning Analytics and Knowledge Conference". In LAK '24: Proceedings of the 14th Learning Analytics and Knowledge Conference, March 18 - 22, 2024, Kyoto Japan, ACM, New York, NY, United States, p. 922 - 928.

Yan, L. et al. (2025). "From Complexity to Parsimony: Integrating Latent Class Analysis to Uncover Multimodal Learning Patterns in Collaborative Learning - Proceedings of the 15th International Learning Analytics and Knowledge Conference". In LAK '25: The 15th International Learning Analytics and Knowledge Conference, March 3 - 7, 2025, Dublin Ireland, ACM, New York, NY, United States, p. 70 - 81.

Zhang, G. et al. (2025). "CPVis: Evidence based Multimodal Learning Analytics for Evaluation in Collaborative Programming". In CHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, April 26 - May 1, 2025, Yokohama Japan, ACM, New York, NY, United States, Article No.: 50, p. 1 - 26.

Zhang, W. et al. (2025). "Research on a Machine Learning-Based Personalized Learning Path Generation Model for Accounting Education - Proceedings of the 2025 2nd International Symposium on Artificial Intelligence for Education.". In ISAIE '25: Proceedings of the 2025 2nd International Symposium on Artificial Intelligence for Education, September 19 - 21, 2025, Changsha China, ACM, New York, NY, United States, p. 643 - 651.

Zhao, L. et al. (2022). "Modelling Co-located Team Communication from Voice Detection and Positioning Data in Healthcare Simulation". In LAK22: 12th International Learning Analytics and Knowledge Conference, March 21–25, 2022, Online, USA, ACM, New York, NY, USA, p. 370–380.

Zhao, L. et al. (2023). "METS: Multimodal Learning Analytics of Embodied Teamwork Learning". In LAK2023: LAK23: 13th International Learning Analytics and Knowledge Conference, March 13 - 17, 2023, Arlington TX USA, ACM, New York, NY, United States, p. 186 - 196.

Zhao, L. et al. (2024). "Epistemic Network Analysis for End-users: Closing the Loop in the Context of Multimodal Analytics for Collaborative Team Learning". In LAK '24: Proceedings of the 14th Learning Analytics and Knowledge Conference, March 18 - 22, 2024, Kyoto Japan, ACM, New York, NY, United States, p. 90 - 100.

Zhou, Q. et al. (2024). "Harnessing Transparent Learning Analytics for Individualized Support through Auto detection of Engagement in Face-to-Face Collaborative Learning". In LAK '24: Proceedings of the 14th Learning Analytics and Knowledge Conference, March 18 - 22, 2024, Kyoto Japan, ACM, New York, NY, United States, p. 392 – 403.
Publicado
05/10/2026
MENDES, Jeffté L.; ALBUQUERQUE, Gabriel O.; DANTAS, Daniel L.; DA SILVA, Manoela M. O.. Uso da Multimodal Learning Analytics (MMLA) no Ensino Superior e seus Impactos Pedagógicos: Uma Revisão Integrativa da Literatura. In: SIMPÓSIO BRASILEIRO DE INFORMÁTICA NA EDUCAÇÃO (SBIE), 37. , 2026, Goiânia/GO. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2026 . p. 2115-2131. DOI: https://doi.org/10.5753/sbie.2026.28218.