Learner Experience in Technology-Enhanced Education: A Conceptual Framework of Design and Evaluation
Resumo
Learner Experience (LX) refers to learners’ perceptions and responses when interacting with educational activities supported by computational resources. The problem is that LX elements are often addressed implicitly, creating misalignment between planned activities and learners’s actual experiences. Thus, the goal of this thesis was to develop the LEDEF framework. The methodology was grounded in the Design Science Research paradigm and involved systematic mapping studies, feasibility studies, and case studies. The main results include 12 publications and the development of three technologies aimed at supporting educators, designers, and researchers. This research advances the continuous improvement of LX.Referências
Arachchi, T. K., Sitbon, L., and Zhang, J. (2017). Enhancing access to elearning for people with intellectual disability: Integrating usability with learning. In Human-Computer Interaction-INTERACT 2017: 16th IFIP TC 13 International Conference, Mumbai, India, September 25-29, 2017, Proceedings, Part II 16, pages 13–32. Springer.
Bevan, N., Carter, J., Earthy, J., Geis, T., and Harker, S. (2016). New iso standards for usability, usability reports and usability measures. In Human-Computer Interaction. Theory, Design, Development and Practice: 18th International Conference, HCI International 2016, Toronto, ON, Canada, July 17-22, 2016. Proceedings, Part I 18, pages 268–278. Springer.
Braun, V. and Clarke, V. (2006). Using thematic analysis in psychology. Qualitative research in psychology, 3(2):77–101.
Dewey, J. (1938). Experience and education. new york, ny: Kappa delta phi. Touchstone, 8(3).
dos Santos, G. C., Silva, D. E., Peres, L. M., and Valentim, N. M. C. (2024a). Case study of a model that evaluates the learner experience with dicts. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, pages 1–9.
dos Santos, G. C., Silva, D. E., and Valentim, N. M. (2023a). Feasibility study of a model that evaluates the learner experience: A quantitative and qualitative analysis. In XXII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais, pages 1–11.
dos Santos, G. C., Silva, D. E., and Valentim, N. M. (2023b). Proposal and preliminary evaluation of a learner experience evaluation model in information systems. In Proceedings of the XIX Brazilian Symposium on Information Systems, pages 308–316.
dos Santos, G. C., Silva, D. E. d. S., Peres, L. M., and Valentim, N. M. (2024b). Acceptance analysis of a learner experience evaluation model. In Simpósio Brasileiro de Informática na Educação (SBIE), pages 1057–1070. SBC.
dos Santos, G. C., Silva, D. E. d. S., and Valentim, N. M. (2022). Um mapeamento sistemático da literatura sobre iniciativas que avaliam a experiência do aprendiz. In Anais do XXXIII Simpósio Brasileiro de Informática na Educação, pages 621–633. SBC.
dos Santos, G. C., Silva, D. E. d. S., and Valentim, N. M. (2025). Learner experience evaluation: a feasibility study and a benchmark. Journal of the Brazilian Computer Society, 31(1):132–153.
El Mawas, N., Tal, I., Moldovan, A.-N., Bogusevschi, D., Andrews, J., Muntean, G.-M., and Muntean, C. H. (2020). Investigating the impact of an adventure-based 3d solar system game on primary school learning process. Knowledge Management & E-Learning: An International Journal, 12(2):165–190.
Huang, R., Hu, Y., and Yang, J. (2015). Improving learner experience in the technology rich classrooms. Ubiquitous learning environments and technologies, pages 243–258.
Huang, R., Spector, J. M., and Yang, J. (2019). Educational technology a primer for the 21st century. Springer.
Magyar, N. and Haley, S. R. (2020). Balancing learner experience and user experience in a peer feedback web application for moocs. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pages 1–8.
Martin, C., Hughes, J., and Richards, J. (2017). Learning dimensions: lessons from field studies. In Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education, pages 299–304.
Miller, B. (2014). Six dimensions of learner experience design. Retrieved October, 25:2014.
Ortiz, J., Junior, D. S., Oliveira, C. M., and Pereira, R. (2019). Pensamento computacional e cultura digital: discussões sobre uma prática para o letramento digital. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), volume 30, page 1241.
Papavlasopoulou, S., Giannakos, M. N., and Jaccheri, L. (2019). Exploring children’s learning experience in constructionism-based coding activities through design-based research. Computers in Human Behavior, 99:415–427.
Pawson, R. and Tilley, N. (1997). Realistic evaluation. sage.
Schmidt, M. and Huang, R. (2022). Defining learning experience design: Voices from the field of learning design & technology. TechTrends, 66(2):141–158.
Silva, D. E., Guerino, G. C., and Valentim, N. M. (2023). Analyzing the learners’ experience of an experimental hci course in a remote context. Journal on Interactive Systems, 14(1):341–353.
Silva, D. E., Sobrinho, M. C., and Valentim, N. M. (2020). Educação 4.0: um estudo de caso com atividades de computação desplugada na amazônia brasileira. Anais do Computer on the Beach, 11:141–147.
Silva, D. E. and Valentim, N. M. C. (2023). Projeto e avaliação da experiência do aprendiz em sistemas computacionais. In Simpósio Brasileiro de Educação em Computação (EDUCOMP), pages 36–37. SBC.
Silva, D. E. d. S., Conte, T., and Valentim, N. (2024a). A systematic mapping study about learner experience design in computational systems. Informatics in Education, 23(2):439–478.
Silva, D. E. d. S., Conte, T. U., and Valentim, N. M. C. (2024b). Learner experience design guidelines: Proposal and a preliminary evaluation with experts. In Simpósio Brasileiro de Informática na Educação (SBIE), pages 2922–2930. SBC.
Silva, D. E. d. S., Guerino, G. C., and Valentim, N. M. C. (2022). Ensino remoto emergencial da disciplina ihc experimental: uma análise baseada na experiência do aprendiz. In Anais do XXX Workshop sobre Educação em Computação, pages 215–226. SBC.
Silva, D. E. S., Conte, T. U., Guerino, G. C., and Valentim, N. M. C. (2025). From design to evaluation: A case study on learner experience. In 20th IFIP TC13 International Conference on Human-Computer Interaction (Interact) - accepted for publication.
Venkatesh, V. and Bala, H. (2008). Technology acceptance model 3 and a research agenda on interventions. Decision sciences, 39(2):273–315.
Zhang, D., Yang, Y., Ji, T., Xie, H., and He, Y. (2018). Designing craft learning experience for rural children: A case study on huayao cross-stitch in southwest china. In Cross-Cultural Design. Applications in Cultural Heritage, Creativity and Social Development: 10th International Conference, CCD 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA, July 15-20, 2018, Proceedings, Part II 10, pages 117–132. Springer.
Bevan, N., Carter, J., Earthy, J., Geis, T., and Harker, S. (2016). New iso standards for usability, usability reports and usability measures. In Human-Computer Interaction. Theory, Design, Development and Practice: 18th International Conference, HCI International 2016, Toronto, ON, Canada, July 17-22, 2016. Proceedings, Part I 18, pages 268–278. Springer.
Braun, V. and Clarke, V. (2006). Using thematic analysis in psychology. Qualitative research in psychology, 3(2):77–101.
Dewey, J. (1938). Experience and education. new york, ny: Kappa delta phi. Touchstone, 8(3).
dos Santos, G. C., Silva, D. E., Peres, L. M., and Valentim, N. M. C. (2024a). Case study of a model that evaluates the learner experience with dicts. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, pages 1–9.
dos Santos, G. C., Silva, D. E., and Valentim, N. M. (2023a). Feasibility study of a model that evaluates the learner experience: A quantitative and qualitative analysis. In XXII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais, pages 1–11.
dos Santos, G. C., Silva, D. E., and Valentim, N. M. (2023b). Proposal and preliminary evaluation of a learner experience evaluation model in information systems. In Proceedings of the XIX Brazilian Symposium on Information Systems, pages 308–316.
dos Santos, G. C., Silva, D. E. d. S., Peres, L. M., and Valentim, N. M. (2024b). Acceptance analysis of a learner experience evaluation model. In Simpósio Brasileiro de Informática na Educação (SBIE), pages 1057–1070. SBC.
dos Santos, G. C., Silva, D. E. d. S., and Valentim, N. M. (2022). Um mapeamento sistemático da literatura sobre iniciativas que avaliam a experiência do aprendiz. In Anais do XXXIII Simpósio Brasileiro de Informática na Educação, pages 621–633. SBC.
dos Santos, G. C., Silva, D. E. d. S., and Valentim, N. M. (2025). Learner experience evaluation: a feasibility study and a benchmark. Journal of the Brazilian Computer Society, 31(1):132–153.
El Mawas, N., Tal, I., Moldovan, A.-N., Bogusevschi, D., Andrews, J., Muntean, G.-M., and Muntean, C. H. (2020). Investigating the impact of an adventure-based 3d solar system game on primary school learning process. Knowledge Management & E-Learning: An International Journal, 12(2):165–190.
Huang, R., Hu, Y., and Yang, J. (2015). Improving learner experience in the technology rich classrooms. Ubiquitous learning environments and technologies, pages 243–258.
Huang, R., Spector, J. M., and Yang, J. (2019). Educational technology a primer for the 21st century. Springer.
Magyar, N. and Haley, S. R. (2020). Balancing learner experience and user experience in a peer feedback web application for moocs. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pages 1–8.
Martin, C., Hughes, J., and Richards, J. (2017). Learning dimensions: lessons from field studies. In Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education, pages 299–304.
Miller, B. (2014). Six dimensions of learner experience design. Retrieved October, 25:2014.
Ortiz, J., Junior, D. S., Oliveira, C. M., and Pereira, R. (2019). Pensamento computacional e cultura digital: discussões sobre uma prática para o letramento digital. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), volume 30, page 1241.
Papavlasopoulou, S., Giannakos, M. N., and Jaccheri, L. (2019). Exploring children’s learning experience in constructionism-based coding activities through design-based research. Computers in Human Behavior, 99:415–427.
Pawson, R. and Tilley, N. (1997). Realistic evaluation. sage.
Schmidt, M. and Huang, R. (2022). Defining learning experience design: Voices from the field of learning design & technology. TechTrends, 66(2):141–158.
Silva, D. E., Guerino, G. C., and Valentim, N. M. (2023). Analyzing the learners’ experience of an experimental hci course in a remote context. Journal on Interactive Systems, 14(1):341–353.
Silva, D. E., Sobrinho, M. C., and Valentim, N. M. (2020). Educação 4.0: um estudo de caso com atividades de computação desplugada na amazônia brasileira. Anais do Computer on the Beach, 11:141–147.
Silva, D. E. and Valentim, N. M. C. (2023). Projeto e avaliação da experiência do aprendiz em sistemas computacionais. In Simpósio Brasileiro de Educação em Computação (EDUCOMP), pages 36–37. SBC.
Silva, D. E. d. S., Conte, T., and Valentim, N. (2024a). A systematic mapping study about learner experience design in computational systems. Informatics in Education, 23(2):439–478.
Silva, D. E. d. S., Conte, T. U., and Valentim, N. M. C. (2024b). Learner experience design guidelines: Proposal and a preliminary evaluation with experts. In Simpósio Brasileiro de Informática na Educação (SBIE), pages 2922–2930. SBC.
Silva, D. E. d. S., Guerino, G. C., and Valentim, N. M. C. (2022). Ensino remoto emergencial da disciplina ihc experimental: uma análise baseada na experiência do aprendiz. In Anais do XXX Workshop sobre Educação em Computação, pages 215–226. SBC.
Silva, D. E. S., Conte, T. U., Guerino, G. C., and Valentim, N. M. C. (2025). From design to evaluation: A case study on learner experience. In 20th IFIP TC13 International Conference on Human-Computer Interaction (Interact) - accepted for publication.
Venkatesh, V. and Bala, H. (2008). Technology acceptance model 3 and a research agenda on interventions. Decision sciences, 39(2):273–315.
Zhang, D., Yang, Y., Ji, T., Xie, H., and He, Y. (2018). Designing craft learning experience for rural children: A case study on huayao cross-stitch in southwest china. In Cross-Cultural Design. Applications in Cultural Heritage, Creativity and Social Development: 10th International Conference, CCD 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA, July 15-20, 2018, Proceedings, Part II 10, pages 117–132. Springer.
Publicado
24/11/2025
Como Citar
SILVA, Deivid; CONTE, Tayana; VALENTIM, Natasha.
Learner Experience in Technology-Enhanced Education: A Conceptual Framework of Design and Evaluation. In: CONCURSO ALEXANDRE DIRENE (CTD-IE) - TESES DE DOUTORADO - CONGRESSO BRASILEIRO DE INFORMÁTICA NA EDUCAÇÃO (CBIE), 14. , 2025, Curitiba/PR.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2025
.
p. 1-15.
DOI: https://doi.org/10.5753/cbie_estendido.2025.13329.
