Luís Guilherme Eich
ABSTRACT
Context: Technological transformations drive the growth of online classrooms and present both opportunities and challenges for understanding students’ experiences in the learning process. The Experience Sampling Method (ESM) allows capturing these experiences as they occur and can be used to understand better the factors that influence the learning process.
Problem: Although the ESM has advantages compared to other collection methods, such as reducing cognitive bias, it is still not widespread in the Education area. In addition, it was observed in the literature the lack of tools to support the application of the ESM.
Solution: The article presents a computational model named ESMeRA to aid in applying the ESM. The model includes aspects to provide computational support for the preparation, collection, and analysis of the experiences collected from the participants.
IS Theory: The work was carried out following the Design Theory. Also, the foundations of the Unified Theory of Acceptance and Use of Technology (UTAUT) were mainly employed to evaluate the artifact’s user intent.
Method: This work adopted the Design Science Research (DSR) method. A literature review on ESM allowed the problem awareness, and a prototype of the artifact was developed and positively evaluated by five experts.
Contributions and Impact in the IS area: The contribution of this work is twofold. First, the developed model can feasibly support applying the ESM to collect students’ experiences. The practicality of the model also helps disseminate the method. Second, the work aims to address the IS challenge of understanding the students’ experiences in their learning process.
- Daniel J. Beal. 2015. ESM 2.0: State of the Art and Future Potential of Experience Sampling Methods in Organizational Research. Annual Review of Organizational Psychology and Organizational Behavior 2, 1(2015), 383–407. https://doi.org/10.1146/annurev-orgpsych-032414-111335 arXiv:https://doi.org/10.1146/annurev-orgpsych-032414-111335Google Scholar
Cross Ref
- Eva Susann Becker, Thomas Goetz, Vinzenz Morger, and John Ranellucci. 2014. The importance of teachers’ emotions and instructional behavior for their students’ emotions – An experience sampling analysis. Teaching and Teacher Education 43 (2014), 15–26. https://doi.org/10.1016/j.tate.2014.05.002Google ScholarCross Ref
- Patrick N. Beymer, Joshua M. Rosenberg, and Jennifer A. Schmidt. 2020. Does choice matter or is it all about interest? An investigation using an experience sampling approach in high school science classrooms. Learning and Individual Differences 78 (2020), 101812. https://doi.org/10.1016/j.lindif.2019.101812Google ScholarCross Ref
- Euan Bonner, Kevin Garvey, Matthew Miner, Sam Godin, and Hayo Reinders. 2022. Measuring real-time learner engagement in the Japanese EFL classroom. Innovation in Language Learning and Teaching 0, 0 (2022), 1–11. https://doi.org/10.1080/17501229.2021.2025379 arXiv:https://doi.org/10.1080/17501229.2021.2025379Google ScholarCross Ref
- Brasil. 2018. Lei nº 13.709, de 14 de agosto de 2018. Diário Oficial [da] República Federativa do Brasil (2018). http://www.planalto.gov.br/ccivil_03/_ato2015-2018/2018/lei/L13709.htmGoogle Scholar
- Isabel Cafezeiro, José Viterbo, Leonardo Cruz da Costa, Luciana Salgado, Marcelo Rocha, and Rodrigo Salvador Monteiro. 2017. Strengthening of the Sociotechnical Approach in Information Systems Research. In I GranDSI-BR – Grand Research Challenges in Information Systems in Brazil 2016-2026, R. M.; Maciel R. S. P. Boscarioli, C.; Araujo (Ed.). Special Committee on Information Systems (CE-SI). Brazilian Computer Society (SBC), Chapter 11, 133–147. http://www2.sbc.org.br/ce-si//arquivos/GranDSI-BR_Ebook-Final.pdfGoogle Scholar
- Mihaly Csikszentmihalyi. 2014. Flow and the Foundations of Positive Psychology (1 ed.). Springer, Dordrecht. https://doi.org/10.1007/978-94-017-9088-8Google Scholar
- ABED – Associação Brasileira de Educação a Distância. 2021. Censo Ead.Br: Relatório Analítico Da Aprendizagem A Distância No Brasil 2019/2020. InterSaberes. http://abed.org.br/arquivos/CENSO_EAD_2019_PORTUGUES.pdfGoogle Scholar
- Aline Dresch, Daniel Pacheco Lacerda, and José Antonio Valle Antunes Junior. 2020. Design science research: método de pesquisa para avanço da ciência e tecnologia. Bookman, Porto Alegre.Google Scholar
- Rosemary Francisco. 2020. Experience Sampling Method (ESM). In JAQUES, Patrícia Augustin; SIQUEIRA; Sean; BITTENCOURT, Ig; PIMENTEL, Mariano. (Org.) Metodologia de Pesquisa Científica em Informática na Educação: Abordagem Quantitativa. Porto Alegre. SBC. https://metodologia.ceie-br.org/livro-2Google Scholar
- Tapiwa Gundu. 2020. Smart Locker System Acceptance for Rural Last-Mile Delivery. In 2020 2nd International Multidisciplinary Information Technology and Engineering Conference (IMITEC). 1–7. https://doi.org/10.1109/IMITEC50163.2020.9334107Google Scholar
- Wilhelm Hofmann and Paresh V. Patel. 2015. SurveySignal: A Convenient Solution for Experience Sampling Research Using Participants’ Own Smartphones. Social Science Computer Review 33, 2 (2015), 235–253. https://doi.org/10.1177/0894439314525117 arXiv:https://doi.org/10.1177/0894439314525117Google ScholarDigital Library
- Katie M Lawson. 2021. Women’s Daily Performance, Enjoyment, and Comfort in Male-Dominated Majors: The Role of Social Interactions in Classes. Research in Higher Education 62, 4 (2021), 478–497. https://doi.org/10.1007/s11162-020-09609-5Google ScholarCross Ref
- Yufeng Liu, Tongsheng Liu, and Qiaoyun Ma. 2022. Immersive Virtual Reality Teaching in Colleges and Universities Based on Vision Sensors. Wireless Communications and Mobile Computing 2022 (2022). https://doi.org/10.1155/2022/5790491Google Scholar
- Anni Loukomies and Kalle Juuti. 2021. Primary Students’ Experiences of Remote Learning during COVID-19 School Closures: A Case Study of Finland. Education Sciences 11, 9 (2021), 560. https://doi.org/10.3390/educsci11090560Google ScholarCross Ref
- Jakob Nielsen and Thomas K. Landauer. 1993. A Mathematical Model of the Finding of Usability Problems. In Proceedings of the INTERACT ’93 and CHI ’93 Conference on Human Factors in Computing Systems (Amsterdam, The Netherlands) (CHI ’93). Association for Computing Machinery, New York, NY, USA, 206–213. https://doi.org/10.1145/169059.169166Google ScholarDigital Library
- Katariina Salmela-Aro, Katja Upadyaya, Patricio Cumsille, Jari Lavonen, Beatrice Avalos, and Jacquelynne Eccles. 2021. Momentary task-values and expectations predict engagement in science among Finnish and Chilean secondary school students. International Journal of Psychology 56, 3 (2021), 415–424. https://doi.org/10.1002/ijop.12719 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/ijop.12719Google ScholarCross Ref
- Ulrich Schiefele and Mihaly Csikszentmihalyi. 1994. Interest and the quality of experience in classrooms. European Journal of Psychology of Education 9, 3 (1994), 251–269. https://doi.org/10.1007/BF03172784Google ScholarCross Ref
- Software IBM SPSS. 2022. SPSS. https://www.ibm.com/br-pt/analytics/spss-statistics-software. Accessed: 2022-01-30.Google Scholar
- Mplus Team. 2022. The Mplus Modeling Framework. https://www.statmodel.com/. Accessed: 2022-01-30.Google Scholar
- Paco Core Team. 2022. The Personal Analytics Companion. https://www.pacoapp.com/. Accessed: 2022-01-30.Google Scholar
- R Core Team. 2022. R. https://www.r-project.org/. Accessed: 2022-01-30.Google Scholar
Index Terms
- ESMeRA: a computational model to support Experience Sampling Method (ESM) real-time application
Recommendations
Computerized experience sampling in the car: issues and challenges
AutomotiveUI '13: Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsUser Experience (UX) studies in the automotive context are essential for a good interaction design in the car. But there is a lack of appropriate methods to investigate the user's experience in-situ in a natural setting. In this paper we introduce ...
Towards an engaging e-reading experience
BooksOnline '11: Proceedings of the 4th ACM workshop on Online books, complementary social media and crowdsourcingElectronic books are gaining in popularity, but their potential is not fully exploited yet. This is especially true for children eBooks. HEBE (Highly Engaging eBook Experiences) project, aims to actively involve children in the design of a new concept ...
Analysis of technology adoption for real-time aspiration delivery system
ICCIP '17: Proceedings of the 3rd International Conference on Communication and Information ProcessingCity problems occurred had driven government of Jakarta to collaborate with service provider in Indonesia to operate application-based Real-Time Aspiration Delivery System (RTADS) for people to report any issues around Jakarta. However, people's ...
Comments