Monitoring Student Engagement in Text-Reading Activities within the Moodle Environment Using PDFNoteTrack
Abstract
The lack of student engagement in learning tasks is one of the factors that can lead to academic failure. Monitoring the level of engagement allows teachers and students to seek improvements in the learning process. This work aims to present the PDFNoteTrack tool developed to support monitoring student engagement in text reading activities in the Moodle environment, recording elements such as interaction time, access to pages, and insertion of markings and comments in the text. The article also evaluates the tool's usability through an experiment involving 69 students from a distance learning specialization course. The results of applying the System Usability Scale (SUS) questionnaire indicate that, on average, users rated the tool's usability higher than the reference value.
Keywords:
Student Engagement, Text-Reading, Moodle, PDFNoteTrack
References
AQUINO, B.; STROELE, V.; SOUZA, J. Análise do engajamento dos alunos em ambientes virtuais de aprendizagem para detecção de comunidade. In: SBC. Simpósio Brasileiro de Informática na Educação (SBIE). [S.l.], 2020. p. 952–961.
BACCA-ACOSTA, J.; AVILA-GARZON, C. Student engagement with mobile-based assessment systems: A survival analysis. Journal of Computer Assisted Learning, 2020.
BEN-ELIYAHU, A. et al. Investigating the multidimensionality of engagement: Affective, behavioral, and cognitive engagement across science activities and contexts. Contemporary Educational Psychology, Elsevier, v. 53, p. 87–105, 2018.
BOND, M. et al. Mapping research in student engagement and educational technology in higher education: a systematic evidence map. International Journal of Educational Technology in Higher Education, v. 17, 2020.
BROOKE, J. Sus: A quick and dirty usability scale. Usability Eval. Ind., v. 189, 11 1995.
DERMEVAL, D.; COELHO, J. A. d. M.; BITTENCOURT, I. I. Mapeamento sistemático e revisão sistemática da literatura em informática na educação. JAQUES, Patrícia Augustin; SIQUEIRA; Sean; BITTENCOURT, Ig; PIMENTEL, Mariano.(Org.) Metodologia de Pesquisa Cientifica em Informática na Educação: Abordagem Quantitativa. Porto Alegre: SBC, 2020.
FAN, S., Chen, L., Nair, M., Garg, S., Yeom, S., Kregor, G., and Wang, Y. Revealing impact factors on student engagement: Learning analytics adoption in online and blended courses in higher education. Education Sciences, v. 11, n. 10, 2021. ISSN 2227-7102.
HEILPORN, G.; RAYNAULT, A.; FRENETTE, E. Student engagement in a higher education course: A multidimensional scale for different course modalities. Social Sciences & Humanities Open, Elsevier, v. 9, p. 100794, 2024.
KIZILCEC, R. F.; CHEN, M. Student engagement in mobile learning via text message. In: Proceedings of the Seventh ACM Conference on Learning @ Scale. New York, NY, USA: Association for Computing Machinery, 2020. (L@S ’20), p. 157–166. ISBN 9781450379519.
LIU, M. et al. Measuring and visualizing students’ behavioral engagement in writing activities. IEEE Transactions on Learning Technologies, v. 8, p. 215–224, 04 2015.
O’BRIEN, H. L.; TOMS, E. What is user engagement? a conceptual framework for defining user engagement with technology. J. Assoc. Inf. Sci. Technol., v. 59, p. 938–955, 2008.
OIGARA, J. N. Using smart table technology for the interactive elementary classroom. In: Handbook of Research on Innovative Digital Practices to Engage Learners. [S.l.]: IGI Global, 2019. p. 158–176.
OLIVEIRA, P. L. S. de; SOUZA, A. J. de; RODRIGUES, R. Identificação de pesquisas referentes ao engajamento de alunos em plataformas de lms e suas relações com o desempenho acadêmico. In: Simpósio Brasileiro de Informática na Educação-SBIE). [S.l.: s.n.], 2019. v. 30, n. 1, p. 1631.
PESARE, E. et al. Visualizing student engagement in e-learning environment. In: 22th International Conference on Distributed Multimedia Systems (DMS). [S.l.: s.n.], 2016. p. 26–33.
SAID, N. S. An engaging multimedia design model. In: Proceedings of the 2004 conference on Interaction design and children: building a community. [S.l.: s.n.], 2004. p. 169–172. ISBN 1-58113-791-5.
SAINI, M. K.; GOEL, N. How smart are smart classrooms? A review of smart classroom technologies. ACM Comput. Surv., Association for Computing Machinery, New York, NY, USA, v. 52, n. 6, dez. 2019. ISSN 0360-0300.
SARACOSTTI, M. et al. Development of a web-based system to measure, monitor and promote school engagement strategies. In: MESQUITA, A. et al. (Ed.). Perspectives and Trends in Education and Technology. Singapore: Springer Nature Singapore, 2023. p. 45–57. ISBN 978-981-19-6585-2.
WANG, M. et al. The impact of mobile learning on students’ learning behaviours and performance: Report from a large blended classroom. British Journal of Educational Technology - BRIT J EDUC TECHNOL, v. 40, p. 673–695, 07 2009.
ZIBERS, B.; ESTES, J. S. Creating a virtual reality lab: using a student-centered approach. In: Current and prospective applications of virtual reality in Higher Education. [S.l.]: IGI Global, 2021. p. 145–169. ISBN 9781799849612.
BACCA-ACOSTA, J.; AVILA-GARZON, C. Student engagement with mobile-based assessment systems: A survival analysis. Journal of Computer Assisted Learning, 2020.
BEN-ELIYAHU, A. et al. Investigating the multidimensionality of engagement: Affective, behavioral, and cognitive engagement across science activities and contexts. Contemporary Educational Psychology, Elsevier, v. 53, p. 87–105, 2018.
BOND, M. et al. Mapping research in student engagement and educational technology in higher education: a systematic evidence map. International Journal of Educational Technology in Higher Education, v. 17, 2020.
BROOKE, J. Sus: A quick and dirty usability scale. Usability Eval. Ind., v. 189, 11 1995.
DERMEVAL, D.; COELHO, J. A. d. M.; BITTENCOURT, I. I. Mapeamento sistemático e revisão sistemática da literatura em informática na educação. JAQUES, Patrícia Augustin; SIQUEIRA; Sean; BITTENCOURT, Ig; PIMENTEL, Mariano.(Org.) Metodologia de Pesquisa Cientifica em Informática na Educação: Abordagem Quantitativa. Porto Alegre: SBC, 2020.
FAN, S., Chen, L., Nair, M., Garg, S., Yeom, S., Kregor, G., and Wang, Y. Revealing impact factors on student engagement: Learning analytics adoption in online and blended courses in higher education. Education Sciences, v. 11, n. 10, 2021. ISSN 2227-7102.
HEILPORN, G.; RAYNAULT, A.; FRENETTE, E. Student engagement in a higher education course: A multidimensional scale for different course modalities. Social Sciences & Humanities Open, Elsevier, v. 9, p. 100794, 2024.
KIZILCEC, R. F.; CHEN, M. Student engagement in mobile learning via text message. In: Proceedings of the Seventh ACM Conference on Learning @ Scale. New York, NY, USA: Association for Computing Machinery, 2020. (L@S ’20), p. 157–166. ISBN 9781450379519.
LIU, M. et al. Measuring and visualizing students’ behavioral engagement in writing activities. IEEE Transactions on Learning Technologies, v. 8, p. 215–224, 04 2015.
O’BRIEN, H. L.; TOMS, E. What is user engagement? a conceptual framework for defining user engagement with technology. J. Assoc. Inf. Sci. Technol., v. 59, p. 938–955, 2008.
OIGARA, J. N. Using smart table technology for the interactive elementary classroom. In: Handbook of Research on Innovative Digital Practices to Engage Learners. [S.l.]: IGI Global, 2019. p. 158–176.
OLIVEIRA, P. L. S. de; SOUZA, A. J. de; RODRIGUES, R. Identificação de pesquisas referentes ao engajamento de alunos em plataformas de lms e suas relações com o desempenho acadêmico. In: Simpósio Brasileiro de Informática na Educação-SBIE). [S.l.: s.n.], 2019. v. 30, n. 1, p. 1631.
PESARE, E. et al. Visualizing student engagement in e-learning environment. In: 22th International Conference on Distributed Multimedia Systems (DMS). [S.l.: s.n.], 2016. p. 26–33.
SAID, N. S. An engaging multimedia design model. In: Proceedings of the 2004 conference on Interaction design and children: building a community. [S.l.: s.n.], 2004. p. 169–172. ISBN 1-58113-791-5.
SAINI, M. K.; GOEL, N. How smart are smart classrooms? A review of smart classroom technologies. ACM Comput. Surv., Association for Computing Machinery, New York, NY, USA, v. 52, n. 6, dez. 2019. ISSN 0360-0300.
SARACOSTTI, M. et al. Development of a web-based system to measure, monitor and promote school engagement strategies. In: MESQUITA, A. et al. (Ed.). Perspectives and Trends in Education and Technology. Singapore: Springer Nature Singapore, 2023. p. 45–57. ISBN 978-981-19-6585-2.
WANG, M. et al. The impact of mobile learning on students’ learning behaviours and performance: Report from a large blended classroom. British Journal of Educational Technology - BRIT J EDUC TECHNOL, v. 40, p. 673–695, 07 2009.
ZIBERS, B.; ESTES, J. S. Creating a virtual reality lab: using a student-centered approach. In: Current and prospective applications of virtual reality in Higher Education. [S.l.]: IGI Global, 2021. p. 145–169. ISBN 9781799849612.
Published
2024-11-04
How to Cite
SCAVASSA, Marcelo B. A.; PIMENTEL, Edson P.; BRAGA, Juliana; DOTTA, Silvia.
Monitoring Student Engagement in Text-Reading Activities within the Moodle Environment Using PDFNoteTrack. In: BRAZILIAN SYMPOSIUM ON COMPUTERS IN EDUCATION (SBIE), 35. , 2024, Rio de Janeiro/RJ.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 525-537.
DOI: https://doi.org/10.5753/sbie.2024.242824.
