Teaching Qualitative Research Methodology at Undergraduate Courses in Computing: An Evidence-Based Proposal
Abstract
The teaching of scientific methodology is a mandatory component for the Brazilian undergraduate courses in Computing. However, this component typically does not address qualitative research despite its increasing dissemination and relevance in Computer Science research. In this paper, we introduce the proposal of a qualitative research methodology course tailored to undergraduate courses in Computing. Among others, the didactic proposal of the course includes resources for stimulating students to think qualitatively, the linked teaching of data collection techniques, the discussion and analysis of real studies, and the conduction of group dynamics. We applied the course of qualitative research methodology as an elective course in the context of the Bachelor's Degree in Computer Science offered by Cefet/RJ, Brazil. Despite the challenges posed by exceptional remote learning, we achieved good levels of retention and approval. Through an opinion survey, we found a considerably positive perception about the learning experience and the didactic resources applied.
Keywords:
qualitative research, research methodology, undergraduate, computer science, opinion
References
Ana, W. P. S. and Lemos, G. C. (2018). Metodologia científica: a pesquisa qualitativa nas visões de lüdke e andré. Revista Eletrônica Científica Ensino Interdisciplinar, 4(12).
Aragon, C., Hutto, C., Echenique, A., Fiore-Gartland, B., Huang, Y., Kim, J., Neff, G., Xing, W., and Bayer, J. (2016). Developing a research agenda for human-centered data science. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion, pages 529–535.
Correia, J. L., Pereira, J. A., Mello, R., Garcia, A., Fonseca, B., Ribeiro, M., Gheyi, R., Kalinowski, M., Cerqueira, R., and Tiengo, W. (2020). Brazilian data scientists: Revealing their challenges and practices on machine learning model development. In 19th Brazilian Symposium on Software Quality, pages 1–10.
Cukierman, H. L., Teixeira, C., and Prikladnicki, R. (2007). Um olhar sociotécnico sobre a engenharia de software. Revista de Informática Teórica e Aplicada, 14(2):199–219.
de Mello, R. M., da Silva, P. C., and Travassos, G. H. (2014). Agilidade em processos de software: Evidências sobre características de agilidade e práticas ágeis. In Anais do XIII Simpósio Brasileiro de Qualidade de Software, pages 151–165. SBC.
de Mello, R. M., Uchoa, A. G., Oliveira, R. F., de Oliveira, D. T. M., Fonseca, B., Garcia, A. F., and de Mello, F. d. B. (2019). Investigating the social representations of code smell identification: a preliminary study. In 2019 IEEE/ACM 12th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE), pages 53–60. IEEE.
de Oliveira, S. L. (1999). Tratado de metodologia científica: projetos de pesquisas, TGI, TCC, monografias, dissertações e teses. Pioneira.
Dyba, T., Prikladnicki, R., Rönkkö, K., Seaman, C., and Sillito, J. (2011). Qualitative research in software engineering. Empirical Software Engineering, 16(4):425–429.
Flick, U. (2008). Introdução à pesquisa qualitativa-3. Artmed editora.
Hove, S. E. and Anda, B. (2005). Experiences from conducting semi-structured interviews in empirical software engineering research. In 11th IEEE International Software Metrics Symposium (METRICS’05), pages 10–pp. IEEE.
Kaplan, B. and Maxwell, J. A. (2005). Qualitative research methods for evaluating computer information systems. In Evaluating the organizational impact of healthcare information systems, pages 30–55. Springer.
Kontio, J., Lehtola, L., and Bragge, J. (2004). Using the focus group method in software engineering: obtaining practitioner and user experiences. In Proceedings. 2004 International Symposium on Empirical Software Engineering, 2004. ISESE’04., pages 271–280. IEEE.
Linaker, J., Sulaman, S. M., Höst, M., and de Mello, R. M. (2015). Guidelines for conducting surveys in software engineering v. 1.1.
Meng, M., Steinhardt, S., and Schubert, A. (2019). How developers use api documentation: an observation study. Communication Design Quarterly Review, 7(2):40–49.
Oh, C., Song, J., Choi, J., Kim, S., Lee, S., and Suh, B. (2018). I lead, you help but only with enough details: Understanding user experience of co-creation with artificial intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pages 1–13.
Pesce, L. and de Moura Abreu, C. B. (2013). Pesquisa qualitativa. Revista da FAEEBAEducação e Contemporaneidade, 22(40):19–29.
Rossi, S., Santangelo, G., Staffa, M., Varrasi, S., Conti, D., and Di Nuovo, A. (2018).
Psychometric evaluation supported by a social robot: Personality factors and technology acceptance. In 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pages 802–807. IEEE.
Vieira, A. A. N., Clemente, A., Dias, G. A., and Franca, M. T. (2017). Metodologia científica no brasil: ensino e interdisciplinaridade. Educação & Realidade, 42:237– 260.
Wazlawick, R. (2017). Metodologia de pesquisa para ciência da computação, volume 2. Elsevier Brasil.
Aragon, C., Hutto, C., Echenique, A., Fiore-Gartland, B., Huang, Y., Kim, J., Neff, G., Xing, W., and Bayer, J. (2016). Developing a research agenda for human-centered data science. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion, pages 529–535.
Correia, J. L., Pereira, J. A., Mello, R., Garcia, A., Fonseca, B., Ribeiro, M., Gheyi, R., Kalinowski, M., Cerqueira, R., and Tiengo, W. (2020). Brazilian data scientists: Revealing their challenges and practices on machine learning model development. In 19th Brazilian Symposium on Software Quality, pages 1–10.
Cukierman, H. L., Teixeira, C., and Prikladnicki, R. (2007). Um olhar sociotécnico sobre a engenharia de software. Revista de Informática Teórica e Aplicada, 14(2):199–219.
de Mello, R. M., da Silva, P. C., and Travassos, G. H. (2014). Agilidade em processos de software: Evidências sobre características de agilidade e práticas ágeis. In Anais do XIII Simpósio Brasileiro de Qualidade de Software, pages 151–165. SBC.
de Mello, R. M., Uchoa, A. G., Oliveira, R. F., de Oliveira, D. T. M., Fonseca, B., Garcia, A. F., and de Mello, F. d. B. (2019). Investigating the social representations of code smell identification: a preliminary study. In 2019 IEEE/ACM 12th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE), pages 53–60. IEEE.
de Oliveira, S. L. (1999). Tratado de metodologia científica: projetos de pesquisas, TGI, TCC, monografias, dissertações e teses. Pioneira.
Dyba, T., Prikladnicki, R., Rönkkö, K., Seaman, C., and Sillito, J. (2011). Qualitative research in software engineering. Empirical Software Engineering, 16(4):425–429.
Flick, U. (2008). Introdução à pesquisa qualitativa-3. Artmed editora.
Hove, S. E. and Anda, B. (2005). Experiences from conducting semi-structured interviews in empirical software engineering research. In 11th IEEE International Software Metrics Symposium (METRICS’05), pages 10–pp. IEEE.
Kaplan, B. and Maxwell, J. A. (2005). Qualitative research methods for evaluating computer information systems. In Evaluating the organizational impact of healthcare information systems, pages 30–55. Springer.
Kontio, J., Lehtola, L., and Bragge, J. (2004). Using the focus group method in software engineering: obtaining practitioner and user experiences. In Proceedings. 2004 International Symposium on Empirical Software Engineering, 2004. ISESE’04., pages 271–280. IEEE.
Linaker, J., Sulaman, S. M., Höst, M., and de Mello, R. M. (2015). Guidelines for conducting surveys in software engineering v. 1.1.
Meng, M., Steinhardt, S., and Schubert, A. (2019). How developers use api documentation: an observation study. Communication Design Quarterly Review, 7(2):40–49.
Oh, C., Song, J., Choi, J., Kim, S., Lee, S., and Suh, B. (2018). I lead, you help but only with enough details: Understanding user experience of co-creation with artificial intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pages 1–13.
Pesce, L. and de Moura Abreu, C. B. (2013). Pesquisa qualitativa. Revista da FAEEBAEducação e Contemporaneidade, 22(40):19–29.
Rossi, S., Santangelo, G., Staffa, M., Varrasi, S., Conti, D., and Di Nuovo, A. (2018).
Psychometric evaluation supported by a social robot: Personality factors and technology acceptance. In 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pages 802–807. IEEE.
Vieira, A. A. N., Clemente, A., Dias, G. A., and Franca, M. T. (2017). Metodologia científica no brasil: ensino e interdisciplinaridade. Educação & Realidade, 42:237– 260.
Wazlawick, R. (2017). Metodologia de pesquisa para ciência da computação, volume 2. Elsevier Brasil.
Published
2022-07-31
How to Cite
MELLO, Rafael de; MELLO, Fernanda de.
Teaching Qualitative Research Methodology at Undergraduate Courses in Computing: An Evidence-Based Proposal. In: WORKSHOP ON COMPUTING EDUCATION (WEI), 30. , 2022, Niterói.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
p. 322-333.
ISSN 2595-6175.
DOI: https://doi.org/10.5753/wei.2022.223233.
