skip to main content
10.1145/3422392.3422489acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbesConference Proceedingsconference-collections
research-article

Evaluating the impact of Software Testing Education through the Flipped Classroom Model in deriving Test Requirements

Published: 21 December 2020 Publication History

Abstract

Recent studies have shown that software testing professionals, for the most part, conduct testing activity in a non-systematic way in software projects developed in the industry. In this sense, with the understanding that it is necessary to educate professionals capable of performing the test activity in a systematic way, the community of Software Engineering educators has paid attention to teaching test criteria. In particular, studies have been carried out in the context of different pedagogical models to recognize the models that manage to promote effective learning. In this perspective, research is being conducted on the flipped classroom pedagogical model. Although there are already experimental studies on this model, they did not investigate whether the student studying with the flipped classroom model can apply the test criteria effectively, deriving the test requirements satisfactorily. Our study emerges intending to analyze these issues. The study is configured using an experimental process that compares the test requirements derived by students who studied with the flipped classroom model, with test requirements derived by students who studied with the traditional teaching model. From the observed dependent variables (efficiency, efficacy, and effectiveness), it is possible to notice that students who study with the flipped classroom model derive test requirements that satisfy the equivalence partitioning criterion of the software under test with greater effectiveness compared to students who study with the traditional teaching model.

References

[1]
P. Ammann and J. Offutt. 2008. Introduction to Software Testing. (1st ed.). Cambridge University Press, New York, NY, USA.
[2]
J. Bergmann and A. Sams. 2012. Flip your classroom: Reach every student in every class every day. International Society for Technology in Education, Washington, D.C., EUA.
[3]
J. F. P. Cheiran, E. de M. Rodrigues, E. L. de S. Carvalho, and J. P. S. da Silva. 2017. Problem-based learning to align theory and practice in software testing teaching. In Brazilian Symposium on Software Engineering, 328--337.
[4]
P. J. Clarke, D. Davis, T. M. King, J. Pava, and E. L. Jones. 2014. Integrating testing into software engineering courses supported by a collaborative learning environment. ACM Transactions on Computing Education, 14, 3, 1--33.
[5]
B. S. Clegg, J. M. Rojas, and G. Fraser. 2017. Teaching software testing concepts using a mutation testing game. In International Conference on Software Engineering, 33--36.
[6]
J.Cohen. 1992. A power primer. Psychological bulletin, 112, 1, 155.
[7]
T. D. Cook and D. T. Campbell. 1979. Quasi-Experimentation: Design & Analysis Issues for Field Settings. Houghton Mifflin, Boston, Massachusetts, United States.
[8]
A. Cury. 2006. Organização e métodos: uma visão holıstica. Atlas.
[9]
M. Delamaro, M. Jino, and J. Maldonado. 2016. Introdução ao Teste de Software. Elsevier, Rio de Janeiro, Brasil.
[10]
A. C. Dias-Neto, S. Matalonga, M. Solari, G. Robiolo, and G. H. Travassos. 2017. Toward the characterization of software testing practices in south america: looking at brazil and uruguay. Software Quality Journal, 25, 4, 1145--1183.
[11]
G. C. Gannod, J. E. Burge, and M. T. Helmick. 2008. Using the inverted classroom to teach software engineering. In International Conference on Software Engineering, 777--786.
[12]
V. Garousi and J. Zhi. 2013. A survey of software testing practices in canada. Journal of Systems and Software, 86, 5, 1354--1376.
[13]
T. Hynninen, J. Kasurinen, A. Knutas, and O. Taipale. 2018. Software testing: survey of the industry practices. In International Convention on Information and Communication Technology, Electronics and Microelectronics, 1449--1454.
[14]
P. C. Jorgensen. 2013. Software testing: a craftsman's approach. Auerbach Publications.
[15]
C. Kaner and R. L. Fiedler. 2005. Inside out: a computer science course gets a makeover. In The National Convention of the Association for Educational Communications and Technology, 254--264.
[16]
S. K. Khalsa, Y. Labiche, and J. Nicoletta. 2016. The power of single and error annotations in category partition testing: an experimental evaluation. In International Conference on Evaluation and Assessment in Software Engineering, 28:1--28:10.
[17]
O. A. L. Lemos, F. F. Silveira, F. C. Ferrari, and A. Garcia. 2017. The impact of software testing education on code reliability: an empirical assessment. Journal of Systems and Software.
[18]
B. Maqbool, F. U. Rehman, M. Abbas, and S. Rehman. 2018. Implementation of software testing practices in pakistan's software industry. In International Conference on Management Engineering, Software Engineering and Service Sciences, 147--152.
[19]
S. P. Ng, T. Murnane, K. Reed, D. Grant, and T. Y. Chen. 2004. A preliminary survey on software testing practices in australia. In Australian Software Engineering Conference, 116--125.
[20]
L. N. Paschoal, B. R. N. Oliveira, E. Y. Nakagawa, and S. R. S. Souza. 2019. Can we use the flipped classroom model to teach black-box testing to computer students? In Brazilian Symposium on Software Quality, 158--167.
[21]
L. N. Paschoal, L. R. Silva, and S. R. S. Souza. 2017. Abordagem flipped classroom em comparação com o modelo tradicional de ensino: uma investigação empírica no âmbito de teste de software. In Simpósio Brasileiro de Informática na Educação, 476--485.
[22]
L. N. Paschoal and S. R. S. Souza. 2018. A survey on software testing education in brazil. In Brazilian Symposium on Software Quality, 334--343.
[23]
L. N. Paschoal and S. R. S. Souza. 2018. Planejamento e aplicação de flipped classroom para o ensino de teste de software. RENOTE - Revista Novas Tecnologias na Educação, 16, 2, 1--10.
[24]
A. Soska, J. Mottok, and C. Wolff. 2016. An experimental card game for software testing: development, design and evaluation of a physical card game to deepen the knowledge of students in academic software testing education. In IEEE Global Engineering Education Conference, 576--584.
[25]
D. M. Souza. 2017. Subsídios à integração de ferramentas de avaliação automática e sistemas de gerenciamento de aprendizagem. Ph.D. Dissertation. Instituto de Ciências Matemáticas e de Computação, Universidade de São Paulo, São Carlos.
[26]
G. Tan. 2016. A collection of well-known software failures. (2016). http://www.cse.psu.edu/~gxt29/bug/softwarebug.html.
[27]
S. Tiwari, V. Saini, P. Singh, and A. Sureka. 2018. A case study on the application of case-based learning in software testing. In Innovations in Software Engineering Conference, 1--5.
[28]
C. Wohlin, P. Runeson, M. Hst, M. C. Ohlsson AND B. Regnell, and A. Wessln. 2012. Experimentation in Software Engineering. Springer Publishing Company, Incorporated, New York City, USA.
[29]
P. Y. Wu, P. Manohar, and S. Acharya. 2016. The design and evaluation of class exercises as active learning tools in software verification and validation. Information Systems Education Journal, 14, 4, 4--12.
[30]
M. Zhivich and R. K. Cunningham. 2009. The real cost of software errors. IEEE Security Privacy, 7, 2, 87--90.

Cited By

View all
  • (2024)Uso de Práticas Gamificadas no Ensino de Verificação e Validação de SoftwareAnais do IV Simpósio Brasileiro de Educação em Computação (EDUCOMP 2024)10.5753/educomp.2024.237525(184-192)Online publication date: 22-Apr-2024
  • (2023)An Open Educational Resource Supporting Mutation Testing TeachingProceedings of the XXII Brazilian Symposium on Software Quality10.1145/3629479.3629496(291-300)Online publication date: 7-Nov-2023
  • (2021)A diagnosis on software testing education in the Brazilian Universities2021 IEEE Frontiers in Education Conference (FIE)10.1109/FIE49875.2021.9637305(1-8)Online publication date: 13-Oct-2021

Index Terms

  1. Evaluating the impact of Software Testing Education through the Flipped Classroom Model in deriving Test Requirements

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    SBES '20: Proceedings of the XXXIV Brazilian Symposium on Software Engineering
    October 2020
    901 pages
    ISBN:9781450387538
    DOI:10.1145/3422392
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • SBC: Brazilian Computer Society

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 December 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Computing Education
    2. Flipped Classroom Model
    3. Software Testing

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
    • CNPq
    • State of São Paulo Research Foundation

    Conference

    SBES '20

    Acceptance Rates

    Overall Acceptance Rate 147 of 427 submissions, 34%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)35
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Uso de Práticas Gamificadas no Ensino de Verificação e Validação de SoftwareAnais do IV Simpósio Brasileiro de Educação em Computação (EDUCOMP 2024)10.5753/educomp.2024.237525(184-192)Online publication date: 22-Apr-2024
    • (2023)An Open Educational Resource Supporting Mutation Testing TeachingProceedings of the XXII Brazilian Symposium on Software Quality10.1145/3629479.3629496(291-300)Online publication date: 7-Nov-2023
    • (2021)A diagnosis on software testing education in the Brazilian Universities2021 IEEE Frontiers in Education Conference (FIE)10.1109/FIE49875.2021.9637305(1-8)Online publication date: 13-Oct-2021

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media