AI-Driven Acceptance Testing: first insights exploring the educational potential for test analysts

  • Caio Jordan de Lima Maia UFPB
  • Yuska Paola Costa Aguiar UFPB

Resumo


This article examines the potential of AI-based natural language processing models, such as ChatGPT and Bard, as educational tools in the context of acceptance test case creation. The principal findings indicate that test cases manually generated by two QA professionals (one junior and one senior) exhibited reduced coverage and accuracy in comparison to those generated by the AIs, which, while expeditious, also demonstrated limitations. The findings indicate that AI can significantly enhance the learning process for less experienced QA professionals by providing clear and structured examples. Furthermore, collaboration between AI tools and experienced professionals optimizes the process, offering greater efficiency and test coverage. The study underscores the importance of integrating technological advancements into educational practices to better prepare future software quality professionals.
Palavras-chave: Software Quality Education, Generative AI-Supported Education, Acceptance Test, Test Plan, Quality Assurance, ChatGPT, Bard
Publicado
05/11/2024
MAIA, Caio Jordan de Lima; AGUIAR, Yuska Paola Costa. AI-Driven Acceptance Testing: first insights exploring the educational potential for test analysts. In: SIMPÓSIO BRASILEIRO DE QUALIDADE DE SOFTWARE (SBQS), 23. , 2024, Bahia/BA. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2024 . p. 665–672.