Automating test oracles for medical images of three-dimensional models
Abstract
Test Oracles determine whether an execution of a SUT (from English, System Under Test) is correct or not. However, depending on the nature of the data produced by the system, the SUT is known as the output system complex, making the automation of oracles a challenge. Systems in the area in particular, which analyze three-dimensional images, exemplify a type of complex exit system. One of the challenges associated with analyzing three-dimensional images is whether the output produced is cor- straight or not. The fact that it is a complex exit system makes this difficult task, making ad-hoc strategies and manuals of the In this master's work, the aim was to contribute through the of test oracles based on the extraction of characteristics from the outputs of the theme. The approach proposed has been applied specifically in systems whose outputs consist of three-dimensional synthetic images of blood vessels. To do so, the O-FIm / CO framework (Oracle for Images and Complex Outputs), which uses CBIR (Content-Based Image Retrieval) as a way to automate test oracles. Besides adaptations and extensions of the framework, plug-ins have been developed, which represent feature extractors for three-dimensional blood vessels. Two experimental studies were conducted aiming at to evaluate the effectiveness and accuracy of test-based oracles in evaluating this type of image. In addition, an experimental study was carried by comparing automated oracles and human oracles. The results evidence of the effectiveness of the approach as a promising strategy for activities, contributing to the reduction of time and efforts generated by manual approaches during the evaluation of the quality of systems three-dimensional medical imagers.
References
Bertolino, A. (2007). Software testing research: Achievements, challenges, dreams. In Future of Software Engineering, pages 85–103.
Delamaro, M. E., Maldonado, J. C., and Jino, M. (2017). Introdução ao teste de software. Elsevier.
Delamaro, M. E., Nunes, F. L. S., and Oliveira, R. A. P. (2013). Using concepts of content-based image retrieval to implement graphical testing oracles. Software Testing, Verification and Reliability, pages 171–198.
Galarreta-Valverde, M. A., Macedo, M. M. G., Mekkaaoi, C., and Jackowski, M. P. (2013). Three-dimensional synthetic blood vessel generation using stochastic Lsystems. In Proceedings of the Medical Imaging: Image Processing, pages 86691I–86691I–6.
Oliveira, R. A. P. (2017). Test oracles for systems with complex outputs: the case of TTS systems. Ph.d. thesis, Instituto de Ciências Matemáticas e de Computação (ICMC) – Universidade de S˜ao Paulo (USP), S˜ao Carlos,SP.
Oliveira, R. A. P., Delamaro, M. E., and Nunes, F. L. S. (2009). O-FIm – oracle for images. In Simpósio Brasileiro de Engenharia de Software (SBES), pages 1–6.
Oliveira, R. A. P., Gil, V. N., Nunes, F. L. S., and Delamaro, M. E. (2014). An extensible framework to implement test oracle for “non-testable programs”. In Proceedings of the 26th International Conference on Software Engineering & Knowledge Engineering, pages 199–204.
