Maturity Level Assessment in Software Testing in Small and Medium-Sized Enterprises of the State of Goiás

• Adailton Araújo Federal University of Goiás
• Cássio Rodrigues Federal University of Goiás
• Auri Vincenzi Federal University of Goiás
• Celso Camilo Federal University of Goiás

DOI: https://doi.org/10.5753/sbsi.2015.5845

Abstract

Software testing is an important component that leads to quality software production. This paper presents the results of a framework for assessing the level of maturity in Software Testing application in the context of Small and Medium-Sized Enterprises (SMEs) based on TMMi model. Our framework includes an evaluation questionnaire based on TMMi sub-practices, support tools with examples of artifacts required to ensure that the questionnaire is thoroughly completed, as well as an automated tool support for its application, enabling SMEs to carry out self-assessment. The framework was applied in ten companies and before the results presented, it can be concluded that the companies maturity in software testing is low and that the companies positively assessed the adequacy of the framework developed for the context of SMEs.

Keywords: Avaliação da Maturidade de Processo de Teste, Melhoria de Processo de Teste de Software, TMMi, TMM

References

A. Gentile. Associa¸c˜ao brasileira das empresas de software - mercado brasileiro de software - panorama e tendˆencias. Technical report, 2014.

C. Laporte, S. Alexandre, and A. Renault. Developing international standards for very small enterprises. Computer, 41(3):98–101, Mar. 2008.

E. H¨ohn. KITeste - A Framework of Knowledge and Test Process Improvement. PhD thesis, USP, S˜ao Carlos - SP - Brazil, June 2011. (in Portuguese).

I. Burnstein. Practical Software Testing: a process-oriented approach. Springer-Verlag New York, Inc., Secaucus, NJ, USA, 2002.

J. Brodman and D. Johnson. What small businesses and small organizations say about the CMM. pages 331–340. IEEE Comput. Soc. Press, Aug. 2002.

M. A. Montoni, A. R. Rocha, and K. C. Weber. MPS.BR: a successful program for software process improvement in brazil. Softw. Process, 14(5):289–300, Sept. 2009.

M. Khokhar, K. Zeshan, and J. Aamir. Literature review on the software process improvement factors in the small organizations. pages 592 – 598. IEEE Comput. Soc. Press, May 2010.

M. Q. A. A., S. Ramachandram, and A. M. A. An evolutionary software product development process for small and medium enterprises (SMEs). pages 298–303. IEEE, Oct. 2008.

S. Ng, T. Murnane, K. Reed, D. Grant, and T. Chen. A preliminary survey on software testing practices in australia. pages 116–125. IEEE, 2004.

SEI. Capability maturity model integration - CMMI version 1.3.

Softex. Evaluations published MPS.BR, Mar. 2012. (in Portuguese).

Softex. Melhoria do processo de teste brasileiro - MPT.Br vers˜ao 3.0.

SQI. Appraisal assistant, 2007.

T. Tayamanon, T. Suwannasart, N. Wongchingchai, and A. Methawachananont. TMM appraisal assistant tool. pages 329–333. IEEE, Aug. 2011.

T. Varkoi, T. Makinen, and H. Jaakkola. Process improvement priorities in small software companies. page 555. Portland Int. Conf. Manage. Eng. & Technol. PICMET, Aug. 2002.

TMMi-Foundation. Test maturity model integration - TMMi version 3.1.