Levels Approach for Evaluating and Improving Software Processes
Abstract
This paper proposes an approach for software process evaluation and improvement that includes three levels: project level, organizations level, and an external level. In the first level, evaluations are done to the processes applied to the projects, looking for weaknesses in the processes for each project. In the second level the measures and results of all project processes evaluations are consolidated and analyzed to suggest improvements to the organizational processes. In the last level, measures and results from several organizations are analyzed, looking for common problems and successes patterns, resulting in improvements on “software process assets” and supporting tools.
Keywords:
Levels Approach, Evaluation and Improvement, Software Processes
References
Albuquerque, A., (2005), “Melhoria de Processos Organizacionais no Ambiente TABA”, Exame de Qualificação de Doutorado, PESC, COPPE-UFRJ.
Andrade, J., (2005), “Avaliação de Processos de Software no Ambiente TABA”, Dissertação de Mestrado, PESC, COPPE-UFRJ.
Basili, V., Caldiera, G., and Rombach, H. D., (1994a) “Goal Question Metric Paradigm”, Encyclopedia of Software Engineering (Marciniak, J. J., editor), vol. 1, John Wiley & Sons, pp.528-532.
Basili V. R. and Seaman C., (2002) “The Experience Factory Organization, IEEE Software”, pp. 30-31, June.
Blanco, M., Guitiérez, P. and Satriani, G., (2001) “SPI Patterns: Learning From Experience”, IEEE Software May/June.
Campos, F. B., (2005), “Melhoria de Processos e Evolução do Meta-ambiente da Estação TABA”, Exame de Qualificação de Doutorado, PESC, COPPE-UFRJ.
Campos, F. B., Albuquerque, A., Andrade, J., Silva Filho, R. e Rocha, A. R., (2005), “Estratégia em Níveis para a Avaliação e Melhoria de Processos de Software”, Relatório Técnico do Programa de Engenharia de Sistemas e Computação”, COPPE/UFRJ, Rio de Janeiro, Brasil.
Cattaneo, F., Fuggetta, A. and Sciuto, D., (2001) “Pursuing Coherence in Software Process Assessment and Improvement”, Software Process: Improvement an Practice, 6:3-22.
Chrissis, M., Konrad, M. and Shrum, S., (2003) CMMI : “Guidelines for Process Integration and Product Improvement”, Addison-Wesley Professional; 1st edition (February 24, 2003)
Conradi, R. and Fuggetta, A, (2002) “Improving Software Process Improvement”, IEEE Software, July/August.
Deming, W. E., (1986), “Out of the Crisis”, Cambridge: MIT Center for Advanced Engineering Study.
Dyba, T., (2002) “Enabling Software Process Improvement: An Investigation of The Importance of Organizational Issues”, Empirical Software Engineering, 7, 387 390, Kluwer academic Publishers, Netherlands.
Dymond, K., (1999) “Essence and Accidents in SEI-Style Assessments or Maybe this time the voice of the Engineer Will be Heard”, In Elements of Software Process Assessment and Improvement, K. El-Emam and N. Madhavji (eds.) IEEE CS Press.
Eickmann, N. and Anant, A., (2003), “Statistical Process Control: What You Don’t Measure Can Hurt You”, IEEE Software, http://computer.org/software, pp. 49-51.
Florac, W. and Carleton, A. E., (2000) “Measuring the Software Process: Statistical Process Control for Software Process Improvement”, Addison-Wesley.
Fuggetta, A., (2000), “Software Process: a Roadmap”, in: The Future of Software Engineering, IEEE Computer Society, pp. 25-34.
Garg, P. and Jazayeri, M. (1996) “Process-Centered Software Engineering Environments: A grand Tour” in Software Process. A. Fuggetta and A. Wolf (eds.), John Wiley & Sons.
Gnatz, M., Marschall, F., Popp, G., Rausch, A. and Schwerin, W., (2002), “Towards a Tool support for Living Software Development Process based on Process Patterns”, Proceedings of the 35th Hawaii International Conference on System Sciences.
Gomes, A., (2001) "Avaliação de processos de software baseada em medições", Tese de MSc., COPPE/UFRJ, Rio de Janeiro, RJ, Brasil, Jul 2001.
Greenwood, R. M., Kawalek, P., Robertson, I. and Warboys, B. C., (1996) “an Asset View on the Software Process”, Proceedings 10th International Software Process Workshop, Ventron, France.
Gruhn, V., (2000) “Software Process Landscaping”, Software Process: Improvement an Practice, 5:111-120.
Hefner, R. and Tauser, J., (2001) “Things They Never Taught You in CMM School”, 26th Annual NASA Goddard Software Engineering Workshop, November, pp. 27-29.
ISO 9000, (2000) “Quality Management Systems – Fundamental and Vocabulary”. International Standard Organization.
ISO/IEC 12207, (1995) “Information technology – software life cycle”, International Standard Organization.
ISO/IEC PDAM 12207, (2002) “Information Technology - Amendment to ISO/IEC 12207”. Montreal: ISO/IEC JTC1 SC7, 2002. International Standard Organization.
ISO/IEC TR 15504-2003: “Information Technology – Software Process Assessment”, Parts 1-9, International Organization for Standardization and the International Electrotechnical Commission, Geneva, Switzerland.
Kaltio,T. and Kinnula, A., (2000) “Deploying the Defined Software Process”; Software Process: Improvement and Practice, 5:65-83
Kan, S. H., (2003), “Metrics and Models in Software Quality Engineering”, Second Edition, Addison-Wesley.
Kitchenhan, B., Pfleeger, S. L. and Fenton, N., (1995), “Towards a Framework for Software Measurement Validation”, IEEE Transactions on Software Engineering, vol. 21, no. 12, December, pp. 929-943.
Leung, H. K. N. and Yuen, T. C. F., (2001), “A Process Framework for Small Projects”, Software Process: Improvement an Practice, 6:67-83.
McFeeley, B., (1996), IDEALSM: “A User's guide for Software Process Improvement, Handbook” - CMU/SEI-96-HB-001.
MCT/SEPIN – Secretaria de Política de Informática e Automação / Ministério da Ciência e Tecnologia, (2002), “Qualidade e Produtividade no Setor de Software Brasileiro” – 2001 / n.4., Brasília.
Montoni, M., Santos, G., Villela, K., Rocha, A. R., Travassos, G. H., Figueiredo, S., Mafra, S., Albuquerque, A., and Mian, P., (2005), “Enterprise-Oriented Software Development Environments to Support Software Products and Processes Quality Improvement”, Proceedings of the PROFES 2005: 370-384.
Paulk, M. C., Curtiss, B., Chrissis, M. B. and Weber, C. V., (1993), “Capability Maturity Model for Software”, Version 1.1, Pittsburgh, Software Engineering Institute.
Perry, D. E., (1988) “Problems of Scale and Process Models”, Position Paper in the 4th International Software Process Workshop, 1988.
Pfleeger, S. L., (2000), “Improving Predictions, Products, Processes and Resources”, In: Software Engineering, cap.13, pp. 563-592.
Oliveira, K., (1999), “Modelo para Constrição de Ambientes de Desenvolvimento de Software Orientados a Domínio”, Tese de D. Sc., COPPE/UFRJ, Rio de Janeiro, Brasil.
Rocha, A. R., Souza, J. M. and Aguiar, T. C., (1990), “TABA: A Heuristic Workstation for Software Development”. In: Proceedings of COMPEURO 90, pp. 126-129, Tel Aviv, Israel, May.
Silva Filho, R., (2005), “Uma abordagem Experimental para avaliação da melhoria de processos”, SBQS, Porto Alegre, Brasil.
SOFTEX (2005) “MPS.Br – Guia Geral”, http://www.softex.br/media/guia.pdf, acessado em 12/09/2005.
Travassos, G. H., (1994), “O Modelo de Integração de Ferramentas da Estação TABA”, Tese de D. Sc., COPPE/UFRJ, Rio de Janeiro, RJ, Brasil.
Villela, K., (2004), “Definição e Construção de Ambientes de Desenvolvimento de Software Orientados a Organização”, Tese de D.SC., COPPE/UFRJ, Rio de Janeiro, RJ, Brasil.
Wang, Y. and King, G., (2002), “Software Engineering Processes: Principles and Applications”, CRC Press. (EuroSPI Konferenzbände) 2002.
Weiss, D. Bennett, D. Payseur, J., Zhang, P. and Tendick, P. (2002) “Goal-Oriented Software Assessment”, ICSE 2002, Orlando, USA.
Andrade, J., (2005), “Avaliação de Processos de Software no Ambiente TABA”, Dissertação de Mestrado, PESC, COPPE-UFRJ.
Basili, V., Caldiera, G., and Rombach, H. D., (1994a) “Goal Question Metric Paradigm”, Encyclopedia of Software Engineering (Marciniak, J. J., editor), vol. 1, John Wiley & Sons, pp.528-532.
Basili V. R. and Seaman C., (2002) “The Experience Factory Organization, IEEE Software”, pp. 30-31, June.
Blanco, M., Guitiérez, P. and Satriani, G., (2001) “SPI Patterns: Learning From Experience”, IEEE Software May/June.
Campos, F. B., (2005), “Melhoria de Processos e Evolução do Meta-ambiente da Estação TABA”, Exame de Qualificação de Doutorado, PESC, COPPE-UFRJ.
Campos, F. B., Albuquerque, A., Andrade, J., Silva Filho, R. e Rocha, A. R., (2005), “Estratégia em Níveis para a Avaliação e Melhoria de Processos de Software”, Relatório Técnico do Programa de Engenharia de Sistemas e Computação”, COPPE/UFRJ, Rio de Janeiro, Brasil.
Cattaneo, F., Fuggetta, A. and Sciuto, D., (2001) “Pursuing Coherence in Software Process Assessment and Improvement”, Software Process: Improvement an Practice, 6:3-22.
Chrissis, M., Konrad, M. and Shrum, S., (2003) CMMI : “Guidelines for Process Integration and Product Improvement”, Addison-Wesley Professional; 1st edition (February 24, 2003)
Conradi, R. and Fuggetta, A, (2002) “Improving Software Process Improvement”, IEEE Software, July/August.
Deming, W. E., (1986), “Out of the Crisis”, Cambridge: MIT Center for Advanced Engineering Study.
Dyba, T., (2002) “Enabling Software Process Improvement: An Investigation of The Importance of Organizational Issues”, Empirical Software Engineering, 7, 387 390, Kluwer academic Publishers, Netherlands.
Dymond, K., (1999) “Essence and Accidents in SEI-Style Assessments or Maybe this time the voice of the Engineer Will be Heard”, In Elements of Software Process Assessment and Improvement, K. El-Emam and N. Madhavji (eds.) IEEE CS Press.
Eickmann, N. and Anant, A., (2003), “Statistical Process Control: What You Don’t Measure Can Hurt You”, IEEE Software, http://computer.org/software, pp. 49-51.
Florac, W. and Carleton, A. E., (2000) “Measuring the Software Process: Statistical Process Control for Software Process Improvement”, Addison-Wesley.
Fuggetta, A., (2000), “Software Process: a Roadmap”, in: The Future of Software Engineering, IEEE Computer Society, pp. 25-34.
Garg, P. and Jazayeri, M. (1996) “Process-Centered Software Engineering Environments: A grand Tour” in Software Process. A. Fuggetta and A. Wolf (eds.), John Wiley & Sons.
Gnatz, M., Marschall, F., Popp, G., Rausch, A. and Schwerin, W., (2002), “Towards a Tool support for Living Software Development Process based on Process Patterns”, Proceedings of the 35th Hawaii International Conference on System Sciences.
Gomes, A., (2001) "Avaliação de processos de software baseada em medições", Tese de MSc., COPPE/UFRJ, Rio de Janeiro, RJ, Brasil, Jul 2001.
Greenwood, R. M., Kawalek, P., Robertson, I. and Warboys, B. C., (1996) “an Asset View on the Software Process”, Proceedings 10th International Software Process Workshop, Ventron, France.
Gruhn, V., (2000) “Software Process Landscaping”, Software Process: Improvement an Practice, 5:111-120.
Hefner, R. and Tauser, J., (2001) “Things They Never Taught You in CMM School”, 26th Annual NASA Goddard Software Engineering Workshop, November, pp. 27-29.
ISO 9000, (2000) “Quality Management Systems – Fundamental and Vocabulary”. International Standard Organization.
ISO/IEC 12207, (1995) “Information technology – software life cycle”, International Standard Organization.
ISO/IEC PDAM 12207, (2002) “Information Technology - Amendment to ISO/IEC 12207”. Montreal: ISO/IEC JTC1 SC7, 2002. International Standard Organization.
ISO/IEC TR 15504-2003: “Information Technology – Software Process Assessment”, Parts 1-9, International Organization for Standardization and the International Electrotechnical Commission, Geneva, Switzerland.
Kaltio,T. and Kinnula, A., (2000) “Deploying the Defined Software Process”; Software Process: Improvement and Practice, 5:65-83
Kan, S. H., (2003), “Metrics and Models in Software Quality Engineering”, Second Edition, Addison-Wesley.
Kitchenhan, B., Pfleeger, S. L. and Fenton, N., (1995), “Towards a Framework for Software Measurement Validation”, IEEE Transactions on Software Engineering, vol. 21, no. 12, December, pp. 929-943.
Leung, H. K. N. and Yuen, T. C. F., (2001), “A Process Framework for Small Projects”, Software Process: Improvement an Practice, 6:67-83.
McFeeley, B., (1996), IDEALSM: “A User's guide for Software Process Improvement, Handbook” - CMU/SEI-96-HB-001.
MCT/SEPIN – Secretaria de Política de Informática e Automação / Ministério da Ciência e Tecnologia, (2002), “Qualidade e Produtividade no Setor de Software Brasileiro” – 2001 / n.4., Brasília.
Montoni, M., Santos, G., Villela, K., Rocha, A. R., Travassos, G. H., Figueiredo, S., Mafra, S., Albuquerque, A., and Mian, P., (2005), “Enterprise-Oriented Software Development Environments to Support Software Products and Processes Quality Improvement”, Proceedings of the PROFES 2005: 370-384.
Paulk, M. C., Curtiss, B., Chrissis, M. B. and Weber, C. V., (1993), “Capability Maturity Model for Software”, Version 1.1, Pittsburgh, Software Engineering Institute.
Perry, D. E., (1988) “Problems of Scale and Process Models”, Position Paper in the 4th International Software Process Workshop, 1988.
Pfleeger, S. L., (2000), “Improving Predictions, Products, Processes and Resources”, In: Software Engineering, cap.13, pp. 563-592.
Oliveira, K., (1999), “Modelo para Constrição de Ambientes de Desenvolvimento de Software Orientados a Domínio”, Tese de D. Sc., COPPE/UFRJ, Rio de Janeiro, Brasil.
Rocha, A. R., Souza, J. M. and Aguiar, T. C., (1990), “TABA: A Heuristic Workstation for Software Development”. In: Proceedings of COMPEURO 90, pp. 126-129, Tel Aviv, Israel, May.
Silva Filho, R., (2005), “Uma abordagem Experimental para avaliação da melhoria de processos”, SBQS, Porto Alegre, Brasil.
SOFTEX (2005) “MPS.Br – Guia Geral”, http://www.softex.br/media/guia.pdf, acessado em 12/09/2005.
Travassos, G. H., (1994), “O Modelo de Integração de Ferramentas da Estação TABA”, Tese de D. Sc., COPPE/UFRJ, Rio de Janeiro, RJ, Brasil.
Villela, K., (2004), “Definição e Construção de Ambientes de Desenvolvimento de Software Orientados a Organização”, Tese de D.SC., COPPE/UFRJ, Rio de Janeiro, RJ, Brasil.
Wang, Y. and King, G., (2002), “Software Engineering Processes: Principles and Applications”, CRC Press. (EuroSPI Konferenzbände) 2002.
Weiss, D. Bennett, D. Payseur, J., Zhang, P. and Tendick, P. (2002) “Goal-Oriented Software Assessment”, ICSE 2002, Orlando, USA.
Published
2006-05-29
How to Cite
CAMPOS, Fábio B.; ALBUQUERQUE, Adriano B.; ANDRADE, Jeann M.; SILVA FILHO, Reinaldo C.; ROCHA, Ana Regina C..
Levels Approach for Evaluating and Improving Software Processes. In: BRAZILIAN SOFTWARE QUALITY SYMPOSIUM (SBQS), 5. , 2006, Vila Velha.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2006
.
p. 100-114.
DOI: https://doi.org/10.5753/sbqs.2006.15603.
