A Process Model for Quality guided Programming: An Approach to Making Quantitative Evaluation of Software Systems Useful for Practitioners
Resumo
Quantitative evaluation of software systems has not yet been accepted by practioners. Early expectations especially into code analysis have not been met so far. Among several reasons for the rare use in practice we suppose a lack of empirical data, a dominant focus in research on formal aspects, as unreasonable embedding in the development process. The following papers deals with more technical reasons: lack of flexibility and usability of code measuring tools. We outline a process model for quality assurance during the coding phase providing human reviews as well as quantitative evaluation. The model is based on the idea of permanently adapting measuring tools to the goals of a project which will result in a metric and review guided coding cycle. The system presented generates software measuring tools providing the necessary flexibility for quick adaptions at hand. The generator is a equipped with a clear separation of language and metric description making both reusable when a new tool design is being generated. Experiments with several commercial programming languages and most classical code metrics proved the claim of flexibility and usability. We postulate that quantitative evaluation can work in practice if metrics, project constraint and management goals are matched within a local process of collecting empirical data.
Palavras-chave:
quality assurance, software metrics, quantitative evaluation of software, tools for metric analysis
Referências
Adamov R., Baumann P., Literature Review on SW-Metrics, Institut für Informatik der Universität Zürich, Okt.1987
Albrecht A. J., Gaffney J. E., SW-Function, Source Lines of Code, and Prediction: A SW-Science Validation, IEEE TSE, Vol. SE-9, No. 6, pp. 639-648., 1983
Basili V., Tayloring the SW process to Project Goals and Environments, In Proc. of the 9th Int. Conf. on SE, ACM, 1987
Berry, R. E., Meekings B.A.E., A Style Analysis of C Programs, CACM, Vol. 28, No. 1, pp. 80-88., Jan 1985.
Binder L.H., Poore J.H., Field Experiments With Local Software Quality Metrics, Software - Practice and Experience, Vol 20(7) p.631-647, 1990
Boehm B.W. Software engineering economics, IEEE TSE, Vol.SE-10,No.1,p.4-21 Jan. 1984
Boehm B.W., Understanding and controlling software costs, IEEE TSE, vol.14, No.10, p.1426-77, Oct. 1988
Briand L.C., Basili V.R., Hetmanski C.J., Providing an Empirical Basis for Optimizing the Verification and Testing Phases of SW Development, Proc. on Int. Symp. on S Reliability Engineering, North Carolina, USA, Oct 1992
Conte, Dunsmore, Shen, Metrics And Models, Benjamin/Cummings, 1986
Cote V., Bourque P., Oligny S., Rivard N., J., Software metrics: an overview of recent results, Syst. Softw., Vol.8, No.2, 1988, p.121-31.
Gill G.K., Kemerer Cyclomatic Complexity Density and Software Maintenance Productivity, IEEE TSE, Vol. 17, No.12, Dec. 1991, p.1284-1288
Grechenig Th., Biffl St., Taylor your own metrics environment: AMATO - a tool for the metric-engineer, Proc. of Eurometrics 92, Brüssel, p. 287-300, Apr. 1992
Halstead, M.H., Elements of SW-Science, Elsevier North-Holland, 1977
Hausen H. L., Müllerburg M., Über das Prüfen, Messen und Bewerten von SW. Methoden und Techniken der analytischen SW-Qualitätssicherung., Informatik-Spektrum, Band 10, 1987
Hon III S.E., Assuring SW Quality through Measurements: A Buyer's Perspective, J. Systems SW, 1990, Vol. 13, p.117-130, 1990
Höckel H., Itzfeld W.D., Qualitätsmaβe für SW in der Praxis, ONLINE 9/86, Sept. 1986
Ince D., Software Metrics, Measurement For Software Control and Assurance, Editors: Kitchenham B.A., Littlewood B. London, UK: Elsevier Appl. Sci. Publishers 1989, p. 27-62, 1989
Kafura, D.; Reddy, G.R., The use of software complexity metrics in software maintenance, IEEE TSE, VoL.SE-13, No.13, p.335-43, March 1987
Monitoring software development using metrics, Kitchenham B.A. UK IT 88 Conference Publication; London, UK: Inf. Eng. Directorate 1988, p. 45-8 of xix+618, Conf.:Swansea, July 1988
Kitchenham B. A.; Walker J. G., A quantitative approach to monitoring software development, Software Engin. Journal, Vol.4, No1, p.2-13., Jan.1989.
McCabe, T.J., A Complexity Measure, IEEE TSE, Vol.SE-2, No. 4, pp. 308-320., Dec 1976
McGarry F.E. Using software metrics and measurements to improve software productivity and quality, Proc. of the Comp. Standarts Conference 1988, Washington, DC: IEEE Comp. Soc. Press 1988, p.105 of x+111., 1988
Oman P. W., Cook C.R., Design and Code Traceability Using a PDL Metrics Tool, J. Systems SW, 1990, Vol. 12, p. 189-198
Page D.R., Static Code Analysis For COBOL Development: The Advantages of An Automated Programming Support Tool, Unisphere 8, 12: 64-66, Mar 1989
Paulish Dan, Best practices of software metrics, Tutorial 3, European conference on quantitative evaluation of software and systems, Proc. of Eurometrics 92, Brüssel, 1992
Prather, R.E., An Axiomatic Theory of SW Complexity Measure, Computer Journal, Vol. 27, No. 4, pp. 340-347, Nov 1984
Rechenberg P., Ein neues Maβ für die softwaretechnische Komplexität von Programmen, Informatik Forschung und Entwicklung 1; p. 26-57, 1986
Redmond J.A., Ah-Chuen R., Software Metrics - A User's Perspective, J. Systems SW, 1990, Vol. 13, p.97-110
Rombach H.D., SW-design metrics for maintenance, Proc. 9th Annu. SE Workshop, NASA Godard, pp. 100-134, Nov. 1984
Rombach H.D., Basili V.R., Quantitative SW-Qualitätssicherung. Eine Methode zur Definition und Nutzung geeigneter Maβe., Informatik-Spektrum, Band 10, 1987
Rombach H.D., Ulery B.T., Establishing a Measurement Based Maintenance Improvement Program: Lessons Learned in the SEL, Proc. of Conf. on Maintenance 1989, Miami FL, p.50-57, October 1989
Samadzadeh M.H., Nandakumar K., A Study of Software Metrics, J. Systems Software, 16; p.229-234, 1991
Schneidewind N.F., Methodology For Validating Software Metrics, IEEE TSE, Vol. 18, No. 5, May 1992, p.410-422
Sherif, Y.S.; Ng, E.; Steinbacher, Computer software development: quality attributes, measurements, and metrics, J. Naval Research Logistics, Vol.35, No.3, p.425-36, June 1988
Siegel Stan, Why we need checks and balances to assure quality, IEEE Software, Jan. 1992
Whale G., SW Metrics and Plagiarism Detection, J. Systems SW, Vol. 13, p.131-138, 1990
Zuse H., Bollmann P., Reply to: Erhard Konrad: Software Metrics, Measurement Theory, and Viewpoints - Critical Remarks on a New Approach, ACM SIGPLAN Notices, Vol. 26, No. 5, May 1991, p.27-36
Albrecht A. J., Gaffney J. E., SW-Function, Source Lines of Code, and Prediction: A SW-Science Validation, IEEE TSE, Vol. SE-9, No. 6, pp. 639-648., 1983
Basili V., Tayloring the SW process to Project Goals and Environments, In Proc. of the 9th Int. Conf. on SE, ACM, 1987
Berry, R. E., Meekings B.A.E., A Style Analysis of C Programs, CACM, Vol. 28, No. 1, pp. 80-88., Jan 1985.
Binder L.H., Poore J.H., Field Experiments With Local Software Quality Metrics, Software - Practice and Experience, Vol 20(7) p.631-647, 1990
Boehm B.W. Software engineering economics, IEEE TSE, Vol.SE-10,No.1,p.4-21 Jan. 1984
Boehm B.W., Understanding and controlling software costs, IEEE TSE, vol.14, No.10, p.1426-77, Oct. 1988
Briand L.C., Basili V.R., Hetmanski C.J., Providing an Empirical Basis for Optimizing the Verification and Testing Phases of SW Development, Proc. on Int. Symp. on S Reliability Engineering, North Carolina, USA, Oct 1992
Conte, Dunsmore, Shen, Metrics And Models, Benjamin/Cummings, 1986
Cote V., Bourque P., Oligny S., Rivard N., J., Software metrics: an overview of recent results, Syst. Softw., Vol.8, No.2, 1988, p.121-31.
Gill G.K., Kemerer Cyclomatic Complexity Density and Software Maintenance Productivity, IEEE TSE, Vol. 17, No.12, Dec. 1991, p.1284-1288
Grechenig Th., Biffl St., Taylor your own metrics environment: AMATO - a tool for the metric-engineer, Proc. of Eurometrics 92, Brüssel, p. 287-300, Apr. 1992
Halstead, M.H., Elements of SW-Science, Elsevier North-Holland, 1977
Hausen H. L., Müllerburg M., Über das Prüfen, Messen und Bewerten von SW. Methoden und Techniken der analytischen SW-Qualitätssicherung., Informatik-Spektrum, Band 10, 1987
Hon III S.E., Assuring SW Quality through Measurements: A Buyer's Perspective, J. Systems SW, 1990, Vol. 13, p.117-130, 1990
Höckel H., Itzfeld W.D., Qualitätsmaβe für SW in der Praxis, ONLINE 9/86, Sept. 1986
Ince D., Software Metrics, Measurement For Software Control and Assurance, Editors: Kitchenham B.A., Littlewood B. London, UK: Elsevier Appl. Sci. Publishers 1989, p. 27-62, 1989
Kafura, D.; Reddy, G.R., The use of software complexity metrics in software maintenance, IEEE TSE, VoL.SE-13, No.13, p.335-43, March 1987
Monitoring software development using metrics, Kitchenham B.A. UK IT 88 Conference Publication; London, UK: Inf. Eng. Directorate 1988, p. 45-8 of xix+618, Conf.:Swansea, July 1988
Kitchenham B. A.; Walker J. G., A quantitative approach to monitoring software development, Software Engin. Journal, Vol.4, No1, p.2-13., Jan.1989.
McCabe, T.J., A Complexity Measure, IEEE TSE, Vol.SE-2, No. 4, pp. 308-320., Dec 1976
McGarry F.E. Using software metrics and measurements to improve software productivity and quality, Proc. of the Comp. Standarts Conference 1988, Washington, DC: IEEE Comp. Soc. Press 1988, p.105 of x+111., 1988
Oman P. W., Cook C.R., Design and Code Traceability Using a PDL Metrics Tool, J. Systems SW, 1990, Vol. 12, p. 189-198
Page D.R., Static Code Analysis For COBOL Development: The Advantages of An Automated Programming Support Tool, Unisphere 8, 12: 64-66, Mar 1989
Paulish Dan, Best practices of software metrics, Tutorial 3, European conference on quantitative evaluation of software and systems, Proc. of Eurometrics 92, Brüssel, 1992
Prather, R.E., An Axiomatic Theory of SW Complexity Measure, Computer Journal, Vol. 27, No. 4, pp. 340-347, Nov 1984
Rechenberg P., Ein neues Maβ für die softwaretechnische Komplexität von Programmen, Informatik Forschung und Entwicklung 1; p. 26-57, 1986
Redmond J.A., Ah-Chuen R., Software Metrics - A User's Perspective, J. Systems SW, 1990, Vol. 13, p.97-110
Rombach H.D., SW-design metrics for maintenance, Proc. 9th Annu. SE Workshop, NASA Godard, pp. 100-134, Nov. 1984
Rombach H.D., Basili V.R., Quantitative SW-Qualitätssicherung. Eine Methode zur Definition und Nutzung geeigneter Maβe., Informatik-Spektrum, Band 10, 1987
Rombach H.D., Ulery B.T., Establishing a Measurement Based Maintenance Improvement Program: Lessons Learned in the SEL, Proc. of Conf. on Maintenance 1989, Miami FL, p.50-57, October 1989
Samadzadeh M.H., Nandakumar K., A Study of Software Metrics, J. Systems Software, 16; p.229-234, 1991
Schneidewind N.F., Methodology For Validating Software Metrics, IEEE TSE, Vol. 18, No. 5, May 1992, p.410-422
Sherif, Y.S.; Ng, E.; Steinbacher, Computer software development: quality attributes, measurements, and metrics, J. Naval Research Logistics, Vol.35, No.3, p.425-36, June 1988
Siegel Stan, Why we need checks and balances to assure quality, IEEE Software, Jan. 1992
Whale G., SW Metrics and Plagiarism Detection, J. Systems SW, Vol. 13, p.131-138, 1990
Zuse H., Bollmann P., Reply to: Erhard Konrad: Software Metrics, Measurement Theory, and Viewpoints - Critical Remarks on a New Approach, ACM SIGPLAN Notices, Vol. 26, No. 5, May 1991, p.27-36
Publicado
27/10/1993
Como Citar
BIFFL, Stefan; GRECHENIG, Thomas.
A Process Model for Quality guided Programming: An Approach to Making Quantitative Evaluation of Software Systems Useful for Practitioners. In: SIMPÓSIO BRASILEIRO DE ENGENHARIA DE SOFTWARE (SBES), 7. , 1993, Rio de Janeiro/RJ.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
1993
.
p. 295-305.
DOI: https://doi.org/10.5753/sbes.1993.24412.
