Identifying Implicit Process Variables To Support Future Empirical Work
Resumo
The most basic questions that researchers must address when introducing a new process or technique are what is the intended effect of that process and can that effect be demonstrated empirically. As the understanding of a process progresses, researchers become interested in more sophisticated questions about a process or technique, such as studying the relationship between a particular type of variable and the outcome of the process. Quite often, researchers will find few, if any, studies in the literature that explicitly identify and analyze the effects of potential variables on the process. This paper proposes a methodology to aid in performing a literature search to be used as a basis for new research into these types of variables. The methodology provides guidance on making use of a large range of studies from which to extract potential variables. Throughout the paper, the methodology is illustrated with a specific example. The example focuses on searching for variables that deal with individual variations among software inspectors that affect their performance during an inspection. At the end of the example, after following the steps of the methodology, a list of potential variables among software inspectors is identified. The paper concludes with the next steps to be taken concerning the identified variables and hypotheses.
Palavras-chave:
Software Process Variables, Literature Search, Empirical Software Engineering, Software Inspections
Referências
Adelson, B. and Soloway, E. "A Model of Software Design." In The Nature of Expertise, Chi, M.H, Glaser, R. and Farr, M. (eds.). Lawrence Erlbaum Associates, 1988.
Alexander, P.A. "Toward a Model of Academic Development: Schooling and the Acquisition of Knowledge." Educational Researcher 29(2): 28-33,44. March 2000.
Basili, V. R., Green, S. ,Laitenberger, O., Lanubile, F., Shull, F., Sorumgard, S., Zelkowitz, M.V., "The Empirical Investigation of Perspective-Based Reading"; Empirical Software Engineering - An International Journal, vol. 1, no. 2, 1996.
Berliner, D.C. and Rosenshine, B. "The Acquisition of Knowledge in the Classroom." In Schooling and the Acquisition of Knowledge. Anderson, R.C., Spiro, R.J. and Montague, W.E. (eds.), Lawrence Erlbaum Associates, New Jersey, 1977. pp. 375-396.
Boehm, B., Clark, B., Horowitz, E., Westland, C., Madachy, R., and Selby, R. "Cost Models for Future Software Life Cycle Processes: COCOMO 2.0." Annals of Software Engineering: Special Volume on Software Process and Product Measurements. Arthur, J.D. and Henry, S.M. (eds.). 1995, Vol. 1, pp. 57-94.
Boehm, B.W. and Basili, V.R. "Software Defect Reduction Top 10 List." IEEE Software 18(1): 135-137, Jan. 2001.
Carver, J. "The Impact of Background and Experience on Software Inspections." PhD Thesis, University of Maryland, April 2003. (University of Maryland, Department of Computer Science Technical Report CS-TR-4476)
Cheng, B. and Jeffery, R. "Comparing Inspection Strategies for Software Requirements Specifications." In Proceedings of the 1996 Australian Software Engineering Conference, p. 203-211.
Collins, A. "Processes in Acquiring Knowledge." In Schooling and the Acquisition of Knowledge." Anderson, R.C., Spiro, R.J., and Montague, W.E. (eds.). Lawrence Erlbaum Associates, New Jersey, 1977, pp. 339-363.
Collins, A., Brown, J.S., and Newman, S.E. "Cognitive Apprenticeship: Teaching the Crafts of Reading Writing and Mathematics." In Knowing, Learning, and Instruction: Essays in Honor of Robert Glaser, L.B. Resnik (ed.), Hillsdale, NJ: Erlbaum, 1989, p. 453-494.
Doolan, E.P. "Experiences with Fagan's Inspection Method." Software - Practice and Experience. Feb. 1992. 22(2): 173-182.
Dow, H.E. and Murphy, J.S. "Detailed Product Knowledge is not a Prerequisite for an Effective Formal Software Inspection." In Proceedings of the 7th Software Engineering Process Group Meeting, Boston, MA, May 1994.
Fagan, M. E., "Design and code inspections to reduce errors in program development." IBM Systems Journal, 15(3): 182-211, 1976.
Fagan, M.E. "Advances in Software Inspections." IEEE Transactions on Software Engineering, 12(7): 744-751, 1986.
Fusario, P., Lanubile, F., and Visaggio, G. "A Replicated Experiment to Asses Requirements Inspection Techniques." Empirical Software Engineering: An International Journal 2(1), 1997. p. 39-57.
Gilb, T., Graham, D. Software Inspection. Addison-Wesley, 1993
Glaser, B. G., and Strauss, A.L. The Discovery of Grounded Theroy: Strategies for qualitative research. New York : Aldine de Gruyter. 1967.
Knight, J.C., and Myers, E.A. "An Improved Inspection Technique." Communications of the ACM, 36(11): 51-61, Nov. 1993.
Laitenberger, O., Atkinson, C., Schlich, M. and El Emam, K. "An Experimental Comparison for Reading Techniques for Defect Detection in UML Design Documents." Journal of Systems and Software, 53(2), August 2000, 183-204.
Martin, J., and Tsai, W.T. "N-Fold Inspection: A Requirements Analysis Technique." Communications of the ACM, 33(2): 225-232, Feb. 1990.
Melo, W.; Shull, F. and Travassos, G.H., 2001. Software Review Guidelines. Technical Report ES-556/01. Systems Engineering and Computer Science Program. COPPE. Federal University of Rio de Janeiro. September.
Parnas, D.L. and Weiss, D.M. "Active Design Reviews: Principles and Practice." Proceedings of the 8th International Conference on Software Engineering, 1985, 132- 136.
Porter, A.A. and Johnson, P.M. "Assessing Software Review Meetings: Results of a Comparative Analysis of Two Experimental Studies." IEEE Transactions on Software Engineering, 23(3): 129-145.
Schneider, G.M., Martin, J., and Tsai, W.T. "An Experimental Study of Fault Detection in User Requirements Documents." ACM Transactions on Software Engineering and Methodology 1(2): 188-204.
Siy, H.P. "Identifying the Mechanisms Driving Code Inspection Cost and Benefits." Ph.D. Dissertation, University of Maryland, 1996.
Soloway, E., Adelson, B., and Ehrlich, K. "Knowledge and Processes in the Comprehension of Computer Programs." In The Nature of Expertise, Chi, M.H, Glaser, R. and Farr, M. (eds.). Lawrence Erlbaum Associates, 1988.
Travassos, G.H., Shull, F., Fredericks, M., and Basili, V.R. "Detecting Defects in Object Oriented Designs: Using Reading Techniques to Improve Software Quality." Proceedings of OOPSLA '99, Denver, CO. November, 1999.
Votta, L.G., Jr. "Does Every Inspection Need a Meeting?" Proceedings of ACM SIGSOFT '93 Symposium Foundations of Software Engineering. ACM, Dec. 1993.
Walston, C.E., and Felix, C.P. "A method of programming measurement and estimation." IBM Systems Journal 16, No. 1, 54-73. 1977.
Alexander, P.A. "Toward a Model of Academic Development: Schooling and the Acquisition of Knowledge." Educational Researcher 29(2): 28-33,44. March 2000.
Basili, V. R., Green, S. ,Laitenberger, O., Lanubile, F., Shull, F., Sorumgard, S., Zelkowitz, M.V., "The Empirical Investigation of Perspective-Based Reading"; Empirical Software Engineering - An International Journal, vol. 1, no. 2, 1996.
Berliner, D.C. and Rosenshine, B. "The Acquisition of Knowledge in the Classroom." In Schooling and the Acquisition of Knowledge. Anderson, R.C., Spiro, R.J. and Montague, W.E. (eds.), Lawrence Erlbaum Associates, New Jersey, 1977. pp. 375-396.
Boehm, B., Clark, B., Horowitz, E., Westland, C., Madachy, R., and Selby, R. "Cost Models for Future Software Life Cycle Processes: COCOMO 2.0." Annals of Software Engineering: Special Volume on Software Process and Product Measurements. Arthur, J.D. and Henry, S.M. (eds.). 1995, Vol. 1, pp. 57-94.
Boehm, B.W. and Basili, V.R. "Software Defect Reduction Top 10 List." IEEE Software 18(1): 135-137, Jan. 2001.
Carver, J. "The Impact of Background and Experience on Software Inspections." PhD Thesis, University of Maryland, April 2003. (University of Maryland, Department of Computer Science Technical Report CS-TR-4476)
Cheng, B. and Jeffery, R. "Comparing Inspection Strategies for Software Requirements Specifications." In Proceedings of the 1996 Australian Software Engineering Conference, p. 203-211.
Collins, A. "Processes in Acquiring Knowledge." In Schooling and the Acquisition of Knowledge." Anderson, R.C., Spiro, R.J., and Montague, W.E. (eds.). Lawrence Erlbaum Associates, New Jersey, 1977, pp. 339-363.
Collins, A., Brown, J.S., and Newman, S.E. "Cognitive Apprenticeship: Teaching the Crafts of Reading Writing and Mathematics." In Knowing, Learning, and Instruction: Essays in Honor of Robert Glaser, L.B. Resnik (ed.), Hillsdale, NJ: Erlbaum, 1989, p. 453-494.
Doolan, E.P. "Experiences with Fagan's Inspection Method." Software - Practice and Experience. Feb. 1992. 22(2): 173-182.
Dow, H.E. and Murphy, J.S. "Detailed Product Knowledge is not a Prerequisite for an Effective Formal Software Inspection." In Proceedings of the 7th Software Engineering Process Group Meeting, Boston, MA, May 1994.
Fagan, M. E., "Design and code inspections to reduce errors in program development." IBM Systems Journal, 15(3): 182-211, 1976.
Fagan, M.E. "Advances in Software Inspections." IEEE Transactions on Software Engineering, 12(7): 744-751, 1986.
Fusario, P., Lanubile, F., and Visaggio, G. "A Replicated Experiment to Asses Requirements Inspection Techniques." Empirical Software Engineering: An International Journal 2(1), 1997. p. 39-57.
Gilb, T., Graham, D. Software Inspection. Addison-Wesley, 1993
Glaser, B. G., and Strauss, A.L. The Discovery of Grounded Theroy: Strategies for qualitative research. New York : Aldine de Gruyter. 1967.
Knight, J.C., and Myers, E.A. "An Improved Inspection Technique." Communications of the ACM, 36(11): 51-61, Nov. 1993.
Laitenberger, O., Atkinson, C., Schlich, M. and El Emam, K. "An Experimental Comparison for Reading Techniques for Defect Detection in UML Design Documents." Journal of Systems and Software, 53(2), August 2000, 183-204.
Martin, J., and Tsai, W.T. "N-Fold Inspection: A Requirements Analysis Technique." Communications of the ACM, 33(2): 225-232, Feb. 1990.
Melo, W.; Shull, F. and Travassos, G.H., 2001. Software Review Guidelines. Technical Report ES-556/01. Systems Engineering and Computer Science Program. COPPE. Federal University of Rio de Janeiro. September.
Parnas, D.L. and Weiss, D.M. "Active Design Reviews: Principles and Practice." Proceedings of the 8th International Conference on Software Engineering, 1985, 132- 136.
Porter, A.A. and Johnson, P.M. "Assessing Software Review Meetings: Results of a Comparative Analysis of Two Experimental Studies." IEEE Transactions on Software Engineering, 23(3): 129-145.
Schneider, G.M., Martin, J., and Tsai, W.T. "An Experimental Study of Fault Detection in User Requirements Documents." ACM Transactions on Software Engineering and Methodology 1(2): 188-204.
Siy, H.P. "Identifying the Mechanisms Driving Code Inspection Cost and Benefits." Ph.D. Dissertation, University of Maryland, 1996.
Soloway, E., Adelson, B., and Ehrlich, K. "Knowledge and Processes in the Comprehension of Computer Programs." In The Nature of Expertise, Chi, M.H, Glaser, R. and Farr, M. (eds.). Lawrence Erlbaum Associates, 1988.
Travassos, G.H., Shull, F., Fredericks, M., and Basili, V.R. "Detecting Defects in Object Oriented Designs: Using Reading Techniques to Improve Software Quality." Proceedings of OOPSLA '99, Denver, CO. November, 1999.
Votta, L.G., Jr. "Does Every Inspection Need a Meeting?" Proceedings of ACM SIGSOFT '93 Symposium Foundations of Software Engineering. ACM, Dec. 1993.
Walston, C.E., and Felix, C.P. "A method of programming measurement and estimation." IBM Systems Journal 16, No. 1, 54-73. 1977.
Publicado
08/10/2003
Como Citar
CARVER, Jeff; BASILI, Victor.
Identifying Implicit Process Variables To Support Future Empirical Work. In: SIMPÓSIO BRASILEIRO DE ENGENHARIA DE SOFTWARE (SBES), 17. , 2003, Manaus/AM.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2003
.
p. 1-14.
DOI: https://doi.org/10.5753/sbes.2003.23849.
