Maturity Models Architecture: A large systematic mapping
Keywords:Maturity Model, Capability maturity model, Stage of growth, Maturity grid, Systematic mapping
Maturity models are widespread in research and in particular, IT practitioner communities. However, theoretically sound, methodologically rigorous and empirically validated maturity models are quite rare. This systematic mapping paper focuses on the challenges faced during the development of maturity models. More specifically, it explores the literature on maturity models and standard guidelines to develop maturity models, the challenges identified and solutions proposed. Our systematic mapping revealed over six hundred articles on maturity models. Extant literature reveals that researchers have primarily focused on developing new maturity models pertaining to domain-specific problems and/or new enterprise technologies. We find rampant re-use of the design structure of widely adopted models such as Nolan’s Stage of Growth Model, Crosby’s Grid, and Capability Maturity Model (CMM). We also identify three dominant views of maturity models and provide guidelines for various approaches to constructing maturity models with a standard vocabulary. We finally propose using process theories and configurational approaches to address the main theoretical criticisms with regard to maturity models and conclude with some recommendations for maturity model developers.
o Associação Brasileira de Normas Técnicas – ABNT. (2010). NBR ISO 9004: Gestão para o sucesso sustentado de uma organização: uma abordagem da gestão da qualidade. Rio de Janeiro: ABNT.
o Anza, F. A.; Sensuse, D. I. and Ramadhan, A. Developing E-government maturity framework based on COBIT 5 and implementing in city level: Case study Depok city and South Tangerang city. Proc. Computer Science and Informatics (EECSI) 2017 4th Int. Conf. Electrical Engineering, 2017, 1-6
o Back, A. and C. Haager (2011). "Assessing Degrees of Web-2.0-ness for Websites: Model and Results for Product Websites in the Pharmaceutical Industry." BLED 2011. Paper 48.
o Becker, J., B. Niehaves, J. Poeppelbuss and A. Simons (2010). "Maturity Models in IS Research." ECIS 2010, Paper 42.
o Becker, J., R. Knackstedt and J. Pöppelbuß (2009). "Developing Maturity Models for IT Management." Business & Information Systems Engineering 1(3): 213-222.
o Bemowski, K. (1996). Baldrige award celebrates its 10th birthday with a new look. Quality Progress, 29(12), 49.
o Bessant, J., Caffyn, S., & Gallagher, M. (2001). An evolutionary model of continuous improvement behavior. Technovation, 21(2), 67-77.
o Carvalho, J. V.; Rocha, Á.; Abreu, A. and Afonso, A. Development methodology of the HISMM Maturity Model. Proc. 12th Iberian Conf. Information Systems and Technologies (CISTI), 2017, 1-7
o Carvalho, J. V., Pereira, R. H., & Rocha, A. (2018, June). Maturity models of education information systems and technologies: a systematic literature review. In 2018 13th Iberian Conference on Information Systems and Technologies (CISTI) (pp. 1-7). IEEE.
o Carvalho, J. V., Rocha, A., Vasconcelos, J., Abreu, A. A health data analytics maturity model for hospitals information systems. International Journal of Information Management, 2018.
o Cleven, A., R. Winter, F. Wortmann and T. Mettler (2014). "Process management in hospitals: an empirically grounded maturity model." Business Research 7(2): 191-216.
o CMMI , P. T. (2010). "CMMI for Development, Version 1.3 (CMU/SEI-2010-TR-033) ". Software Engineering Institute, Carnegie Mellon University, 2010. http://resources.sei.cmu.edu/library/asset-view.cfm?AssetID=9661 (Access in 15 de May, 2017).
o Cosic, R., G. Shanks, S. Maynard and J. Lamp (2012). "Towards a business analytics capability maturity model." Australasian Conference on Information Systems 2012, pp. 1-11.
o Correia, E., Carvalho, H., Azevedo, S., & Govindan, K. (2017). Maturity models in supply chain sustainability: A systematic literature review. Sustainability, 9(1), 64.
o Crosby, P. B. (1980). Quality Is Free: The Art of Making Quality Certain, New York, NY: Mentor.
o Chrissis, M. B.; Konrad, M.; Shrum, S. CMMI®: guidelines for process integration and product improvement. Addison Wesley, 2003.
o Damsgaard, J. and R. Scheepers (1999). "Managing the crises in intranet implementation: a stage model." Information Systems Journal 10(2): 131-149.
o Davenport, T., H and J. Harris, G. (2007). "Competing on Analytics: The New Science of Winning", Massachusetts: Harvard Business School Press.
o De Bruin, T., M. Rosemann, D. Bartmann, F. Rajola, J. Kallinikos, D. Avison, R. Winter, P. Ein-Dor, J. Becker, F. Bodendorf and C. Weinhardt (2005). "Towards a Business Process Management Maturity Model." Australasian Conference on Information Systems 2005.
o De Bruin, T., R. Freeze, U. Kaulkarni, M. Rosemann, B. Campbell, J. Underwood and D. Bunker (2005). "Understanding the Main Phases of Developing a Maturity Assessment Model." Australasian Conference on Information Systems 2005.
o Delloitte-eCommerce-Assessment (2012). "European eCommerce Assessment 2012 Benchmarking the top 200 in online retail." https://www2.deloitte.com/content/dam/Deloitte/nl/Documents/consumer-business/deloitte-nl-european-ecommerce-assessment-2012.pdf. (Access in 15 de May, 2017).
o DELTA-Model-Accenture (2013) "The Accenture Netherlands Analytics DELTA Survey 2013" http://www.it-executive.nl/images/uploads/downloads/accenture-analytics-delta-survey-2013%281%29.pdf (Access in 15 de May, 2017)
o Dinter, B. (2012). The Maturing of a Business Intelligence Maturity Model. AMCIS 2012. Paper 37.
o Drury, D. H. (1983). "An Empirical Assessment of the Stages of DP Growth." MIS Quarterly 7(2): 5.
o Duane, A. M. and P. OReilly (2012). A Conceptual Stages of Growth Model for Managing an Organization's Social Media Business Profile (SMBP). ICIS 2012
o El Sawy, O. A., ArvindPark, YoungKiPavlou, Paul A (2010). "Research Commentary Seeking the Configurations of Digital Ecodynamics: It Takes Three to Tango." Information Systems Research 21(4): 835- 848.
o European Foundation for Quality Management – EFQM. (2011). Modelo EFQM de excelência. Brussels: European Foundation for Quality Management.
o Fiss, P. C. (2011). "Building better causal theories: A fuzzy set approach to typologies in organization research." Academy of Management Journal 54(2): 393-420.
o Garrett, G. A., & Rendon, R. G. (2005). Managing contracts in turbulent times: the contract management maturity model. Contract Management, Sept. 2005, 48-57.
o Gorschek,T., Nguyen, T., Nguyen, M., Svahnberg, M. Uni-REPM: a framework for requirements engineering process assessment. Published in: Journal Requirements Engineering. Volume 20 Issue 1, March 2015, Pages 91-118.
o Hackos, J. T. Information Process Maturity Model. Proc. IEEE Int. Professional Communication Conf. (ProComm), 2017, 1-8
o Henriques, Vaughan, and Maureen Tanner. "A systematic literature review of agile and maturity model research." Interdisciplinary Journal of Information, Knowledge, and Management 12 (2017): 053-073.
o Japanese Industrial Standards – JIS. (2005). Quality Management System: guidelines for sustainable growth. Tokyo: JIS.
o Karkkainen, H., J. Jussila and J. Lyytikkä (2011). "Towards Maturity Modeling Approach for Social Media Adoption in Innovation." 4th ISPIM Innovation Symposium.
o King, J. L. and K. L. Kraemer (1984). "Evolution and organizational information systems: an assessment of Nolan's stage model." Commun. ACM 27(5): 466-475.
o Kitchenham, B. Procedures for performing systematic reviews. 2004. ISSN 1353-7776. TR/SE-0401.
o Kitchenham, B., Mendes, E., Travassos, G.H. (2007) A Systematic Review of Cross- vs. Within-Company Cost Estimation Studies, IEEE Trans on SE, 33 (5),pp 316-329.
o Lahrmann, G., F. Marx, T. Mettler, R. Winter and F. Wortmann (2011). Inductive Design of Maturity Models: Applying the Rasch Algorithm for Design Science Research. Service-Oriented Perspectives in Design Science Research, Springer Berlin Heidelberg. 6629: 176-191.
o Lehmkuhl, T., U. Baumol and R. Jung (2013). Towards a Maturity Model for the Adoption of Social Media as a Means of Organizational Innovation. HICSS, 2013.
o Lockamy, A., & McCormack, K. (2004). The development of a supply chain management process maturity model using the concepts of business process orientation. Supply Chain Management International Journal (Toronto, Ont.), 9(4), 272-278.
o Luftman, J. (2000). "Assessing Business-IT Alignment Maturity." Communications of the Association for Information Systems 4(1): 14.
o McCormack, K., Willems, J., Van Den Bergh, J., Deschoolmeester, D., Willaert, P., Indihar Štemberger, M., & Bosilj Vuksic, V. (2009). A global investigation of key turning points in business process maturity. Business Process Management Journal, 15(5), 792-815.
o Mettler, T., P. Rohner and R. Winter (2010). "Towards a Classification of Maturity Models in Information Systems." Management of the Interconnected World 2010, pp 333-340.
o Mullaly, M. P. W. (2014). "If maturity is the answer, then exactly what was the question?" International Journal of Managing Projects in Business 7(2): 169-185.
o Nolan, R. L. and C. F. Gibson. (1974). "Managing the Four Stages of EDP Growth." Harvard Business Review January–February 1974.
o Paulk, M., B. Curtis, M. Chrissis and C. Weber (2006). "Capability maturity model, version 1.2." Software, IEEE 10.4 (2006): 18-27.
o Plattfaut, R., B. Niehaves, J. Pöppelbuß and J. Becker (2011). "Development of BPM capabilities – Is maturity the right path? ", ECIS 2011. Paper 27.
o Pöppelbuß, J., B. Niehaves, A. Simons and J. Becker (2011). "Maturity Models in Information Systems Research: Literature Search and Analysis." Communications of the Association for Information Systems 29: 505-532.
o Raber, D., F. Wortmann and R. Winter (2013). "Situational Business Intelligence Maturity Models: An Exploratory Analysis". HICSS, 2013.
o Raber, D., R. Winter and F. Wortmann (2012). "Using Quantitative Analyses to Construct a Capability Maturity Model for Business Intelligence." HICSS, 2012.
o Renken, J. (2004). "Developing an IS/ICT management capability maturity framework". Proceedings of the 2004 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries, South African Institute for Computer Scientists and Information Technologists.
o Röglinger, M., J. Pöppelbuß and J. Becker (2012). "Maturity models in business process management". Business Process Management Journal. 18: 328-346.
o Royce, Walker. CMM vs. CMMI: from conventional to modern software management. 2002. Disponível em http://www.student.nada.kth.se/~karlm/CMMI.pdf. Access in 24 Jul. 2017.
o Rodríguez, N. H. & Carreira, M. R. Towards a usability maturity model in mobile application development. Proc. 12th Iberian Conf. Information Systems and Technologies (CISTI), 2017, 1-6.
o Solli-Sæther, H. and P. Gottschalk (2010). "The modeling process for stage models." Journal of Organizational Computing and Electronic Commerce, 20: 279–293, 2010.
o Software, L. L. de Pesquisa em Engenharia de. State of Art in Systematic Review - StArt. 2013. Available at http://lapes.dc.ufscar.br/tools/starttool(2013)
o Spruit, M. and M. Röling (2014). "ISFAM: The Information Security Focus Area Maturity Model". ECIS 2014.
o Singh, P. J., & Smith, A. (2006). An empirically validated quality management measurement instrument. Benchmarking International Journal (Toronto, Ont.), 13(4), 493-522.
o Van De, A. H. and M. S. Poole (1995). "Explaining Development and Change in Organizations." Academy of Management vol. 20 no. 3 510-540.
o van Steenbergen, M., R. Bos, S. Brinkkemper, I. van de Weerd and W. and Bekkers (2013). "Improving IS Functions Step by Step: the Use of Focus Area Maturity Models." Scandinavian Journal of Information Systems 25(2): 2.
o Steenbergen, M. v., R. Bos, S. Brinkkemper, I. v. d. Weerd and W. Bekkers (2011). "The Design of Focus Area Maturity Models." Global perspectives on design science research. Springer Berlin Heidelberg: 317-332.
o Webster, J. and R. T. Watson (2002). "Analyzing the past to prepare for the future: Writing a literature review." MIS Quarterly 26(2): 3.
o Weiss, D., J. Repschlaeger, R. Zarnekow and H. and Schroedl (2013). "Towards a Consumer Cloud Computing Maturity Model - Proposition of Development Guidelines, Maturity Domains and Maturity Levels." PACIS 2013. Paper 211.
o Wendler, R. (2012). "The maturity of maturity model research: A systematic mapping study." Information and Software Technology 54(12): 1317-1339.
o Winkler, T. J., Jochen, Brenner, Walter (2015). "Selfsurvey: A Prediction-Based Decision Support Platform For Survey Research." Twenty-Third European Conference on Information Systems (ECIS), Münster, Germany, 2015.