Surveying the Academic Literature on the Use of OKR (Objective and Key Results)
Resumo
Context: OKR (Objective and Key Results) has emerged as a lightweight framework for business objectives measurement and strategic alignment. Problem: Although we may observe a growing interest in OKR in the industry, the academic literature on OKR still needs to be explored. Solution: We aim to identify how and why OKR has been used by researchers and information technology (IT) organizations while capturing associated difficulties, benefits, and lessons learned. IS Theory: This work is conducted under the General Systems Theory, focusing on understanding how IT organizations and individuals (i.e., researchers) deal with using or adopting a measurement method. Method: We executed a systematic mapping study surveying Engineering Village, Scopus, IEEE Xplore, Web of Knowledge, SpringerLink, ScienceDirect, and Wiley digital databases and complemented the results with snowballing. Summary of Results: We found 30 studies mentioning OKR and its use. Most studies (23 out of 30) were published after 2020. In general, OKR use is under-documented from a theoretical point of view. Most selected studies present little or no information on why or how OKR was used. Among the topics associated with using OKR are communication, performance evaluation, tasks planning and prioritization, transparency, team alignment, and goal fulfillment. Contributions and Impact in the IS area: This study revealed few academic studies addressing the topic. Some research questions, such as lessons learned and difficulties in implementation, still need more answers. Also missing are details on how OKR is implemented. Nonetheless, we captured information regarding the main benefits and advantages of using OKR. We expect this work will provide relevant content for other researchers.
Palavras-chave:
OKR, Objective and Key Results, Software and IT Measurement
Referências
Kevin Chandra Abimaulana, Eko K.Budiardjo, Kodrat Mahatma, and Anita Hidayati. 2021. Evaluation of Scrum-Based Software Development Process Maturity using the SMM and AMM: A Case of Education Technology Startup. In 2021 International Conference on Advanced Computer Science and Information Systems (ICACSIS). IEEE, Depok, Indonesia, 1–5. https://doi.org/10.1109/ICACSIS53237.2021.9631308
Kostina Tatyana Anatolyevna, Akimkina Daria Alexandrovna, and Sokolov Nikolay Alexandrovich. 2020. Company Human Capital Development Based on OKR Methodology. Process Management and Scientific Developments 17 (2020), 5.
Victor Basili, Adam Trendowicz, Martin Kowalczyk, Jens Heidrich, Carolyn Seaman, Jürgen Münch, and Dieter Rombach. 2014. GQM+Strategies in a Nutshell. Springer International Publishing, Cham, 9–17. https://doi.org/10.1007/978-3-319-05047-8_2
Rui Belfort, Farley Fernandes, and Fabio Campos. 2021. Combining Objective Key Results, Net Promoter Score and Social Return of Investment to Measure Project Impact, In Intelligent Human Systems Integration 2021. Advances in Intelligent Systems and Computing 1322, 428–433. http://dx.doi.org/10.1007/978-3-030-68017-6_64
Marthe Berntzen, Rashina Hoda, Nils B. Moe, and Viktoria Stray. 2022. A Taxonomy of Inter-Team Coordination Mechanisms in Large-Scale Agile. IEEE Transactions on Software Engineering (2022), 1–1. https://doi.org/10.1109/TSE.2022.3160873
Marthe Berntzen, Viktoria Stray, and Nils Brede Moe. 2021. Coordination Strategies: Managing Inter-team Coordination Challenges in Large-Scale Agile. In Agile Processes in Software Engineering and Extreme Programming. Springer International Publishing, Cham, 140–156.
Ângela F Brodbeck and Norberto Hoppen. 2003. Alinhamento estratégico entre os planos de negócio e de tecnologia de informação: um modelo operacional para implementação. Revista de Administração Contemporânea 7 (2003), 9–33. https://doi.org/10.1590/S1415-65552003000300002
Victor R Basili-Gianluigi Caldiera and H Dieter Rombach. 1994. Goal question metric approach. Encyclopedia of software engineering 1, 528-532 (1994), 6.
Ruixia Cao. 2021. Research on teaching evaluation system of higher vocational colleges based on OKR and big data, In 2021 16th International Conference on Computer Science & Education (ICCSE). ICCSE 2021 - IEEE 16th International Conference on Computer Science and Education, 676 – 680. http://dx.doi.org/10.1109/ICCSE51940.2021.9569413
Gostian Claudiu-Dan. 2015. Internet Involvment and Metrics in Adult Education Services Online Marketing in Romania. An Evaluation Study. Procedia Computer Science 65 (2015), 950–960.
Jacob Cohen. 1960. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement 20, 1 (1960), 37–46. https://doi.org/10.1177/001316446002000104
Quang-Vinh Dang, Minh-Tuan Truong, and Minh-Hoang Huynh. 2021. Studying the Fuzzy Clustering Methods to Understand Employee Performance. In 2021 4th International Conference on Artificial Intelligence and Big Data (ICAIBD). IEEE, Chengdu, China, 541–544. https://doi.org/10.1109/ICAIBD51990.2021.9459054
Damiano Distante, Stefano Faralli, Steve Rittinghaus, Paolo Rosso, and Nima Samsami. 2022. Domainsenticnet: An ontology and a methodology enabling domain-aware sentic computing. Cognitive computation 14, 1 (2022), 62–77.
John Doerr. 2019. Measure What Matters: How Google, Bono, and the Gates Foundation Rock the World with OKRs (1st. ed.). Portfolio/Penguin, New York. 159 pages.
Tim Van Erp, Niels Gorm Maly Rytter, Felix Sieckmann, Mads Bruun Larsen, Henrik Blichfeldt, and Holger Kohl. 2021. Management, Design, and Implementation of Innovation Projects: Towards a Framework for Improving the Level of Automation and Digitalization in Manufacturing Systems. In 2021 9th International Conference on Control, Mechatronics and Automation (ICCMA). Luxembourg, 211–217. https://doi.org/10.1109/ICCMA54375.2021.9646214
Luis Gustavo Araujo Ferreira, Priscila Bibiana Viegas, and Dagoberto Trento. 2018. An Agile Approach Applied in Enterprise Project Management Office. In Agile Methods, Viviane Almeida dos Santos, Gustavo Henrique Lima Pinto, and Adolfo Gustavo Serra Seca Neto (Eds.). Springer International Publishing, Cham, 95–102.
Steven L. Goldman. 2012. Smart Communities and Networked Organizations. In Virtual and Networked Organizations, Emergent Technologies and Tools, Goran D. Putnik and Maria Manuela Cruz-Cunha (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 304–315.
Fabian Hoeft. 2021. The case of sales in the automotive industry during the COVID-19 pandemic. Strategic Change 30, 2 (2021), 117–125. https://doi.org/10.1002/jsc.2395 arXiv: [link]
Erki Kilu, Fredrik Milani, Ezequiel Scott, and Dietmar Pfahl. 2019. Agile Software Process Improvement by Learning from Financial and Fintech Companies: LHV Bank Case Study. In Software Quality: The Complexity and Challenges of Software Engineering and Software Quality in the Cloud. Springer International Publishing, Cham, 57–69.
Barbara Kitchenham, Stuart Charters, et al. 2007. Guidelines for performing systematic literature reviews in software engineering. Keele University, Keele, UK. (2007), 65.
Natthakan Klanwaree and Songphan Choemprayong. 2019. Objectives & key results for active knowledge sharing in IT consulting enterprises: A feasibility study. Proceedings of the Association for Information Science and Technology 56, 1 (2019), 441–444. https://doi.org/10.1002/pra2.44
Maxim V Koldyshev, Khrystyna S Stoliaruk, Oleksandr O Shpynkovskyi, Olena H Mital, Halyna Y Yamnenko, and Igor M Dovban. 2021. HR Management Efficiency Factors and Their Impact on Creation of a Commercial Innovative Product.Journal of Management Information & Decision Sciences 24, 6 (2021).
Mruthyanjaya Rao Mangipudi, K Prasad, and RW Vaidya. 2021. Objectives and Key Results for Higher Educational Institutions–A Blended Approachas Part of Post Covid-19 Initiatives for Keeping the Institutions Abreast of the Industry Innovations, Create Future Leaders and Build the Nation. Pacific Business Review International (2021), 46–56.
Geoffrey Mann, Sharyn Jevon, and Brendan Bachmann. 2020. How are firms measuring digital transformation at a corporate-level in organisations?. In Australasian Conference on Information Systems: Navigating Our Digital Future, He waka eke noa-We are all in this together. AIS Electronic Library, Melbourne Australia, 88.
John McGarry, Davidck Card, Cheryl Jones, Beth Layman, Elizabeth Clark, Joseph Dean, and Fred Hall. 2002. Practical Software Measurement Objective Information for Decision Makers (1st. ed.). Addison-Wesley, Boston. 277 pages.
Marius Mikalsen, Viktoria Stray, Nils Brede Moe, and Idun Backer. 2020. Shifting Conceptualization of Control in Agile Transformations. In Agile Processes in Software Engineering and Extreme Programming – Workshops, Maria Paasivaara and Philippe Kruchten (Eds.). Springer International Publishing, Cham, 173–181.
Erica Mourão, João Felipe Pimentel, Leonardo Murta, Marcos Kalinowski, Emilia Mendes, and Claes Wohlin. 2020. On the performance of hybrid search strategies for systematic literature reviews in software engineering. Information and Software Technology 123 (jul 2020), 106294. https://doi.org/10.1016/j.infsof.2020.106294
Antonio Muniz, Carla Krieger, Victor Patané, Walther Krause, and Werther Krause. 2022. Jornada OKR na Prática: Unindo Práticas e Experiências que Potencializam Resultados - [OKR Journey in Practice: Uniting Practices and Experiences that Potentialize Results] (1st. ed.). Brasport, Brazil. 216 pages.
Paul R Niven and Ben Lamorte. 2016. Objectives and key results: Driving focus, alignment, and engagement with OKRs (1st. ed.). John Wiley & Sons. 211 pages.
Kai Petersen and Cigdem Gencel. 2013. Worldviews, research methods, and their relationship to validity in empirical software engineering research. In 2013 joint conference of the 23rd international workshop on software measurement and the 8th international conference on software process and product measurement. IEEE, IEEE, Ankara, Turkey, 81–89.
Kai Petersen, Sairam Vakkalanka, and Ludwik Kuzniarz. 2015. Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology 64 (aug 2015), 1–18. https://doi.org/10.1016/j.infsof.2015.03.007
Jihan Rafidah and Emilia Dewi. 2020. Improving Performance Management System of Human Resource Aspect in Health Drink Industry Startup. Malaysian Journal of Social Sciences and Humanities (MJSSH) 5, 8 (Aug. 2020), 85 – 95. https://doi.org/10.47405/mjssh.v5i8.461
Amalia Rahmah, Pristi Sukmasetya, Muh Syaiful Romadhon, and Ahmad Rio Adriansyah. 2020. Developing Distance Learning Monitoring Dashboard with Google Sheet: An Approach for Flexible and Low-Price Solution in Pandemic Era. In 7th International Conference on ICT for Smart Society: AIoT for Smart Society, ICISS 2020 - Proceeding. IEEE, Virtual, Bandung, Indonesia. http://dx.doi.org/10.1109/ICISS50791.2020.9307558
H Roberts and M Petticrew. 2006. Systematic reviews in the social sciences. Blackwell Pub. 352 pages.
IYari Rojas-Chipana, Nicolas Aguilar-Pelizzoli, Juan Carlos Quiroz-Flores, Martín Collao-Diaz, and Alberto Flores-Perez. 2021. Increasing Profitability Through the Implementation of an Integrated Balance Score Card & Objectives Key Results Model in a Digital Agency: A Research in Perú. IEEE Transactions on Software Engineering (2021).
Ezequiel Scott, Fredrik Milani, Erki Kilu, and Dietmar Pfahl. 2021. Enhancing agile software development in the banking sector—A comprehensive case study at LHV. Journal of Software: Evolution and Process 33, 7 (2021), e2363. https://doi.org/10.1002/smr.2363 arXiv: [link]
ISO Central Secretary. 2017. ISO/IEC/IEEE International Standard - Systems and software engineering–Measurement process. ISO/IEC/IEEE 15939:2017(E) (2017), 1–49. https://doi.org/10.1109/IEEESTD.2017.7907158
A.J. Gilbert Silvius. 2007. Business & IT Alignment in Theory and Practice. In 2007 40th Annual Hawaii International Conference on System Sciences (HICSS’07). IEEE, Hawaii, 211b–211b. https://doi.org/10.1109/HICSS.2007.119
Chutiwan Sowkasem and Phumin Kirawanich. 2021. A Deliverable Delay Management of Software Development in Railway Project Using an OKR-Based Scrum Process. In 2021 The 4th International Conference on Software Engineering and Information Management (Yokohama, Japan) (ICSIM 2021). Association for Computing Machinery, New York, NY, USA, 10–16. https://doi.org/10.1145/3451471.3451473
Viktoria Stray, Jan Henrik Gundelsby, Rasmus Ulfsnes, and Nils Moe. 2022. How agile teams make Objectives and Key Results (OKRs) work. In ICSSP’22: Proceedings of the International Conference on Software and System Processes and International Conference on Global Software Engineering. Association for Computing Machinery, New York, NY, USA, 6. https://doi.org/10.1145/3529320.3529332
Viktoria Stray, Nils Brede Moe, Henrik Vedal, and Marthe Berntzen. 2021. Using objectives and key results (OKRs) and slack: a case study of coordination in large-scale distributed agile. Proceedings of the 55th Hawaii International Conference on System Sciences, 2022 1 (2021), 10.
Bianca Trinkenreich and Gleison Santos. 2015. Avaliação do Processo de Medição para Serviços de TI em uma Empresa Global à Luz do MR-MPS-SV - [Evaluation of the measurement process for IT services in a global enterprise based on the MR-MPS-SV]. iSys-Brazilian Journal of Information Systems 8, 2 (2015), 58–77.
Bianca Trinkenreich, Gleison Santos, Monalessa Perini Barcellos, and Tayana Conte. 2019. Combining GQM+Strategies and OKR - Preliminary Results from a Participative Case Study in Industry. In Product-Focused Software Process Improvement. Springer International Publishing, Cham, 103–111.
Thomas Andres Troian, Rodrigo Soares Lelis Gori, Jacson Rafael Weber, Daniel Pacheco Lacerda, and Leandro Gauss. 2022. OKRs as a results-focused management model: a systematic literature review. 28th IJCIEOM – International Joint Conference on Industrial Engineering and Operations Management (2022).
Henrik Vedal, Viktoria Stray, Marthe Berntzen, and Nils Brede Moe. 2021. Managing Dependencies in Large-Scale Agile. Lecture Notes in Business Information Processing 426, 52 – 61. http://dx.doi.org/10.1007/978-3-030-88583-0_6
Cristina Wodtke. 2016. Introduction to OKRs (1st. ed.). O'Reilly Media, Sebastopol, CA, USA.
Claes Wohlin. 2014. Guidelines for Snowballing in Systematic Literature Studies and a Replication in Software Engineering. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering (London, England, United Kingdom) (EASE ’14). Association for Computing Machinery, New York, NY, USA, Article 38, 10 pages. https://doi.org/10.1145/2601248.2601268
Kristin Wulff and Hanne Finnestrand. 2022. It is like taking a ball for a walk: on boundary work in software development. AI & SOCIETY 37, 2 (2022), 711–724.
Hao Zhou and Yu-Ling He. 2018. Comparative Study of OKR and KPI. In 2018 International Conference on e-commerce and contemporary economic development (ECED 2018)(Destech Transactions on Economics Business and Management). Destech Publications, Hangzhou, China, 319–323.
Kostina Tatyana Anatolyevna, Akimkina Daria Alexandrovna, and Sokolov Nikolay Alexandrovich. 2020. Company Human Capital Development Based on OKR Methodology. Process Management and Scientific Developments 17 (2020), 5.
Victor Basili, Adam Trendowicz, Martin Kowalczyk, Jens Heidrich, Carolyn Seaman, Jürgen Münch, and Dieter Rombach. 2014. GQM+Strategies in a Nutshell. Springer International Publishing, Cham, 9–17. https://doi.org/10.1007/978-3-319-05047-8_2
Rui Belfort, Farley Fernandes, and Fabio Campos. 2021. Combining Objective Key Results, Net Promoter Score and Social Return of Investment to Measure Project Impact, In Intelligent Human Systems Integration 2021. Advances in Intelligent Systems and Computing 1322, 428–433. http://dx.doi.org/10.1007/978-3-030-68017-6_64
Marthe Berntzen, Rashina Hoda, Nils B. Moe, and Viktoria Stray. 2022. A Taxonomy of Inter-Team Coordination Mechanisms in Large-Scale Agile. IEEE Transactions on Software Engineering (2022), 1–1. https://doi.org/10.1109/TSE.2022.3160873
Marthe Berntzen, Viktoria Stray, and Nils Brede Moe. 2021. Coordination Strategies: Managing Inter-team Coordination Challenges in Large-Scale Agile. In Agile Processes in Software Engineering and Extreme Programming. Springer International Publishing, Cham, 140–156.
Ângela F Brodbeck and Norberto Hoppen. 2003. Alinhamento estratégico entre os planos de negócio e de tecnologia de informação: um modelo operacional para implementação. Revista de Administração Contemporânea 7 (2003), 9–33. https://doi.org/10.1590/S1415-65552003000300002
Victor R Basili-Gianluigi Caldiera and H Dieter Rombach. 1994. Goal question metric approach. Encyclopedia of software engineering 1, 528-532 (1994), 6.
Ruixia Cao. 2021. Research on teaching evaluation system of higher vocational colleges based on OKR and big data, In 2021 16th International Conference on Computer Science & Education (ICCSE). ICCSE 2021 - IEEE 16th International Conference on Computer Science and Education, 676 – 680. http://dx.doi.org/10.1109/ICCSE51940.2021.9569413
Gostian Claudiu-Dan. 2015. Internet Involvment and Metrics in Adult Education Services Online Marketing in Romania. An Evaluation Study. Procedia Computer Science 65 (2015), 950–960.
Jacob Cohen. 1960. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement 20, 1 (1960), 37–46. https://doi.org/10.1177/001316446002000104
Quang-Vinh Dang, Minh-Tuan Truong, and Minh-Hoang Huynh. 2021. Studying the Fuzzy Clustering Methods to Understand Employee Performance. In 2021 4th International Conference on Artificial Intelligence and Big Data (ICAIBD). IEEE, Chengdu, China, 541–544. https://doi.org/10.1109/ICAIBD51990.2021.9459054
Damiano Distante, Stefano Faralli, Steve Rittinghaus, Paolo Rosso, and Nima Samsami. 2022. Domainsenticnet: An ontology and a methodology enabling domain-aware sentic computing. Cognitive computation 14, 1 (2022), 62–77.
John Doerr. 2019. Measure What Matters: How Google, Bono, and the Gates Foundation Rock the World with OKRs (1st. ed.). Portfolio/Penguin, New York. 159 pages.
Tim Van Erp, Niels Gorm Maly Rytter, Felix Sieckmann, Mads Bruun Larsen, Henrik Blichfeldt, and Holger Kohl. 2021. Management, Design, and Implementation of Innovation Projects: Towards a Framework for Improving the Level of Automation and Digitalization in Manufacturing Systems. In 2021 9th International Conference on Control, Mechatronics and Automation (ICCMA). Luxembourg, 211–217. https://doi.org/10.1109/ICCMA54375.2021.9646214
Luis Gustavo Araujo Ferreira, Priscila Bibiana Viegas, and Dagoberto Trento. 2018. An Agile Approach Applied in Enterprise Project Management Office. In Agile Methods, Viviane Almeida dos Santos, Gustavo Henrique Lima Pinto, and Adolfo Gustavo Serra Seca Neto (Eds.). Springer International Publishing, Cham, 95–102.
Steven L. Goldman. 2012. Smart Communities and Networked Organizations. In Virtual and Networked Organizations, Emergent Technologies and Tools, Goran D. Putnik and Maria Manuela Cruz-Cunha (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 304–315.
Fabian Hoeft. 2021. The case of sales in the automotive industry during the COVID-19 pandemic. Strategic Change 30, 2 (2021), 117–125. https://doi.org/10.1002/jsc.2395 arXiv: [link]
Erki Kilu, Fredrik Milani, Ezequiel Scott, and Dietmar Pfahl. 2019. Agile Software Process Improvement by Learning from Financial and Fintech Companies: LHV Bank Case Study. In Software Quality: The Complexity and Challenges of Software Engineering and Software Quality in the Cloud. Springer International Publishing, Cham, 57–69.
Barbara Kitchenham, Stuart Charters, et al. 2007. Guidelines for performing systematic literature reviews in software engineering. Keele University, Keele, UK. (2007), 65.
Natthakan Klanwaree and Songphan Choemprayong. 2019. Objectives & key results for active knowledge sharing in IT consulting enterprises: A feasibility study. Proceedings of the Association for Information Science and Technology 56, 1 (2019), 441–444. https://doi.org/10.1002/pra2.44
Maxim V Koldyshev, Khrystyna S Stoliaruk, Oleksandr O Shpynkovskyi, Olena H Mital, Halyna Y Yamnenko, and Igor M Dovban. 2021. HR Management Efficiency Factors and Their Impact on Creation of a Commercial Innovative Product.Journal of Management Information & Decision Sciences 24, 6 (2021).
Mruthyanjaya Rao Mangipudi, K Prasad, and RW Vaidya. 2021. Objectives and Key Results for Higher Educational Institutions–A Blended Approachas Part of Post Covid-19 Initiatives for Keeping the Institutions Abreast of the Industry Innovations, Create Future Leaders and Build the Nation. Pacific Business Review International (2021), 46–56.
Geoffrey Mann, Sharyn Jevon, and Brendan Bachmann. 2020. How are firms measuring digital transformation at a corporate-level in organisations?. In Australasian Conference on Information Systems: Navigating Our Digital Future, He waka eke noa-We are all in this together. AIS Electronic Library, Melbourne Australia, 88.
John McGarry, Davidck Card, Cheryl Jones, Beth Layman, Elizabeth Clark, Joseph Dean, and Fred Hall. 2002. Practical Software Measurement Objective Information for Decision Makers (1st. ed.). Addison-Wesley, Boston. 277 pages.
Marius Mikalsen, Viktoria Stray, Nils Brede Moe, and Idun Backer. 2020. Shifting Conceptualization of Control in Agile Transformations. In Agile Processes in Software Engineering and Extreme Programming – Workshops, Maria Paasivaara and Philippe Kruchten (Eds.). Springer International Publishing, Cham, 173–181.
Erica Mourão, João Felipe Pimentel, Leonardo Murta, Marcos Kalinowski, Emilia Mendes, and Claes Wohlin. 2020. On the performance of hybrid search strategies for systematic literature reviews in software engineering. Information and Software Technology 123 (jul 2020), 106294. https://doi.org/10.1016/j.infsof.2020.106294
Antonio Muniz, Carla Krieger, Victor Patané, Walther Krause, and Werther Krause. 2022. Jornada OKR na Prática: Unindo Práticas e Experiências que Potencializam Resultados - [OKR Journey in Practice: Uniting Practices and Experiences that Potentialize Results] (1st. ed.). Brasport, Brazil. 216 pages.
Paul R Niven and Ben Lamorte. 2016. Objectives and key results: Driving focus, alignment, and engagement with OKRs (1st. ed.). John Wiley & Sons. 211 pages.
Kai Petersen and Cigdem Gencel. 2013. Worldviews, research methods, and their relationship to validity in empirical software engineering research. In 2013 joint conference of the 23rd international workshop on software measurement and the 8th international conference on software process and product measurement. IEEE, IEEE, Ankara, Turkey, 81–89.
Kai Petersen, Sairam Vakkalanka, and Ludwik Kuzniarz. 2015. Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology 64 (aug 2015), 1–18. https://doi.org/10.1016/j.infsof.2015.03.007
Jihan Rafidah and Emilia Dewi. 2020. Improving Performance Management System of Human Resource Aspect in Health Drink Industry Startup. Malaysian Journal of Social Sciences and Humanities (MJSSH) 5, 8 (Aug. 2020), 85 – 95. https://doi.org/10.47405/mjssh.v5i8.461
Amalia Rahmah, Pristi Sukmasetya, Muh Syaiful Romadhon, and Ahmad Rio Adriansyah. 2020. Developing Distance Learning Monitoring Dashboard with Google Sheet: An Approach for Flexible and Low-Price Solution in Pandemic Era. In 7th International Conference on ICT for Smart Society: AIoT for Smart Society, ICISS 2020 - Proceeding. IEEE, Virtual, Bandung, Indonesia. http://dx.doi.org/10.1109/ICISS50791.2020.9307558
H Roberts and M Petticrew. 2006. Systematic reviews in the social sciences. Blackwell Pub. 352 pages.
IYari Rojas-Chipana, Nicolas Aguilar-Pelizzoli, Juan Carlos Quiroz-Flores, Martín Collao-Diaz, and Alberto Flores-Perez. 2021. Increasing Profitability Through the Implementation of an Integrated Balance Score Card & Objectives Key Results Model in a Digital Agency: A Research in Perú. IEEE Transactions on Software Engineering (2021).
Ezequiel Scott, Fredrik Milani, Erki Kilu, and Dietmar Pfahl. 2021. Enhancing agile software development in the banking sector—A comprehensive case study at LHV. Journal of Software: Evolution and Process 33, 7 (2021), e2363. https://doi.org/10.1002/smr.2363 arXiv: [link]
ISO Central Secretary. 2017. ISO/IEC/IEEE International Standard - Systems and software engineering–Measurement process. ISO/IEC/IEEE 15939:2017(E) (2017), 1–49. https://doi.org/10.1109/IEEESTD.2017.7907158
A.J. Gilbert Silvius. 2007. Business & IT Alignment in Theory and Practice. In 2007 40th Annual Hawaii International Conference on System Sciences (HICSS’07). IEEE, Hawaii, 211b–211b. https://doi.org/10.1109/HICSS.2007.119
Chutiwan Sowkasem and Phumin Kirawanich. 2021. A Deliverable Delay Management of Software Development in Railway Project Using an OKR-Based Scrum Process. In 2021 The 4th International Conference on Software Engineering and Information Management (Yokohama, Japan) (ICSIM 2021). Association for Computing Machinery, New York, NY, USA, 10–16. https://doi.org/10.1145/3451471.3451473
Viktoria Stray, Jan Henrik Gundelsby, Rasmus Ulfsnes, and Nils Moe. 2022. How agile teams make Objectives and Key Results (OKRs) work. In ICSSP’22: Proceedings of the International Conference on Software and System Processes and International Conference on Global Software Engineering. Association for Computing Machinery, New York, NY, USA, 6. https://doi.org/10.1145/3529320.3529332
Viktoria Stray, Nils Brede Moe, Henrik Vedal, and Marthe Berntzen. 2021. Using objectives and key results (OKRs) and slack: a case study of coordination in large-scale distributed agile. Proceedings of the 55th Hawaii International Conference on System Sciences, 2022 1 (2021), 10.
Bianca Trinkenreich and Gleison Santos. 2015. Avaliação do Processo de Medição para Serviços de TI em uma Empresa Global à Luz do MR-MPS-SV - [Evaluation of the measurement process for IT services in a global enterprise based on the MR-MPS-SV]. iSys-Brazilian Journal of Information Systems 8, 2 (2015), 58–77.
Bianca Trinkenreich, Gleison Santos, Monalessa Perini Barcellos, and Tayana Conte. 2019. Combining GQM+Strategies and OKR - Preliminary Results from a Participative Case Study in Industry. In Product-Focused Software Process Improvement. Springer International Publishing, Cham, 103–111.
Thomas Andres Troian, Rodrigo Soares Lelis Gori, Jacson Rafael Weber, Daniel Pacheco Lacerda, and Leandro Gauss. 2022. OKRs as a results-focused management model: a systematic literature review. 28th IJCIEOM – International Joint Conference on Industrial Engineering and Operations Management (2022).
Henrik Vedal, Viktoria Stray, Marthe Berntzen, and Nils Brede Moe. 2021. Managing Dependencies in Large-Scale Agile. Lecture Notes in Business Information Processing 426, 52 – 61. http://dx.doi.org/10.1007/978-3-030-88583-0_6
Cristina Wodtke. 2016. Introduction to OKRs (1st. ed.). O'Reilly Media, Sebastopol, CA, USA.
Claes Wohlin. 2014. Guidelines for Snowballing in Systematic Literature Studies and a Replication in Software Engineering. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering (London, England, United Kingdom) (EASE ’14). Association for Computing Machinery, New York, NY, USA, Article 38, 10 pages. https://doi.org/10.1145/2601248.2601268
Kristin Wulff and Hanne Finnestrand. 2022. It is like taking a ball for a walk: on boundary work in software development. AI & SOCIETY 37, 2 (2022), 711–724.
Hao Zhou and Yu-Ling He. 2018. Comparative Study of OKR and KPI. In 2018 International Conference on e-commerce and contemporary economic development (ECED 2018)(Destech Transactions on Economics Business and Management). Destech Publications, Hangzhou, China, 319–323.
Publicado
29/05/2023
Como Citar
SILVA, Roberto Vasconcelos; SOUZA, Gleison Dos Santos.
Surveying the Academic Literature on the Use of OKR (Objective and Key Results). In: SIMPÓSIO BRASILEIRO DE SISTEMAS DE INFORMAÇÃO (SBSI), 19. , 2023, Maceió/AL.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
