skip to main content
10.1145/3613372.3613404acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbesConference Proceedingsconference-collections
research-article

Evolution of Teamwork Quality Instruments in Agile Software Development: A Systematic Literature Review

Published:25 September 2023Publication History

ABSTRACT

[Context] Multiple models (or instruments) for measuring Teamwork Quality (TWQ) and Teamwork Effectiveness (TWE) for Agile Software Development (ASD) have been created. However, such models have different constructs and measures, with a limited understanding of how they are related and have evolved. [Goal] Our goal is to identify all ASD instruments to gain insights into the evolution of specific instruments for ASD. [Method] We performed a systematic review methodology using a search string and a forward snowballing approach to identify the specific instruments that assess TWQ and TWE. Later, we conducted a frequency analysis of the factors measured by these ASD instruments. [Results] We provided a comprehensive view of the evolution of teamwork instruments in ASD and classified them into Generic teamwork instruments and Agile-based teamwork instruments. We found that these instruments have evolved with the more specialized factors specific to the agile context. In addition, they have semantically similar factors with different factor names, pointing to the need for terminology standardization. [Conclusion] A conceptual framework integrating the instrument factors within the agile context is needed. We advocate further studies on this topic, aiming to develop a unified taxonomy to be taken as a reference for constructing new teamwork instruments.

References

  1. Clayton P Alderfer. 1983. An intergroup perspective on group dynamics.Technical Report. Yale Univ New Haven CT School of Organization and Management.Google ScholarGoogle Scholar
  2. Neil Anderson and Michael A West. 1996. The Team Climate Inventory: Development of the TCI and its applications in teambuilding for innovativeness. European Journal of work and organizational psychology 5, 1 (1996), 53–66.Google ScholarGoogle Scholar
  3. Phillip G Armour. 2002. The spiritual life of projects. Commun. ACM 45, 1 (2002), 11–14.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Terry L Dickinson and Robert M McIntyre. 1997. A conceptual framework for teamwork measurement. In Team performance assessment and measurement. Psychology Press, 31–56.Google ScholarGoogle Scholar
  5. Kim Dikert, Maria Paasivaara, and Casper Lassenius. 2016. Challenges and success factors for large-scale agile transformations: A systematic literature review. Journal of Systems and Software 119 (2016), 87–108.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Torgeir Dingsøyr, Tor Erlend Fægri, Tore Dybå, Børge Haugset, and Yngve Lindsjørn. 2016. Team performance in software development: research results versus agile principles. IEEE software 33, 4 (2016), 106–110.Google ScholarGoogle Scholar
  7. Torgeir Dingsøyr and Yngve Lindsjørn. 2013. Team performance in agile development teams: findings from 18 focus groups. In Agile Processes in Software Engineering and Extreme Programming: 14th International Conference, XP 2013, Vienna, Austria, June 3-7, 2013. Proceedings 14. Springer, 46–60.Google ScholarGoogle ScholarCross RefCross Ref
  8. Arthur Freire, Manuel Neto, Mirko Perkusich, Kyller Gorgônio, Hyggo Almeida, and Angelo Perkusich. 2021. Towards a comprehensive understanding of agile teamwork: A literature-based thematic network. SEKE.Google ScholarGoogle Scholar
  9. Arthur Freire, Mirko Perkusich, Renata Saraiva, Hyggo Almeida, and Angelo Perkusich. 2018. A Bayesian networks-based approach to assess and improve the teamwork quality of agile teams. Information and Software Technology 100 (2018), 119–132.Google ScholarGoogle ScholarCross RefCross Ref
  10. Eliezer Goncalves, Patrícia Lima, Cristina Cerdeiral, Bruna Diirr, and Gleison Santos. 2021. TACT: An insTrument to Assess the organizational ClimaTe of agile teams-A Preliminary Study. Journal of Software Engineering Research and Development 9 (2021), 18–1.Google ScholarGoogle Scholar
  11. Lucas Gren, Richard Torkar, and Robert Feldt. 2015. Group Maturity and Agility, Are They Connected?–A Survey Study. In 2015 41st Euromicro Conference on Software Engineering and Advanced Applications. IEEE, 1–8.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Richard A Guzzo and Gregory P Shea. 1992. Group performance and intergroup relations in organizations. (1992).Google ScholarGoogle Scholar
  13. JR Hackman. 1987. The design of work teams. In JW Lorsch (Ed.), Handbook of Organizational Behavior, Englewood Cliffs, NJ: Prentice-Hall. (1987).Google ScholarGoogle Scholar
  14. Martin Hoegl and Hans Georg Gemuenden. 2001. Teamwork quality and the success of innovative projects: A theoretical concept and empirical evidence. Organization science 12, 4 (2001), 435–449.Google ScholarGoogle Scholar
  15. Daniel R Ilgen, John R Hollenbeck, Michael Johnson, and Dustin Jundt. 2005. Teams in organizations: From input-process-output models to IMOI models. Annu. Rev. Psychol. 56 (2005), 517–543.Google ScholarGoogle ScholarCross RefCross Ref
  16. BA Kitchenham and Stuart M. Charters. 2007. Guidelines for performing systematic literature reviews in software engineering. Technical Report. Citeseer.Google ScholarGoogle Scholar
  17. Pui-Wa Lei and Qiong Wu. 2007. Introduction to structural equation modeling: Issues and practical considerations. Educational Measurement: issues and practice 26, 3 (2007), 33–43.Google ScholarGoogle Scholar
  18. Yngve Lindsjørn, Dag IK Sjøberg, Torgeir Dingsøyr, Gunnar R Bergersen, and Tore Dybå. 2016. Teamwork quality and project success in software development: A survey of agile development teams. Journal of Systems and Software 122 (2016), 274–286.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Lina Lukusa, Sharon Geeling, Shallen Lusinga, and Ulrike Rivett. 2020. Teamwork and project success in agile software development methods: A case study in higher education. In Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality. 885–891.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. George Marsicano, Fabio QB da Silva, Carolyn B Seaman, and Breno Giovanni Adaid-Castro. 2020. The Teamwork Process Antecedents (TPA) questionnaire: developing and validating a comprehensive measure for assessing antecedents of teamwork process quality. Empirical Software Engineering 25 (2020), 3928–3976.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. John Mathieu, M Travis Maynard, Tammy Rapp, and Lucy Gilson. 2008. Team effectiveness 1997-2007: A review of recent advancements and a glimpse into the future. Journal of management 34, 3 (2008), 410–476.Google ScholarGoogle ScholarCross RefCross Ref
  22. Claudia de O Melo, Daniela S Cruzes, Fabio Kon, and Reidar Conradi. 2013. Interpretative case studies on agile team productivity and management. Information and Software Technology 55, 2 (2013), 412–427.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Nils Brede Moe and Torgeir Dingsøyr. 2008. Scrum and team effectiveness: Theory and practice. In Agile Processes in Software Engineering and Extreme Programming: 9th International Conference, XP 2008, Limerick, Ireland, June 10-14, 2008. Proceedings 9. Springer, 11–20.Google ScholarGoogle ScholarCross RefCross Ref
  24. Nils Brede Moe, Torgeir Dingsøyr, and Tore Dybå. 2010. A teamwork model for understanding an agile team: A case study of a Scrum project. Information and software technology 52, 5 (2010), 480–491.Google ScholarGoogle Scholar
  25. Nils Brede Moe, Torgeir Dingsøyr, and Emil A Røyrvik. 2009. Putting agile teamwork to the test–an preliminary instrument for empirically assessing and improving agile software development. In Agile Processes in Software Engineering and Extreme Programming: 10th International Conference, XP 2009, Pula, Sardinia, Italy, May 25-29, 2009. Proceedings 10. Springer, 114–123.Google ScholarGoogle ScholarCross RefCross Ref
  26. Erica Mourão, João Felipe Pimentel, Leonardo Murta, Marcos Kalinowski, Emilia Mendes, and Claes Wohlin. 2020. On the performance of hybrid search strategies for systematic literature reviews in software engineering. Information and Software Technology 123 (2020), 106294.Google ScholarGoogle ScholarCross RefCross Ref
  27. Jorge Pérez, Jessica Díaz, Javier Garcia-Martin, and Bernardo Tabuenca. 2020. Systematic literature reviews in software engineering—Enhancement of the study selection process using Cohen’s kappa statistic. Journal of Systems and Software 168 (2020), 110657.Google ScholarGoogle ScholarCross RefCross Ref
  28. Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic mapping studies in software engineering. In 12th International Conference on Evaluation and Assessment in Software Engineering (EASE) 12. 1–10.Google ScholarGoogle ScholarCross RefCross Ref
  29. Alexander Poth, Mario Kottke, and Andreas Riel. 2020. Evaluation of agile team work quality. In Agile Processes in Software Engineering and Extreme Programming–Workshops: XP 2020 Workshops, Copenhagen, Denmark, June 8–12, 2020, Revised Selected Papers 21. Springer, 101–110.Google ScholarGoogle ScholarCross RefCross Ref
  30. Abirami Radhakrishnan, Jigish Zaveri, Dessa David, and John Stephen Davis. 2022. The impact of project team characteristics and client collaboration on project agility and project success: An empirical study. European Management Journal 40, 5 (2022), 758–777.Google ScholarGoogle ScholarCross RefCross Ref
  31. Daniel Russo and Klaas-Jan Stol. 2021. PLS-SEM for software engineering research: An introduction and survey. ACM Computing Surveys (CSUR) 54, 4 (2021), 1–38.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Eduardo Salas, Dana E Sims, and C Shawn Burke. 2005. Is there a “big five” in teamwork?Small group research 36, 5 (2005), 555–599.Google ScholarGoogle Scholar
  33. Pedro Serrador and Jeffrey K Pinto. 2015. Does Agile work?—A quantitative analysis of agile project success. International journal of project management 33, 5 (2015), 1040–1051.Google ScholarGoogle ScholarCross RefCross Ref
  34. Stavros Stavru. 2014. A critical examination of recent industrial surveys on agile method usage. Journal of Systems and Software 94 (2014), 87–97.Google ScholarGoogle ScholarCross RefCross Ref
  35. Diane Strode. 2016. Applying Adapted big five teamwork theory to agile software development. arXiv preprint arXiv:1606.03549 (2016).Google ScholarGoogle Scholar
  36. Diane Strode, Torgeir Dingsøyr, and Yngve Lindsjorn. 2022. A teamwork effectiveness model for agile software development. Empirical Software Engineering 27, 2 (2022), 56.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Dothang Truong and Thawatchai Jitbaipoon. 2016. How can agile methodologies be used to enhance the success of information technology projects?International Journal of Information Technology Project Management (IJITPM) 7, 2 (2016), 1–16.Google ScholarGoogle Scholar
  38. Marcel F Van Assen. 2000. Agile-based competence management: the relation between agile manufacturing and time-based competence management. International Journal of Agile Management Systems 2, 2 (2000), 142–155.Google ScholarGoogle ScholarCross RefCross Ref
  39. Viswanath Venkatesh and Fred D Davis. 2000. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science 46, 2 (2000), 186–204.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Christiaan Verwijs and Daniel Russo. 2023. A theory of scrum team effectiveness. ACM Transactions on Software Engineering and Methodology (2023).Google ScholarGoogle Scholar
  41. Susan A Wheelan and Judith M Hochberger. 1996. Validation studies of the group development questionnaire. Small group research 27, 1 (1996), 143–170.Google ScholarGoogle Scholar
  42. Claes Wohlin. 2014. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th international conference on evaluation and assessment in software engineering. 1–10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Claes Wohlin, Marcos Kalinowski, Katia Romero Felizardo, and Emilia Mendes. 2022. Successful combination of database search and snowballing for identification of primary studies in systematic literature studies. Information and Software Technology 147 (2022), 106908.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Evolution of Teamwork Quality Instruments in Agile Software Development: A Systematic Literature Review

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        SBES '23: Proceedings of the XXXVII Brazilian Symposium on Software Engineering
        September 2023
        570 pages
        ISBN:9798400707872
        DOI:10.1145/3613372

        Copyright © 2023 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 25 September 2023

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate147of427submissions,34%
      • Article Metrics

        • Downloads (Last 12 months)55
        • Downloads (Last 6 weeks)13

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format