Using an Instrument to Assess Trust, Knowledge, Learning, and Motivation of Agile Teams
DOI:
https://doi.org/10.5753/isys.2023.3005Keywords:
Organizational climate, Agile software development, Human factorsAbstract
Background: Trust, Knowledge, Learning, and Motivation influence the organizational environment of agile teams. Organizational climate surveys can provide concrete evidence of how the process, project activities, people, and culture work in practice. Using assessment climate instruments that do not consider agile values, principles, practices, and roles in a proper context may create difficulties in analyzing possible causes of problems and the execution of corrective actions within organizational climate management. Objective: We present a preliminary evaluation of TACT, which is an instrument to assess the organizational climate of agile teams, comprising four dimensions, Trust, Knowledge, Learning, and Motivation. Method: We planned and executed a case study considering eight development teams from three organizations. We evaluated TACT using open-ended questions, quantitative methods, and TAM dimensions of Intention to Use, Perceived Usefulness, and Output Quality. Results: TACT captured that the product owner's lack of knowledge and experience probably influenced the adverse climate in team trust and that unrealistic deadlines may have generated a lack of team motivation due to an absence of autonomy to plan the iteration. The team leaders reported intention of future use. Contributions and Impact in the IS area: TACT was grounded in scientific literature and industry observations. TACT items regarding Trust, Knowledge, Learning, and Motivation are grounded in the ``agile philosophy'' and consider the most common agile practices. At the same time, it allows reflections on the behaviors of the prominent involved roles in agile projects. Based on the evidence gathered, we inferred that TACT captured the organizational climate of the teams correctly and can be used to identify issues better and improve actions aligned with the agile values, principles, and practices while developing Information Systems.
Downloads
References
Acıkg oz, A. and Gunsel, Ayse, C. K. (2015). Climate and Product Quality in Software
Development Teams: Assessing the Mediating Role of Problem Solving and Learning.
Journal of Administrative Sciences, 13(16):7–40.
Ahmed, S., Ahmed, S., Ali, M., Naseem, A., Razzaq, A., and Ahmed, N. (2018). A
Systematic Literature Review of Success Factors and Barriers of Agile Software Development.
International Journal of Advanced Computer Science and Applications,
(3):1–14.
Ahmed, S., Ahmed, S., Naseem, A., and Razzaq, A. (2017). Motivators and Demotivators
of Agile Software Development: Elicitation and Analysis. International Journal of
Advanced Computer Science and Applications, 8(12):1–11.
Akgun, A. E., Lynn, G. S., and Reilly, R. (2002). Multi-dimensionality of learning in new
product development teams. European Journal of Innovation Management, 5(2):57–
Alasad, H. (2020). The Impact of Agile Processes on Organisational Behaviour Within
Current Banking Practice. Master degree, Auckland University of Technology.
Almanasreh, E., Moles, R., and Chen, T. F. (2019). Evaluation of methods used for estimating
content validity. Research in Social and Administrative Pharmacy, 15(2):214–221.
Anderson, N. R. and West, M. A. (1998). Measuring climate for work group innovation:
development and validation of the team climate inventory. Journal of Organizational
Behavior, 19(3):235–258.
Beck, K., Beedle, M., and et al. Bennekum, A Van (2001). Manifesto for Agile Software
Development.
Bhatt, P., Shroff, G., Anantaram, C., and Misra, A. K. (2006). An influence model for
factors in outsourced software maintenance. Journal of Software Maintenance and
Evolution: Research and Practice, 18(6):385–423.
Boehm, B. and Turner, R. (2003). Balancing Agility and Discipline: A Guide for the
Perplexed. Pearson Education, Boston (USA), 1 edition.
Chagas, A. (2015). (In Portuguese) O impacto dos fatores humanos nos m etodos ageis.
Chagas, A., Santos, M., Santana, C., and Vasconcelos, A. (2015). The Impact of Human
Factors on Agile Projects. In 2015 Agile Conference, pages 87–91, National Harbor,
MD, USA. IEEE.
Cruzes, D. S. and Dyba, T. (2011). Recommended Steps for Thematic Synthesis in Software
Engineering. In 2011 International Symposium on Empirical Software Engineering
and Measurement, pages 275–284, Banff, AB, Canada. IEEE.
Curtis, B., Hefley, W. E., and Miller, S. A. (2009). People Capability Maturity Model
(P-CMM ) Version 2.0, Second Edition. Technical report, Carnegie Mellon University.
de O. Melo, C., Santana, C., and Kon, F. (2012). Developers Motivation in Agile Teams.
In 2012 38th Euromicro Conference on Software Engineering and Advanced Applications,
pages 376–383, Cesme, Turkey. IEEE.
Delgado-Rico, E., Carretero-Dios, H., and Ruch, W. (2012a). Content validity evidences
in test development: An applied perspective. International Journal of Clinical and
Health Psychology, 12(3):449–460.
Delgado-Rico, E., Carretero-Dios, H., and Ruch, W. (2012b). Content validity evidences
in test development: An applied perspective. International Journal of Clinical and
Health Psychology.
Digital.ai, T. (2020). 14th Annual State of Agile Report. Technical report, Digital.ai.
Dima, A. L. (2018). Scale validation in applied health research: tutorial for a 6-step Rbased
psychometrics protocol. Health Psychology and Behavioral Medicine, 6(1):136–161.
Dutra, E., Cerdeiral, C., Lima, P., Diirr, B., and Santos, G. (2022). Organizational Climate
Assessment of Trust, Knowledge, Learning, and Motivation of Agile Teams - A Case
Study. In XVIII Brazilian Symposium on Information Systems, pages 1–8, Curitiba,
Brazil. ACM.
Dutra, E., Diirr, B., and Santos, G. (2021). Human factors and their influence on software
development teams - a tertiary study. In Brazilian Symposium on Software Engineering,
SBES ’21, page 442–451, New York, NY, USA. Association for Computing
Machinery.
Dutra, E., Lima, P., and Santos, G. (2020). An Instrument to Assess the Organizational
Climate of Agile Teams - A Preliminary Study. In 19th Brazilian Symposium on
Software Quality, pages 1–10, S˜ao Luis, Brazil. ACM.
Dutra, E. and Santos, G. (2020). Organisational climate assessments of Agile teams – a
qualitative multiple case study. IET Software, 14(7):861–870.
Dutra, J. S., Fischer, A. L., Nakata, L. E., Pereira, J. C. R., and Veloso, E. F. R. (2012). The
use categories as indicator of organizational climate in Brazilian companies. Revista
de Carreiras e Pessoas, 2:145–176.
Dyb˚a, T. and Dings yr, T. (2008). Empirical studies of agile software development: A
systematic review. Information and Software Technology, 50(9-10):833–859.
Field, A., Miles, J., and Field, Z. (2012). Discovering Statistics Using R. SAGE Publications,
London, 1 edition.
Gonc alves, E. (2022). An Instrument to Assess the Organizational Climate of Agile Software
Development Teams. PhD thesis, UNIRIO.
Goncalves, E., Lima, P., Cerdeiral, C., Diirr, B., and Santos, G. (2022). TACT: An ins-
Trument to Assess the organizational ClimaTe of agile teams - A Preliminary Study.
Journal of Software Engineering Research and Development, 9(1):18:1 – 18:20.
Graziotin, D., Lenberg, P., Feldt, R., andWagner, S. (2020). Psychometrics in Behavioral
Software Engineering: A Methodological Introduction with Guidelines. ACM Trans.
Softw. Eng. Methodol., I(1):Article 111 – 49 pages.
Hinkle, D., Wiersma, W., and Jurs, S. (2003). Applied Statistics for the Behavioural
Sciences. Houghton Mifflin, Boston, 5 edition.
Hohl, P., Kl under, J., van Bennekum, A., Lockard, R., Gifford, J., M unch, J., Stupperich,
M., and Schneider, K. (2018). Back to the future: origins and directions of the “Agile
Manifesto” – views of the originators. Journal of Software Engineering Research and
Development, 6(1):15.
Kakar, A. K. (2020). A Theory of Agile Software Development. In Southern Association
for Information Systems (SAIS 2020) Proceedings, page 8, Virtually. AISeL.
Oliveira, R. and Franc a, C. (2019). Agile Practices and Motivation. In Proceedings of the
Evaluation and Assessment on Software Engineering, pages 365–368, New York, NY,
USA. ACM.
Patterson, M. G., West, M. A., Shackleton, V. J., Dawson, J. F., Lawthom, R., Maitlis,
S., Robinson, D. L., and Wallace, A. M. (2005). Validating the organizational climate
measure: links to managerial practices, productivity and innovation. Journal of
Organizational Behavior, 26(4):379–408.
PMI, P. M. I. and Agile Alliance, A. A. (2017). Agile Practice Guide. PMI, Pennsylvania,
st edition.
Raza, M. M., Minhas, N. M., Khan, H. U., and Asghar, I. (2015). Impact of Stress
on Software Engineers Knowledge Sharing and Creativity [A Pakistani Perspective].
International Journal of Business Intelligents, 004(002):69–73.
iSys: Revista Brasileira de Sistemas de Informac ˜ao (iSys: Brazilian Journal of Information Systems)
http://seer.unirio.br/index.php/isys/
Recker, J. (2013). Scientific Research in Information Systems. Springer Berlin Heidelberg,
Berlin, Heidelberg.
Reginaldo, F. and Santos, G. (2020). Challenges in Agile Transformation Journey. In
Proceedings of the 34th Brazilian Symposium on Software Engineering, pages 11–20,
New York, NY, USA. ACM.
Revelle,W. (2018). How to: Use the psych package for factor analysis and data reduction.
Technical report, Northwestern University.
Salda˜na, J. (2013). The Coding Manual for Qualitative Researchers (2nd Ed.). SAGE
Publications Ltd.
Senapathi, M. and Srinivasan, A. (2013). Sustained agile usage. In Proceedings of the
th International Conference on Evaluation and Assessment in Software Engineering
- EASE ’13, page 119, New York, New York, USA. ACM Press.
Serrador, P., Gemino, A., and Horner, B. (2018). Creating a climate for project success.
Journal of Modern Project Management, May/August:38–47.
Shahzad, F., Xiu, G., and Shahbaz, M. (2017). Organizational culture and innovation
performance in Pakistan’s software industry. Technology in Society, 51:66–73.
Sharma, A. and Gupta, A. (2012). Impact of organisational climate and demographics on
project specific risks in context to Indian software industry. International Journal of
Project Management, 30(2):176–187.
Sherman, S., Hadar, I., and Luria, G. (2018). Leveraging organizational climate theory for
understanding industry-academia collaboration. Information and Software Technology,
:148–160.
Soomro, A. B., Salleh, N., Mendes, E., Grundy, J., Burch, G., and Nordin, A. (2016).
The effect of software engineers’ personality traits on team climate and performance:
A Systematic Literature Review. Information and Software Technology, 73(May
:52–65.
Spector, P. (1992). Summated Rating Scale Construction: An Introduction. Sage Publications,
Inc, California.
Tsai, M.-T. and Cheng, N.-C. (2010). Programmer perceptions of knowledgesharing
behavior under social cognitive theory. Expert Systems with Applications,
(12):8479–8485.
VandenBos, G. R. E. (2017). APA Dictionary of Psychology.
Venkatesh, V. and Bala, H. (2008). Technology Acceptance Model 3 and a Research
Agenda on Interventions. Decision Sciences, 39(2):273–315.
Venkatesh, V. and Davis, F. D. (2000). A Theoretical Extension of the Technology Acceptance
Model: Four Longitudinal Field Studies. Management Science, 46(2):186–204.
Vishnubhotla, S. D., Mendes, E., and Lundberg, L. (2018). An Insight into the Capabilities
of Professionals and Teams in Agile Software Development. In Proceedings of the
7th International Conference on Software and Computer Applications - ICSCA
, pages 10–19, New York, New York, USA. ACM Press.
Vishnubhotla, S. D., Mendes, E., and Lundberg, L. (2020). Investigating the relationship
between personalities and agile team climate of software professionals in a telecom
company. Information and Software Technology, 126:106335.
Wagner, S., Mendez, D., Felderer,M., Graziotin, D., and Kalinowski, M. (2020). Contemporary
Empirical Methods in Software Engineering. Springer International Publishing,Cham.
Yin, R. K. (2013). Case Study Research: Design and Methods. Sage Publications, Los
Angeles, 5 edition.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 iSys - Brazilian Journal of Information Systems
This work is licensed under a Creative Commons Attribution 4.0 International License.
