Using an Instrument to Assess Trust, Knowledge, Learning, and Motivation of Agile Teams


  • Eliezer Dutra UNIRIO AND CEFET/RJ
  • Cristina Cerdeiral Nest Wealth
  • Patrícia Lima UNIRIO
  • Rafael Escalfoni CEFET/RJ
  • Bruna Diirr UNIRIO
  • Gleison Santos UNIRIO



Organizational climate, Agile software development, Human factors


Background: Trust, Knowledge, Learning, and Motivation influence the organizational environment of agile teams. Organizational climate surveys can provide concrete evidence of how the process, project activities, people, and culture work in practice. Using assessment climate instruments that do not consider agile values, principles, practices, and roles in a proper context may create difficulties in analyzing possible causes of problems and the execution of corrective actions within organizational climate management. Objective: We present a preliminary evaluation of TACT, which is an instrument to assess the organizational climate of agile teams, comprising four dimensions, Trust, Knowledge, Learning, and Motivation. Method: We planned and executed a case study considering eight development teams from three organizations. We evaluated TACT using open-ended questions, quantitative methods, and TAM dimensions of Intention to Use, Perceived Usefulness, and Output Quality. Results: TACT captured that the product owner's lack of knowledge and experience probably influenced the adverse climate in team trust and that unrealistic deadlines may have generated a lack of team motivation due to an absence of autonomy to plan the iteration. The team leaders reported intention of future use. Contributions and Impact in the IS area: TACT was grounded in scientific literature and industry observations. TACT items regarding Trust, Knowledge, Learning, and Motivation are grounded in the ``agile philosophy'' and consider the most common agile practices. At the same time, it allows reflections on the behaviors of the prominent involved roles in agile projects. Based on the evidence gathered, we inferred that TACT captured the organizational climate of the teams correctly and can be used to identify issues better and improve actions aligned with the agile values, principles, and practices while developing Information Systems.


Download data is not yet available.


Acıkg oz, A. and Gunsel, Ayse, C. K. (2015). Climate and Product Quality in Software

Development Teams: Assessing the Mediating Role of Problem Solving and Learning.

Journal of Administrative Sciences, 13(16):7–40.

Ahmed, S., Ahmed, S., Ali, M., Naseem, A., Razzaq, A., and Ahmed, N. (2018). A

Systematic Literature Review of Success Factors and Barriers of Agile Software Development.

International Journal of Advanced Computer Science and Applications,


Ahmed, S., Ahmed, S., Naseem, A., and Razzaq, A. (2017). Motivators and Demotivators

of Agile Software Development: Elicitation and Analysis. International Journal of

Advanced Computer Science and Applications, 8(12):1–11.

Akgun, A. E., Lynn, G. S., and Reilly, R. (2002). Multi-dimensionality of learning in new

product development teams. European Journal of Innovation Management, 5(2):57–

Alasad, H. (2020). The Impact of Agile Processes on Organisational Behaviour Within

Current Banking Practice. Master degree, Auckland University of Technology.

Almanasreh, E., Moles, R., and Chen, T. F. (2019). Evaluation of methods used for estimating

content validity. Research in Social and Administrative Pharmacy, 15(2):214–221.

Anderson, N. R. and West, M. A. (1998). Measuring climate for work group innovation:

development and validation of the team climate inventory. Journal of Organizational

Behavior, 19(3):235–258.

Beck, K., Beedle, M., and et al. Bennekum, A Van (2001). Manifesto for Agile Software


Bhatt, P., Shroff, G., Anantaram, C., and Misra, A. K. (2006). An influence model for

factors in outsourced software maintenance. Journal of Software Maintenance and

Evolution: Research and Practice, 18(6):385–423.

Boehm, B. and Turner, R. (2003). Balancing Agility and Discipline: A Guide for the

Perplexed. Pearson Education, Boston (USA), 1 edition.

Chagas, A. (2015). (In Portuguese) O impacto dos fatores humanos nos m etodos ageis.

Chagas, A., Santos, M., Santana, C., and Vasconcelos, A. (2015). The Impact of Human

Factors on Agile Projects. In 2015 Agile Conference, pages 87–91, National Harbor,


Cruzes, D. S. and Dyba, T. (2011). Recommended Steps for Thematic Synthesis in Software

Engineering. In 2011 International Symposium on Empirical Software Engineering

and Measurement, pages 275–284, Banff, AB, Canada. IEEE.

Curtis, B., Hefley, W. E., and Miller, S. A. (2009). People Capability Maturity Model

(P-CMM ) Version 2.0, Second Edition. Technical report, Carnegie Mellon University.

de O. Melo, C., Santana, C., and Kon, F. (2012). Developers Motivation in Agile Teams.

In 2012 38th Euromicro Conference on Software Engineering and Advanced Applications,

pages 376–383, Cesme, Turkey. IEEE.

Delgado-Rico, E., Carretero-Dios, H., and Ruch, W. (2012a). Content validity evidences

in test development: An applied perspective. International Journal of Clinical and

Health Psychology, 12(3):449–460.

Delgado-Rico, E., Carretero-Dios, H., and Ruch, W. (2012b). Content validity evidences

in test development: An applied perspective. International Journal of Clinical and

Health Psychology., T. (2020). 14th Annual State of Agile Report. Technical report,

Dima, A. L. (2018). Scale validation in applied health research: tutorial for a 6-step Rbased

psychometrics protocol. Health Psychology and Behavioral Medicine, 6(1):136–161.

Dutra, E., Cerdeiral, C., Lima, P., Diirr, B., and Santos, G. (2022). Organizational Climate

Assessment of Trust, Knowledge, Learning, and Motivation of Agile Teams - A Case

Study. In XVIII Brazilian Symposium on Information Systems, pages 1–8, Curitiba,

Brazil. ACM.

Dutra, E., Diirr, B., and Santos, G. (2021). Human factors and their influence on software

development teams - a tertiary study. In Brazilian Symposium on Software Engineering,

SBES ’21, page 442–451, New York, NY, USA. Association for Computing


Dutra, E., Lima, P., and Santos, G. (2020). An Instrument to Assess the Organizational

Climate of Agile Teams - A Preliminary Study. In 19th Brazilian Symposium on

Software Quality, pages 1–10, S˜ao Luis, Brazil. ACM.

Dutra, E. and Santos, G. (2020). Organisational climate assessments of Agile teams – a

qualitative multiple case study. IET Software, 14(7):861–870.

Dutra, J. S., Fischer, A. L., Nakata, L. E., Pereira, J. C. R., and Veloso, E. F. R. (2012). The

use categories as indicator of organizational climate in Brazilian companies. Revista

de Carreiras e Pessoas, 2:145–176.

Dyb˚a, T. and Dings yr, T. (2008). Empirical studies of agile software development: A

systematic review. Information and Software Technology, 50(9-10):833–859.

Field, A., Miles, J., and Field, Z. (2012). Discovering Statistics Using R. SAGE Publications,

London, 1 edition.

Gonc alves, E. (2022). An Instrument to Assess the Organizational Climate of Agile Software

Development Teams. PhD thesis, UNIRIO.

Goncalves, E., Lima, P., Cerdeiral, C., Diirr, B., and Santos, G. (2022). TACT: An ins-

Trument to Assess the organizational ClimaTe of agile teams - A Preliminary Study.

Journal of Software Engineering Research and Development, 9(1):18:1 – 18:20.

Graziotin, D., Lenberg, P., Feldt, R., andWagner, S. (2020). Psychometrics in Behavioral

Software Engineering: A Methodological Introduction with Guidelines. ACM Trans.

Softw. Eng. Methodol., I(1):Article 111 – 49 pages.

Hinkle, D., Wiersma, W., and Jurs, S. (2003). Applied Statistics for the Behavioural

Sciences. Houghton Mifflin, Boston, 5 edition.

Hohl, P., Kl under, J., van Bennekum, A., Lockard, R., Gifford, J., M unch, J., Stupperich,

M., and Schneider, K. (2018). Back to the future: origins and directions of the “Agile

Manifesto” – views of the originators. Journal of Software Engineering Research and

Development, 6(1):15.

Kakar, A. K. (2020). A Theory of Agile Software Development. In Southern Association

for Information Systems (SAIS 2020) Proceedings, page 8, Virtually. AISeL.

Oliveira, R. and Franc a, C. (2019). Agile Practices and Motivation. In Proceedings of the

Evaluation and Assessment on Software Engineering, pages 365–368, New York, NY,


Patterson, M. G., West, M. A., Shackleton, V. J., Dawson, J. F., Lawthom, R., Maitlis,

S., Robinson, D. L., and Wallace, A. M. (2005). Validating the organizational climate

measure: links to managerial practices, productivity and innovation. Journal of

Organizational Behavior, 26(4):379–408.

PMI, P. M. I. and Agile Alliance, A. A. (2017). Agile Practice Guide. PMI, Pennsylvania,

st edition.

Raza, M. M., Minhas, N. M., Khan, H. U., and Asghar, I. (2015). Impact of Stress

on Software Engineers Knowledge Sharing and Creativity [A Pakistani Perspective].

International Journal of Business Intelligents, 004(002):69–73.

iSys: Revista Brasileira de Sistemas de Informac ˜ao (iSys: Brazilian Journal of Information Systems)

Recker, J. (2013). Scientific Research in Information Systems. Springer Berlin Heidelberg,

Berlin, Heidelberg.

Reginaldo, F. and Santos, G. (2020). Challenges in Agile Transformation Journey. In

Proceedings of the 34th Brazilian Symposium on Software Engineering, pages 11–20,

New York, NY, USA. ACM.

Revelle,W. (2018). How to: Use the psych package for factor analysis and data reduction.

Technical report, Northwestern University.

Salda˜na, J. (2013). The Coding Manual for Qualitative Researchers (2nd Ed.). SAGE

Publications Ltd.

Senapathi, M. and Srinivasan, A. (2013). Sustained agile usage. In Proceedings of the

th International Conference on Evaluation and Assessment in Software Engineering

- EASE ’13, page 119, New York, New York, USA. ACM Press.

Serrador, P., Gemino, A., and Horner, B. (2018). Creating a climate for project success.

Journal of Modern Project Management, May/August:38–47.

Shahzad, F., Xiu, G., and Shahbaz, M. (2017). Organizational culture and innovation

performance in Pakistan’s software industry. Technology in Society, 51:66–73.

Sharma, A. and Gupta, A. (2012). Impact of organisational climate and demographics on

project specific risks in context to Indian software industry. International Journal of

Project Management, 30(2):176–187.

Sherman, S., Hadar, I., and Luria, G. (2018). Leveraging organizational climate theory for

understanding industry-academia collaboration. Information and Software Technology,


Soomro, A. B., Salleh, N., Mendes, E., Grundy, J., Burch, G., and Nordin, A. (2016).

The effect of software engineers’ personality traits on team climate and performance:

A Systematic Literature Review. Information and Software Technology, 73(May


Spector, P. (1992). Summated Rating Scale Construction: An Introduction. Sage Publications,

Inc, California.

Tsai, M.-T. and Cheng, N.-C. (2010). Programmer perceptions of knowledgesharing

behavior under social cognitive theory. Expert Systems with Applications,


VandenBos, G. R. E. (2017). APA Dictionary of Psychology.

Venkatesh, V. and Bala, H. (2008). Technology Acceptance Model 3 and a Research

Agenda on Interventions. Decision Sciences, 39(2):273–315.

Venkatesh, V. and Davis, F. D. (2000). A Theoretical Extension of the Technology Acceptance

Model: Four Longitudinal Field Studies. Management Science, 46(2):186–204.

Vishnubhotla, S. D., Mendes, E., and Lundberg, L. (2018). An Insight into the Capabilities

of Professionals and Teams in Agile Software Development. In Proceedings of the

7th International Conference on Software and Computer Applications - ICSCA

, pages 10–19, New York, New York, USA. ACM Press.

Vishnubhotla, S. D., Mendes, E., and Lundberg, L. (2020). Investigating the relationship

between personalities and agile team climate of software professionals in a telecom

company. Information and Software Technology, 126:106335.

Wagner, S., Mendez, D., Felderer,M., Graziotin, D., and Kalinowski, M. (2020). Contemporary

Empirical Methods in Software Engineering. Springer International Publishing,Cham.

Yin, R. K. (2013). Case Study Research: Design and Methods. Sage Publications, Los

Angeles, 5 edition.




How to Cite

Dutra, E., Cerdeiral, C., Lima, P., Escalfoni, R., Diirr, B., & Santos, G. (2023). Using an Instrument to Assess Trust, Knowledge, Learning, and Motivation of Agile Teams. ISys - Brazilian Journal of Information Systems, 16(1), 7:1–7:32.



Extended versions of selected articles