Perception of Software Bots on Pull Requests on Social Coding Environments
Resumo
Os software bots conectam usuários e ferramentas, simplificando o processo de revisão de pull requests em plataformas sociais de codificação. No entanto, a presença destes bots pode ser prejudicial para a comunidade. Entrevistando desenvolvedores de código aberto, criamos uma teoria de como desenvolvedores humanos percebem comportamentos irritantes de bots como ruído. Para identificar estratégias para superar tais problemas, aplicamos o Design Fiction como método participativo com desenvolvedores e pesquisadores. Nossas descobertas podem ajudar os profissionais a entender os efeitos da adoção de um bot, e pesquisadores e designers de ferramentas podem utilizar nossos resultados para apoiar a interação humano-bot em plataformas sociais de codificação.
Referências
Abdellatif, A., Badran, K., and Shihab, E. (2020). Msrbot: Using bots to answer questions from software repositories. Empirical Software Engineering, 25(3):1834-1863.
Blythe, M. (2014). Research through design fiction: narrative in real and imaginary abstracts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 703-712. ACM.
Brown, C. and Parnin, C. (2019). Sorry to bother you: Designing bots for effective recommendations. In Proceedings of the 1st International Workshop on Bots in Software Engineering, BotSE '19, pages 54-58, Piscataway, NJ, USA. IEEE Press.
Carvalho, A., Luz, W., Marcilio, D., Bonifacio, R., Pinto, G., and Canedo, E. D. (2020). C-3pr: A bot for fixing static analysis violations via pull requests. In 2020 IEEE 27th International Conference on Software Analysis, Evolution and Reengineering (SANER), pages 161-171. IEEE.
Chaves, A. P. and Gerosa, M. A. (2018). Single or multiple conversational agents? an interactional coherence comparison. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pages 1-13.
Dagli, M. (2019). Designing for Trust. PhD thesis, figshare.
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly, pages 319-340.
Glaser, B. G. and Strauss, A. L. (2017). Discovery of grounded theory: Strategies for qualitative research. Routledge.
Gousios, G., Storey, M.-A., and Bacchelli, A. (2016). Work practices and challenges in pull-based development: The contributor's perspective. In Proceedings of the 38th International Conference on Software Engineering, ICSE '16, pages 285-296, New York, NY, USA. ACM.
Healy, T. (2012). The unanticipated consequences of technology. Nanotechnology: ethical and social Implications, pages 155-173.
Kavaler, D., Trockman, A., Vasilescu, B., and Filkov, V. (2019). Tool choice matters: Javascript quality assurance tools and usage outcomes in github projects. In Proceedings of the 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE), pages 476-487.
Liu, D., Smith, M. J., and Veeramachaneni, K. (2020). Understanding user-bot interactions for small-scale automation in open-source development. In Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, CHI EA '20, page 1-8, New York, NY, USA. Association for Computing Machinery.
McIntosh, S., Kamei, Y., Adams, B., and Hassan, A. E. (2014). The impact of code review coverage and code review participation on software quality: A case study of the qt, vtk, and itk projects. In Proceedings of the 11th Working Conference on Mining Software Repositories, pages 192-201.
Mirhosseini, S. and Parnin, C. (2017). Can automated pull requests encourage software developers to upgrade out-of-date dependencies? In Proceedings of the 32nd IEEE/ACM International Conference on Automated Software Engineering, ASE 2017, pages 84-94, Piscataway, NJ, USA. IEEE Press.
Monperrus, M. (2019). Explainable software bot contributions: Case study of automated bug fixes. In Proceedings of the 1st International Workshop on Bots in Software Engineering, BotSE '19, pages 12-15, Piscataway, NJ, USA. IEEE Press.
Mulder, K. (2013). Impact of new technologies: how to assess the intended and unintended effects of new technologies. Handb. Sustain. Eng.(2013).
Nematzadeh, A., Ciampaglia, G. L., Ahn, Y.-Y., and Flammini, A. (2016). Information overload in group communication: From conversation to cacophony in the twitch chat. Royal Society open science, 6(10):191412.
Paikari, E. and van der Hoek, A. (2018). A framework for understanding chatbots and their future. In Proceedings of the 11th International Workshop on Cooperative and Human Aspects of Software Engineering, CHASE '18, pages 13-16, New York, NY, USA. ACM.
Peng, Z. and Ma, X. (2019). Exploring how software developers work with mention bot in github. CCF Transactions on Pervasive Computing and Interaction, 1(3):190-203.
Sadeddin, K. W., Serenko, A., and Hayes, J. (2007). Online shopping bots for electronic commerce: the comparison of functionality and performance. International Journal of Electronic Business, 5(6):576.
Serban, D., Golsteijn, B., Holdorp, R., and Serebrenik, A. (2021). Saw-bot: Proposing fixes for static analysis warnings with github suggestions. In Workshop on Bots in Software Engineering, United States. IEEE Computer Society.
Steinmacher, I., Conte, T. U., Treude, C., and Gerosa, M. A. (2016). Overcoming open source project entry barriers with a portal for newcomers. In Proceedings of the 38th International Conference on Software Engineering, ICSE '16, pages 273-284, New York, NY, USA. ACM.
Steinmacher, I., Wiese, I., Chaves, A. P., and Gerosa, M. A. (2013). Why do newcomers abandon open source software projects? In 2013 6th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE), pages 25-32. IEEE.
Storey, M.-A., Serebrenik, A., Rosé, C. P., Zimmermann, T., and Herbsleb, J. D. (2020). BOTse: Bots in Software Engineering (Dagstuhl Seminar 19471). Dagstuhl Reports, 9(11):84-96.
Storey, M.-A. and Zagalsky, A. (2016). Disrupting developer productivity one bot at a time. In Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2016, pages 928-931, New York, NY, USA. ACM.
Strauss, A. and Corbin, J. M. (1997). Grounded theory in practice. Sage.
Thistlethwaite, D. L. and Campbell, D. T. (1960). Regression-discontinuity analysis: An alternative to the ex post facto experiment. Journal of Educational psychology, 51(6):309.
Tsay, J., Dabbish, L., and Herbsleb, J. (2014). Let's talk about it: Evaluating contributions through discussion in github. In Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2014, pages 144-154, New York, NY, USA. ACM.
Urli, S., Yu, Z., Seinturier, L., and Monperrus, M. (2018). How to design a program repair bot?: insights from the repairnator project. In Proceedings of the 40th International Conference on Software Engineering: Software Engineering in Practice, pages 95-104. ACM.
Vasilescu, B., Yu, Y., Wang, H., Devanbu, P., and Filkov, V. (2015). Quality and productivity outcomes relating to continuous integration in github. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2015, page 805-816, New York, NY, USA. Association for Computing Machinery.
Wessel, M., de Souza, B. M., Steinmacher, I., Wiese, I. S., Polato, I., Chaves, A. P., and Gerosa, M. A. (2018). The power of bots: Characterizing and understanding bots in oss projects. Proc. ACM Hum.-Comput. Interact., 2(CSCW):182:1-182:19.
Wessel, M., Serebrenik, A., Wiese, I., Steinmacher, I., and Gerosa, M. A. (2020a). What to expect from code review bots on GitHub? a survey with OSS maintainers. In Proceedings of the SBES 2020 Ideias Inovadoras e Resultados Emergentes.
Wessel, M., Serebrenik, A., Wiese, I. S., Steinmacher, I., and Gerosa, M. A. (2020b). Effects of adopting code review bots on pull requests to oss projects. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution. IEEE Computer Society.
Woods, D. D. and Patterson, E. S. (2001). How unexpected events produce an escalation of cognitive and coordinative demands. PA Hancock, & PA Desmond, Stress, workload, and fatigue. Mahwah, NJ: L. Erlbaum.
Wyrich, M. and Bogner, J. (2019). Towards an autonomous bot for automatic source code refactoring. In Proceedings of the 1st International Workshop on Bots in Software Engineering, BotSE '19, pages 24-28, Piscataway, NJ, USA. IEEE Press.
Yu, Y., Wang, H., Filkov, V., Devanbu, P., and Vasilescu, B. (2015). Wait for it: Determinants of pull request evaluation latency on GitHub. In 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories, pages 367-371.
Blythe, M. (2014). Research through design fiction: narrative in real and imaginary abstracts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 703-712. ACM.
Brown, C. and Parnin, C. (2019). Sorry to bother you: Designing bots for effective recommendations. In Proceedings of the 1st International Workshop on Bots in Software Engineering, BotSE '19, pages 54-58, Piscataway, NJ, USA. IEEE Press.
Carvalho, A., Luz, W., Marcilio, D., Bonifacio, R., Pinto, G., and Canedo, E. D. (2020). C-3pr: A bot for fixing static analysis violations via pull requests. In 2020 IEEE 27th International Conference on Software Analysis, Evolution and Reengineering (SANER), pages 161-171. IEEE.
Chaves, A. P. and Gerosa, M. A. (2018). Single or multiple conversational agents? an interactional coherence comparison. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pages 1-13.
Dagli, M. (2019). Designing for Trust. PhD thesis, figshare.
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly, pages 319-340.
Glaser, B. G. and Strauss, A. L. (2017). Discovery of grounded theory: Strategies for qualitative research. Routledge.
Gousios, G., Storey, M.-A., and Bacchelli, A. (2016). Work practices and challenges in pull-based development: The contributor's perspective. In Proceedings of the 38th International Conference on Software Engineering, ICSE '16, pages 285-296, New York, NY, USA. ACM.
Healy, T. (2012). The unanticipated consequences of technology. Nanotechnology: ethical and social Implications, pages 155-173.
Kavaler, D., Trockman, A., Vasilescu, B., and Filkov, V. (2019). Tool choice matters: Javascript quality assurance tools and usage outcomes in github projects. In Proceedings of the 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE), pages 476-487.
Liu, D., Smith, M. J., and Veeramachaneni, K. (2020). Understanding user-bot interactions for small-scale automation in open-source development. In Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, CHI EA '20, page 1-8, New York, NY, USA. Association for Computing Machinery.
McIntosh, S., Kamei, Y., Adams, B., and Hassan, A. E. (2014). The impact of code review coverage and code review participation on software quality: A case study of the qt, vtk, and itk projects. In Proceedings of the 11th Working Conference on Mining Software Repositories, pages 192-201.
Mirhosseini, S. and Parnin, C. (2017). Can automated pull requests encourage software developers to upgrade out-of-date dependencies? In Proceedings of the 32nd IEEE/ACM International Conference on Automated Software Engineering, ASE 2017, pages 84-94, Piscataway, NJ, USA. IEEE Press.
Monperrus, M. (2019). Explainable software bot contributions: Case study of automated bug fixes. In Proceedings of the 1st International Workshop on Bots in Software Engineering, BotSE '19, pages 12-15, Piscataway, NJ, USA. IEEE Press.
Mulder, K. (2013). Impact of new technologies: how to assess the intended and unintended effects of new technologies. Handb. Sustain. Eng.(2013).
Nematzadeh, A., Ciampaglia, G. L., Ahn, Y.-Y., and Flammini, A. (2016). Information overload in group communication: From conversation to cacophony in the twitch chat. Royal Society open science, 6(10):191412.
Paikari, E. and van der Hoek, A. (2018). A framework for understanding chatbots and their future. In Proceedings of the 11th International Workshop on Cooperative and Human Aspects of Software Engineering, CHASE '18, pages 13-16, New York, NY, USA. ACM.
Peng, Z. and Ma, X. (2019). Exploring how software developers work with mention bot in github. CCF Transactions on Pervasive Computing and Interaction, 1(3):190-203.
Sadeddin, K. W., Serenko, A., and Hayes, J. (2007). Online shopping bots for electronic commerce: the comparison of functionality and performance. International Journal of Electronic Business, 5(6):576.
Serban, D., Golsteijn, B., Holdorp, R., and Serebrenik, A. (2021). Saw-bot: Proposing fixes for static analysis warnings with github suggestions. In Workshop on Bots in Software Engineering, United States. IEEE Computer Society.
Steinmacher, I., Conte, T. U., Treude, C., and Gerosa, M. A. (2016). Overcoming open source project entry barriers with a portal for newcomers. In Proceedings of the 38th International Conference on Software Engineering, ICSE '16, pages 273-284, New York, NY, USA. ACM.
Steinmacher, I., Wiese, I., Chaves, A. P., and Gerosa, M. A. (2013). Why do newcomers abandon open source software projects? In 2013 6th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE), pages 25-32. IEEE.
Storey, M.-A., Serebrenik, A., Rosé, C. P., Zimmermann, T., and Herbsleb, J. D. (2020). BOTse: Bots in Software Engineering (Dagstuhl Seminar 19471). Dagstuhl Reports, 9(11):84-96.
Storey, M.-A. and Zagalsky, A. (2016). Disrupting developer productivity one bot at a time. In Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2016, pages 928-931, New York, NY, USA. ACM.
Strauss, A. and Corbin, J. M. (1997). Grounded theory in practice. Sage.
Thistlethwaite, D. L. and Campbell, D. T. (1960). Regression-discontinuity analysis: An alternative to the ex post facto experiment. Journal of Educational psychology, 51(6):309.
Tsay, J., Dabbish, L., and Herbsleb, J. (2014). Let's talk about it: Evaluating contributions through discussion in github. In Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2014, pages 144-154, New York, NY, USA. ACM.
Urli, S., Yu, Z., Seinturier, L., and Monperrus, M. (2018). How to design a program repair bot?: insights from the repairnator project. In Proceedings of the 40th International Conference on Software Engineering: Software Engineering in Practice, pages 95-104. ACM.
Vasilescu, B., Yu, Y., Wang, H., Devanbu, P., and Filkov, V. (2015). Quality and productivity outcomes relating to continuous integration in github. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2015, page 805-816, New York, NY, USA. Association for Computing Machinery.
Wessel, M., de Souza, B. M., Steinmacher, I., Wiese, I. S., Polato, I., Chaves, A. P., and Gerosa, M. A. (2018). The power of bots: Characterizing and understanding bots in oss projects. Proc. ACM Hum.-Comput. Interact., 2(CSCW):182:1-182:19.
Wessel, M., Serebrenik, A., Wiese, I., Steinmacher, I., and Gerosa, M. A. (2020a). What to expect from code review bots on GitHub? a survey with OSS maintainers. In Proceedings of the SBES 2020 Ideias Inovadoras e Resultados Emergentes.
Wessel, M., Serebrenik, A., Wiese, I. S., Steinmacher, I., and Gerosa, M. A. (2020b). Effects of adopting code review bots on pull requests to oss projects. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution. IEEE Computer Society.
Woods, D. D. and Patterson, E. S. (2001). How unexpected events produce an escalation of cognitive and coordinative demands. PA Hancock, & PA Desmond, Stress, workload, and fatigue. Mahwah, NJ: L. Erlbaum.
Wyrich, M. and Bogner, J. (2019). Towards an autonomous bot for automatic source code refactoring. In Proceedings of the 1st International Workshop on Bots in Software Engineering, BotSE '19, pages 24-28, Piscataway, NJ, USA. IEEE Press.
Yu, Y., Wang, H., Filkov, V., Devanbu, P., and Vasilescu, B. (2015). Wait for it: Determinants of pull request evaluation latency on GitHub. In 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories, pages 367-371.
Publicado
03/10/2022
Como Citar
WESSEL, Mairieli; STEINMACHER, Igor; GEROSA, Marco A..
Perception of Software Bots on Pull Requests on Social Coding Environments. In: CONCURSO DE TESES E DISSERTAÇÕES EM ENGENHARIA DE SOFTWARE (CTD-ES) - CONGRESSO BRASILEIRO DE SOFTWARE: TEORIA E PRÁTICA (CBSOFT), 13. , 2022, Uberlândia/MG.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
p. 65-76.
DOI: https://doi.org/10.5753/cbsoft_estendido.2022.225620.
