Investigando os métodos de avaliação de usabilidade para sistemas colaborativos: uma revisão sistemática da literatura
Resumo
A partir de um mapeamento sistemático da literatura, este artigo busca identificar o cenário atual de métodos de avaliação de usabilidade para sistemas colaborativos. Esse tipo de avaliação torna-se um desafio, pois pode haver problemas que só são identificados em situações de colaboração, uma vez que os métodos utilizados para avaliar sistemas não colaborativos não conseguem explorar esses aspectos. 0 mapeamento foi realizado por meio das bibliotecas digitais totalizando 90 artigos encontrados, e após a aplicação dos critérios de inclusão e exclusão, 15 artigos foram analisados. Os resultados descrevem os métodos alcançados mais utilizados nas avaliações.Referências
Almeida, L. D. A. and Baranauskas, M. C. C. (2008). Um prospecto de sistemas colaborativos: modelos e frameworks. In Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems, pages 204-213.
Athukorala, K., Micallef, L., An, C., Reijonen, A., Peltonen, J., Ruotsalo, T., and Jacucci, G. (2017). Visualizing activity traces to support collaborative literature searching. In Proceedings of the 10th International Symposium on Visual Information Communication and Interaction, pages 45-52.
Barbosa, S. D. J., Silva, B. S. d., Silveira, M. S., Gasparini, I., Darin, T., and Barbosa, G. D. J. (2021). Interação Humano-Computador e Experiência do Usuário. Autopublicação.
Bringas, S., Duque, R., Nieto-Reyes, A., Tîrnăucă, C., and Montaña, J. L. (2021). A framework for identifying sequences of interactions that cause usability problems in collaborative systems. Electronics, 10(4):388.
Dew, K., Turner, A. M., Desai, L., Martin, N., and Kirchhoff, K. (2015). Evaluating groupware prototypes with discount methods. In Proceedings of the 18th ACM conference companion on computer supported cooperative work & social computing, pages 183–186.
Geszten, D., Hámomik, B. P., and Hercegfi, K. (2017). Measurement of team mental model as a part of a new team usability testing method: A proposed research agenda. In 2017 8th IEEE International Conference on Cognitive Infocommunications (CoglnfoCom), pages 000291-000294. IEEE.
Geszten, D., Hámornik, B. P., and Hercegfi, K. (2018). Exploring awareness related usability problems of collaborative software with a team usability testing approach. In 2018 9th IEEE International Conference on Cognitive Infocommunications (CoglnfoCom), pages 000045-000050. IEEE.
Geszten, D., Hámornik, B. P., and Hercegfi, K. (2019). Usability evaluation of a collaborative design software in the wild. In 2019 10th IEEE International Conference on Cognitive Infocommunications (CoglnfoCom), pages 101–106. IEEE.
Geszten, D., Hámornik, B. P., and Hercegfi, K. (2020). Empirical study of team usability testing: a laboratory experiment. Cognition, Technology & Work, pages 1-15.
Khadka, R., Money, J. H., and Banic, A. (2018). Evaluation of scientific workflow effectiveness for a distributed multi-user multi-platform support system for collaborative visualization. In Proceedings of the Practice and Experience on Advanced Research Computing, pages 1-8.
Krischkowsky, A., Weiss, A., Osswald, S., and Tscheligi, M. (2013). Evaluating a social media platform in a large-scale international company: A five action approach. In 2013 International Conference on Collaboration Technologies and Systems (CTS), pages 99–106. IEEE.
Kurahashi, A. M., Stinson, J. N., van Wyk, M., Luca, S., Jamieson, T., Weinstein, P., Cafazzo, J. A., Lokuge, B., Cohen, E., Rapoport, A., et al. (2018). The perceived ease of use and usefulness of loop: evaluation and content analysis of a web-based clinical collaboration system. JMIR human factors, 5(1):e7882.
Li, J., Zhang, D., and Zhang, P. (2013). Supporting dynamic situation awareness in on-line group discussion: A visualization approach. In 2013 46th Hawaii International Conference on System Sciences, pages 470-479. IEEE.
Medina, R. D. and Nieto-Reyes, A. (2015). Measuring the usability of groupware applications with a model-driven method for the user interaction analysis. In Proceedings of the XVI International Conference on Human Computer Interaction, pages 1-2.
Prates, R. O. (2011). Interação em sistemas colaborativos. Sistemas Colaborativos. Rio de Janeiro: Elsevier, pages 264-293.
Santos, N. S., Ferreira, L. S., and Prates, R. O. (2012). An overview of evaluation methods for collaborative systems. In 2012 Brazilian Symposium on Collaborative Systems, pages 127–135. IEEE.
Sosa-García, J. and Odone, F. (2017). “hands on" visual recognition for visually impaired users. ACM Transactions on Accessible Computing (TACCESS), 10(3):1–30.
Teo, T., F. Hayati, A., A. Lee, G., Billinghurst, M., and Adcock, M. (2019). A technique for mixed reality remote collaboration using 360 panoramas in 3d reconstructed scenes. In 25th ACM Symposium on Virtual Reality Software and Technology, pages 1-11.
Torres, M. J. R., Barwaldt, R., Pinho, P. C. R., de Topin, L. O. H., and Otero, T. F. (2020). An auditory interface to workspace awareness elements accessible for the blind in diagrams' collaborative modeling. In 2020 IEEE Frontiers in Education Conference (FIE), pages 1-7. IEEE.
Winckler, M. and Pimenta, M. S. (2002). Avaliação de usabilidade de sites web. Escola de Informática da SBC Sul (ERI 2002). Porto Alegre, 1:85–137.
Athukorala, K., Micallef, L., An, C., Reijonen, A., Peltonen, J., Ruotsalo, T., and Jacucci, G. (2017). Visualizing activity traces to support collaborative literature searching. In Proceedings of the 10th International Symposium on Visual Information Communication and Interaction, pages 45-52.
Barbosa, S. D. J., Silva, B. S. d., Silveira, M. S., Gasparini, I., Darin, T., and Barbosa, G. D. J. (2021). Interação Humano-Computador e Experiência do Usuário. Autopublicação.
Bringas, S., Duque, R., Nieto-Reyes, A., Tîrnăucă, C., and Montaña, J. L. (2021). A framework for identifying sequences of interactions that cause usability problems in collaborative systems. Electronics, 10(4):388.
Dew, K., Turner, A. M., Desai, L., Martin, N., and Kirchhoff, K. (2015). Evaluating groupware prototypes with discount methods. In Proceedings of the 18th ACM conference companion on computer supported cooperative work & social computing, pages 183–186.
Geszten, D., Hámomik, B. P., and Hercegfi, K. (2017). Measurement of team mental model as a part of a new team usability testing method: A proposed research agenda. In 2017 8th IEEE International Conference on Cognitive Infocommunications (CoglnfoCom), pages 000291-000294. IEEE.
Geszten, D., Hámornik, B. P., and Hercegfi, K. (2018). Exploring awareness related usability problems of collaborative software with a team usability testing approach. In 2018 9th IEEE International Conference on Cognitive Infocommunications (CoglnfoCom), pages 000045-000050. IEEE.
Geszten, D., Hámornik, B. P., and Hercegfi, K. (2019). Usability evaluation of a collaborative design software in the wild. In 2019 10th IEEE International Conference on Cognitive Infocommunications (CoglnfoCom), pages 101–106. IEEE.
Geszten, D., Hámornik, B. P., and Hercegfi, K. (2020). Empirical study of team usability testing: a laboratory experiment. Cognition, Technology & Work, pages 1-15.
Khadka, R., Money, J. H., and Banic, A. (2018). Evaluation of scientific workflow effectiveness for a distributed multi-user multi-platform support system for collaborative visualization. In Proceedings of the Practice and Experience on Advanced Research Computing, pages 1-8.
Krischkowsky, A., Weiss, A., Osswald, S., and Tscheligi, M. (2013). Evaluating a social media platform in a large-scale international company: A five action approach. In 2013 International Conference on Collaboration Technologies and Systems (CTS), pages 99–106. IEEE.
Kurahashi, A. M., Stinson, J. N., van Wyk, M., Luca, S., Jamieson, T., Weinstein, P., Cafazzo, J. A., Lokuge, B., Cohen, E., Rapoport, A., et al. (2018). The perceived ease of use and usefulness of loop: evaluation and content analysis of a web-based clinical collaboration system. JMIR human factors, 5(1):e7882.
Li, J., Zhang, D., and Zhang, P. (2013). Supporting dynamic situation awareness in on-line group discussion: A visualization approach. In 2013 46th Hawaii International Conference on System Sciences, pages 470-479. IEEE.
Medina, R. D. and Nieto-Reyes, A. (2015). Measuring the usability of groupware applications with a model-driven method for the user interaction analysis. In Proceedings of the XVI International Conference on Human Computer Interaction, pages 1-2.
Prates, R. O. (2011). Interação em sistemas colaborativos. Sistemas Colaborativos. Rio de Janeiro: Elsevier, pages 264-293.
Santos, N. S., Ferreira, L. S., and Prates, R. O. (2012). An overview of evaluation methods for collaborative systems. In 2012 Brazilian Symposium on Collaborative Systems, pages 127–135. IEEE.
Sosa-García, J. and Odone, F. (2017). “hands on" visual recognition for visually impaired users. ACM Transactions on Accessible Computing (TACCESS), 10(3):1–30.
Teo, T., F. Hayati, A., A. Lee, G., Billinghurst, M., and Adcock, M. (2019). A technique for mixed reality remote collaboration using 360 panoramas in 3d reconstructed scenes. In 25th ACM Symposium on Virtual Reality Software and Technology, pages 1-11.
Torres, M. J. R., Barwaldt, R., Pinho, P. C. R., de Topin, L. O. H., and Otero, T. F. (2020). An auditory interface to workspace awareness elements accessible for the blind in diagrams' collaborative modeling. In 2020 IEEE Frontiers in Education Conference (FIE), pages 1-7. IEEE.
Winckler, M. and Pimenta, M. S. (2002). Avaliação de usabilidade de sites web. Escola de Informática da SBC Sul (ERI 2002). Porto Alegre, 1:85–137.
Publicado
25/04/2022
Como Citar
CORDOVA, Karine Alessandra; SANTOS, Maria Teresa Silva; PIMENTEL, Claudia; GASPARINI, Isabela.
Investigando os métodos de avaliação de usabilidade para sistemas colaborativos: uma revisão sistemática da literatura. In: SIMPÓSIO BRASILEIRO DE SISTEMAS COLABORATIVOS (SBSC), 17. , 2022, Online.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
p. 52-61.
ISSN 2326-2842.
DOI: https://doi.org/10.5753/sbsc.2022.19475.
