Uma Abordagem para Apoiar Avaliações de Usabilidade em Sistemas Web com base em Mineração de Dados
Resumo
A usuabilidade é uma característica muito relevante em relação à qualidade de um sistema. Entretanto, avaliar a usabilidade de sistemas geralmente é muito oneroso e complexo. Apesar de existirem diversos métodos propostos com o intuito de mitigar tais desvantagens das avaliações tradicionais, geralmente eles necessitam da alocação de tempo e de participantes exclusivos para a sua realização. Este trabalho apresenta uma abordagem que visa eliminar essas desvantagens, possibilitando a realização de avaliações remotas em sistemas por meio da análise dos dados gerados pelo seu uso cotidiano. A abordagem faz uso de técnicas de agrupamento e mineração de dados para identificar possíveis pontos problemáticos. Uma avaliação da abordagem mostrou que ela foi capaz de encontrar problemas de usuabilidade importantes e que impactam diretamente na qualidade de uso de um sistema.
Palavras-chave:
Apoiar, Sistemas Web, Mineração de Dados
Referências
Ahmad, W. F. W., Sulaiman, S., and Johari, F. S. (2010). Usability management system (usemate): A web-based automated system for managing usability testing systematically. In User Science and Engineering (i-USEr), 2010 International Conference on,pages 110–115. IEEE.
Bruun, A., Gull, P., Hofmeister, L., and Stage, J. (2009). Let your users do the testing: A comparison of three remote asynchronous usability testing methods. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’09, pages 1619–1628, New York, NY, USA. ACM.
Castillo, J. C., Hartson, H. R., and Hix, D. (1998). Remote usability evaluation: can users report their own critical incidents? In CHI 98 Cconference Summary on Human Factors in Computing Systems, pages 253–254. ACM.
de Santana, V. F. and Baranauskas, M. C. C. (2015). Welfit: A remote evaluation tool for identifying web usage patterns through client-side logging. International Journal of Human-Computer Studies, 76:40–49.
de Vasconcelos, L. G. and Baldochi Jr, L. A. (2012). Towards an automatic evaluation of web applications. In Proceedings of the 27th Annual ACM Symposium on Applied Computing, pages 709–716. ACM.
Fernandez, A., Abrahao, S., and Insfran, E. (2012). A systematic review on the effectiveness of web usability evaluation methods. In Evaluation & Assessment in Software Engineering (EASE 2012), 16th International Conference on, pages 52–56. IET.
Fernandez, A., Insfran, E., and Abrahao, S. (2011). Usability evaluation methods for theweb: A systematic mapping study. Information and Software Technology, 53(8):789 – 817. Advances in functional size measurement and effort estimation Extended best papers.
Flavian, C., Guinal ́ ́ıu, M., and Gurrea, R. (2006). The role played by perceived usability, satisfaction and consumer trust on website loyalty. Information & Management, 43(1):1–14.
Fournier-Viger, P., Gomariz, A., Campos, M., and Thomas, R. (2014). Fast vertical mining of sequential patterns using co-occurrence information. In Advances in Knowledge Discovery and Data Mining, pages 40–52. Springer.
Geng, R. and Tian, J. (2015). Improving web navigation usability by comparing actual and anticipated usage. IEEE Transactions on Human-Machine Systems, 45(1):84–94.
ISO (1998). Ergonomic requirements for office work with visual display terminals (VDTs) part 11: Guidance on usability, ISO 9241-11. International Organization for Standardization.
Ivory, M. Y. and Hearst, M. A. (2001). The state of the art in automating usability evaluation of user interfaces. ACM Comput. Surv., 33(4):470–516.
MacQueen, J. et al. (1967). Some methods for classification and analysis of multivariate observations. In Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, volume 1, pages 281–297. Oakland, CA, USA.
Martins, A. I., Queiros, A., Rocha, N. P., and Santos, B. S. (2013). Avaliação de usabilidade: uma revisao sistemática da literatura. RISTI-Revista Iberica de Sistemas e ́ Tecnologias de Informação , (11):31–43.
Mobasher, B. (2006). Web usage mining. Web data mining: Exploring hyperlinks, contents and usage data, 12.
Mueller, C., Tamir, D., Komogortsev, O., and Feldman, L. (2009). An economical approach to usability testing. In Computer Software and Applications Conference, 2009.COMPSAC ’09. 33rd Annual IEEE International, volume 1, pages 124–129.
Nielsen, J. (1994a). Usability engineering. Elsevier.
Nielsen, J. (1994b). Usability inspection methods. In Conference companion on Human factors in computing systems, pages 413–414. ACM.
Polson, P. G., Lewis, C., Rieman, J., and Wharton, C. (1992). Cognitive walkthroughs: a method for theory-based evaluation of user interfaces. International Journal of man- machine studies, 36(5):741–773.
Souza, M. M. C., Oliveira, P. A., Ribeiro, R. F., Britto, R. S., and Neto, P. S. (2015). Useskill: uma ferramenta de apoio a avaliação de usabilidade de sistemas web. XIV Simposio Brasileiro de Qualidade de Software (SBQS)
Srivastava, J., Cooley, R., Deshpande, M., and Tan, P.-N. (2000). Web usage mining: Discovery and applications of usage patterns from web data. Acm Sigkdd Explorations Newsletter, 1(2):12–23.
Tullis, T., Fleischman, S., McNulty, M., Cianchette, C., and Bergel, M. (2002). An empirical comparison of lab and remote usability testing of web sites. In Usability Professionals Association Conference.
Viera, A. J., Garrett, J. M., et al. (2005). Understanding interobserver agreement: the kappa statistic. Fam Med, 37(5):360–363.
Wohlin, C., Runeson, P., Host, M., Ohlsson, M. C., Regnell, B., and Wesslën, A. (2012). Experimentation in software engineering. Springer Science & Business Media.
Bruun, A., Gull, P., Hofmeister, L., and Stage, J. (2009). Let your users do the testing: A comparison of three remote asynchronous usability testing methods. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’09, pages 1619–1628, New York, NY, USA. ACM.
Castillo, J. C., Hartson, H. R., and Hix, D. (1998). Remote usability evaluation: can users report their own critical incidents? In CHI 98 Cconference Summary on Human Factors in Computing Systems, pages 253–254. ACM.
de Santana, V. F. and Baranauskas, M. C. C. (2015). Welfit: A remote evaluation tool for identifying web usage patterns through client-side logging. International Journal of Human-Computer Studies, 76:40–49.
de Vasconcelos, L. G. and Baldochi Jr, L. A. (2012). Towards an automatic evaluation of web applications. In Proceedings of the 27th Annual ACM Symposium on Applied Computing, pages 709–716. ACM.
Fernandez, A., Abrahao, S., and Insfran, E. (2012). A systematic review on the effectiveness of web usability evaluation methods. In Evaluation & Assessment in Software Engineering (EASE 2012), 16th International Conference on, pages 52–56. IET.
Fernandez, A., Insfran, E., and Abrahao, S. (2011). Usability evaluation methods for theweb: A systematic mapping study. Information and Software Technology, 53(8):789 – 817. Advances in functional size measurement and effort estimation Extended best papers.
Flavian, C., Guinal ́ ́ıu, M., and Gurrea, R. (2006). The role played by perceived usability, satisfaction and consumer trust on website loyalty. Information & Management, 43(1):1–14.
Fournier-Viger, P., Gomariz, A., Campos, M., and Thomas, R. (2014). Fast vertical mining of sequential patterns using co-occurrence information. In Advances in Knowledge Discovery and Data Mining, pages 40–52. Springer.
Geng, R. and Tian, J. (2015). Improving web navigation usability by comparing actual and anticipated usage. IEEE Transactions on Human-Machine Systems, 45(1):84–94.
ISO (1998). Ergonomic requirements for office work with visual display terminals (VDTs) part 11: Guidance on usability, ISO 9241-11. International Organization for Standardization.
Ivory, M. Y. and Hearst, M. A. (2001). The state of the art in automating usability evaluation of user interfaces. ACM Comput. Surv., 33(4):470–516.
MacQueen, J. et al. (1967). Some methods for classification and analysis of multivariate observations. In Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, volume 1, pages 281–297. Oakland, CA, USA.
Martins, A. I., Queiros, A., Rocha, N. P., and Santos, B. S. (2013). Avaliação de usabilidade: uma revisao sistemática da literatura. RISTI-Revista Iberica de Sistemas e ́ Tecnologias de Informação , (11):31–43.
Mobasher, B. (2006). Web usage mining. Web data mining: Exploring hyperlinks, contents and usage data, 12.
Mueller, C., Tamir, D., Komogortsev, O., and Feldman, L. (2009). An economical approach to usability testing. In Computer Software and Applications Conference, 2009.COMPSAC ’09. 33rd Annual IEEE International, volume 1, pages 124–129.
Nielsen, J. (1994a). Usability engineering. Elsevier.
Nielsen, J. (1994b). Usability inspection methods. In Conference companion on Human factors in computing systems, pages 413–414. ACM.
Polson, P. G., Lewis, C., Rieman, J., and Wharton, C. (1992). Cognitive walkthroughs: a method for theory-based evaluation of user interfaces. International Journal of man- machine studies, 36(5):741–773.
Souza, M. M. C., Oliveira, P. A., Ribeiro, R. F., Britto, R. S., and Neto, P. S. (2015). Useskill: uma ferramenta de apoio a avaliação de usabilidade de sistemas web. XIV Simposio Brasileiro de Qualidade de Software (SBQS)
Srivastava, J., Cooley, R., Deshpande, M., and Tan, P.-N. (2000). Web usage mining: Discovery and applications of usage patterns from web data. Acm Sigkdd Explorations Newsletter, 1(2):12–23.
Tullis, T., Fleischman, S., McNulty, M., Cianchette, C., and Bergel, M. (2002). An empirical comparison of lab and remote usability testing of web sites. In Usability Professionals Association Conference.
Viera, A. J., Garrett, J. M., et al. (2005). Understanding interobserver agreement: the kappa statistic. Fam Med, 37(5):360–363.
Wohlin, C., Runeson, P., Host, M., Ohlsson, M. C., Regnell, B., and Wesslën, A. (2012). Experimentation in software engineering. Springer Science & Business Media.
Publicado
24/10/2016
Como Citar
SOUZA, Matheus; RIBEIRO, Rafael; OLIVEIRA, Pedro Almir; SANTOS NETO, Pedro.
Uma Abordagem para Apoiar Avaliações de Usabilidade em Sistemas Web com base em Mineração de Dados. In: SIMPÓSIO BRASILEIRO DE QUALIDADE DE SOFTWARE (SBQS), 15. , 2016, Maceió.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2016
.
p. 271-285.
DOI: https://doi.org/10.5753/sbqs.2016.15140.
