Avaliação Heurística Combinada de uma Plataforma Colaborativa de Monitoramento e Avaliação de Educação Ambiental
Resumo
Este artigo apresenta uma avaliação heurística da plataforma MonitoraEA, o sistema de avaliação de iniciativas de Educação Ambiental no Brasil. A metodologia utilizada incluiu heurísticas tradicionais de usabilidade e específicas para visualização de dados e interface web. Além de contar com heurísticas para sistemas colaborativos coletadas em uma revisão rápida da literatura. Como resultado, recomendações foram propostas para aprimorar a experiência do usuário da plataforma e servem de base para outras avaliações no contexto colaborativo.
Referências
ABEPTIC, Associação Brasileira de Empresas de Pesquisa em Tecnologia da Informação e Comunicação. (2022). Guia de uso da linguagem para apresentação de serviços públicos. Disponível em: [link]. Acesso em: 11 mar. 2025.
Almenara, A. P., Saltiveri, T. G., Navarro, J. E. G., & Mitjaneta, M. A. (2024). Enhancing Usability Assessment with a Novel Heuristics-Based Approach Validated in an Actual Business Setting. Journal on Interactive Systems, 15(1), 615-631.
Andrade R, M. H., Albiach B, E., Biasoli, S., Sorrentino, M., & Maranhão, R. (2018). Indicadores de monitoreo e avaliación de proxectos e políticas pu ́blicas de educación ambiental no Brasil. AmbientalMENTEsustentable, 23-24(1), 25–39. DOI: 10.17979/ams.2017.23-24.1.3364
Apraiz, A., Mulet Alberola, J. A., Lasa, G., Mazmela, M., & Nguyen, H. N. (2023). Development of a new set of Heuristics for the evaluation of Human-Robot Interaction in industrial settings: Heuristics Robots Experience (HEUROBOX). Frontiers in Robotics and AI, 10, 1227082.
Baker, K., Greenberg, S., & Gutwin, C. (2002). Empirical development of a heuristic evaluation methodology for shared workspace groupware. In Proceedings of the 2002 ACM conference on Computer supported cooperative work (pp. 96-105).
Cartaxo, B., Pinto, G., & Soares, S. (2018). The role of rapid reviews in supporting decision-making in software engineering practice. In Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018 (pp. 24-34).
Castro, R., Araújo, A. A., Soares, P., Paixao, M., Maia, P. H. M., & Souza, J. (2021). Proposta de mapa interativo e colaborativo para ecossistemas de inovação: Um estudo de caso baseado no estado do Ceará. In Simpósio Brasileiro de Sistemas Colaborativos (SBSC) (pp. 59-70). SBC.
Cordova, K. A., Santos, M. T. S., Pimentel, C., & Gasparini, I. (2022). Investigando os métodos de avaliação de usabilidade para sistemas colaborativos: uma revisão sistemática da literatura. Simpósio Brasileiro de Sistemas Colaborativos (SBSC).
de Franceschi, V. D., Fontoura, L. M., & Silva, M. A. R. (2020). Tabletop Interface Design: Developing and Using Usability Heuristics. In International Conference on Enterprise Information Systems (pp. 708-729). Cham: Springer International Publishing.
Doumanis, I., & Economou, D. (2019). Affective Communication between ECAs and Users in Collaborative Virtual Environments: The REVERIE European Parliament Use Case. Multimodal Technologies and Interaction, 3(1), 7.
Drubscky, L. (2021). O que é Escaneabilidade? Produza textos melhores facilitando a leitura! Rock Content - BR. [link]. Acesso em 07. mar. 2025.
Franklin, F., Breyer, F., & Kelner, J. (2014). Usability heuristics for collaborative augmented reality remote systems. In 2014 XVI Symposium on Virtual and Augmented Reality (pp. 53-62). IEEE.
Friess, E. (2015). Personas in heuristic evaluation: an exploratory study. IEEE Transactions on Professional Communication, 58(2), 176-191.
Frijns, H. A., & Schmidbauer, C. (2021). Design guidelines for collaborative industrial robot user interfaces. In Human-Computer Interaction–INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30–September 3, 2021, Proceedings, Part III 18 (pp. 407-427). Springer International Publishing.
Gallardo, J., Molina, A. I., Bravo, C., Redondo, M. Á., & Collazos, C. A. (2011). Empirical and heuristic-based evaluation of collaborative modeling systems: an evaluation framework. Group Decision and Negotiation, 20, 535-562.
Geszten, D., Hámornik, B. P., & Hercegfi, K. (2024). Team usability testing: development and validation of a groupware usability evaluation method. Cognition, Technology & Work, 26(3), 487-506.
Ha, S., Ho, S. H., Bae, Y. H., Lee, M., Kim, J. H., Kim, J. H., & Lee, J. (2023). Digital health equity and tailored health care service for people with disability: user-centered design and usability study. Journal of Medical Internet Research, 25, e50029.
Herrmann, T., Jahnke, I., & Nolte, A. (2022). A problem-based approach to the advancement of heuristics for socio-technical evaluation. Behaviour & Information Technology, 41(14), 3087-3109.
Jaferian, P., Hawkey, K., Sotirakopoulos, A., Velez-Rojas, M., & Beznosov, K. (2011). Heuristics for evaluating IT security management tools. In Proceedings of the Seventh Symposium on Usable Privacy and Security (pp. 1-20).
Krischkowsky, A., Weiss, A., Osswald, S., & Tscheligi, M. (2013). Evaluating a social media platform in a large-scale international company: A five action approach. In 2013 International Conference on Collaboration Technologies and Systems (CTS) (pp. 99-106). IEEE.
Ladis. (2016). Sistema MonitoraEA | Ladis. Disponível em: [link]. Acesso em 22. mar. 2025.
Lopes, L. A., Guilhermino, D. F., Coleti, T. A., Sgarbi, E. M., & de Oliveira, T. F. (2015). Heuristic to support the sociability evaluation in virtual communities of practices. In Human-Computer Interaction: Users and Contexts: 17th International Conference, HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, Part III 17 (pp. 3-14). Springer International Publishing.
Luna, H., Mendoza, R., Vargas, M., Munoz, J., Alvarez, F. J., & Rodriguez, L. C. (2015). Using design patterns as usability heuristics for mobile groupware systems. IEEE Latin America Transactions, 13(12), 4004-4010.
Mazlan, M. F. B., Sivaji, A., Tzuaan, S. S., & Lokman, A. M. (2012). Enhancing the heuristic evaluation (HE) by development and validation of a collaborative design measurement system (CDMS): Collaborative design and measurement system for designers and testers. In 2012 IEEE Colloquium on Humanities, Science and Engineering (CHUSER) (pp. 473-478). IEEE.
Munoz, R., & Chalegre, V. (2012). Defining virtual worlds usability heuristics. In 2012 Ninth International Conference on Information Technology-New Generations (pp. 690-695). IEEE.
Nielsen, J. (1994). 10 Usability Heuristics for User Interface Design. Computer Science. Disponível em: [link]. Acesso em 20 fev. 2025.
Oliveira, R., Cappelli, C., & Oliveira, J. (2023). Gráficos em Linguagem Simples. Sociedade Brasileira de Computação. DOI: 10.5753/sbc.12145.5
Quiñones, D., & Rusu, C. (2017). How to develop usability heuristics: A systematic literature review. Computer standards & interfaces, 53, 89-122.
Raymundo, M. H. A., Branco, E. A., Biasoli, S. A., & Sorrentino, M. (2019). MonitoraEA: processo participativo para a construção do sistema brasileiro de Monitoramento e avaliação de políticas públicas de educação ambiental. Avaliação e monitoramento de políticas públicas de educação ambiental no Brasil, 27.
Santos, N. S., Ferreira, L. S., & Prates, R. O. (2012). An overview of evaluation methods for collaborative systems. In 2012 Brazilian Symposium on Collaborative Systems (pp. 127-135). IEEE.
Souza, E. C., Costa, R., Gomes, G., Galvao, L., Lauschner, T., & Gadelha, B. (2024). Match Musical: Avaliando a UX de Recursos Colaborativos no Spotify. In Simpósio Brasileiro de Sistemas Colaborativos (SBSC) (pp. 98-111). SBC.
Steves, M. P., Morse, E., Gutwin, C., & Greenberg, S. (2001). A comparison of usage evaluation and inspection methods for assessing groupware usability. In Proceedings of the 2001 ACM International Conference on Supporting Group Work (pp. 125-134).
Viol, R. S., Fernandes, P. C., Lacerda, I. I., Melo, K. G. F., Nunes, A. J. D. A., Pimenta, A. S. G., ... & Delabrida, S. (2025). EduVR Collab: A tool for management immersive collaborative learning. Journal on Interactive Systems, 16(1), 120-136.
Ward, W. S., & Given, L. M. (2019). Assessing intercultural communication: Testing technology tools for information sharing in multinational research teams. Journal of the Association for Information Science and Technology, 70(4), 338-350.
W3C. (2018). ActivityPub. Disponível em: [link]. Acesso em 20 abr. 2025.
Yablonski, J. (2024). Jakob’s Law. Laws of UX. Disponível em: [link]. Acesso em 07. mar. 2025.
Almenara, A. P., Saltiveri, T. G., Navarro, J. E. G., & Mitjaneta, M. A. (2024). Enhancing Usability Assessment with a Novel Heuristics-Based Approach Validated in an Actual Business Setting. Journal on Interactive Systems, 15(1), 615-631.
Andrade R, M. H., Albiach B, E., Biasoli, S., Sorrentino, M., & Maranhão, R. (2018). Indicadores de monitoreo e avaliación de proxectos e políticas pu ́blicas de educación ambiental no Brasil. AmbientalMENTEsustentable, 23-24(1), 25–39. DOI: 10.17979/ams.2017.23-24.1.3364
Apraiz, A., Mulet Alberola, J. A., Lasa, G., Mazmela, M., & Nguyen, H. N. (2023). Development of a new set of Heuristics for the evaluation of Human-Robot Interaction in industrial settings: Heuristics Robots Experience (HEUROBOX). Frontiers in Robotics and AI, 10, 1227082.
Baker, K., Greenberg, S., & Gutwin, C. (2002). Empirical development of a heuristic evaluation methodology for shared workspace groupware. In Proceedings of the 2002 ACM conference on Computer supported cooperative work (pp. 96-105).
Cartaxo, B., Pinto, G., & Soares, S. (2018). The role of rapid reviews in supporting decision-making in software engineering practice. In Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018 (pp. 24-34).
Castro, R., Araújo, A. A., Soares, P., Paixao, M., Maia, P. H. M., & Souza, J. (2021). Proposta de mapa interativo e colaborativo para ecossistemas de inovação: Um estudo de caso baseado no estado do Ceará. In Simpósio Brasileiro de Sistemas Colaborativos (SBSC) (pp. 59-70). SBC.
Cordova, K. A., Santos, M. T. S., Pimentel, C., & Gasparini, I. (2022). Investigando os métodos de avaliação de usabilidade para sistemas colaborativos: uma revisão sistemática da literatura. Simpósio Brasileiro de Sistemas Colaborativos (SBSC).
de Franceschi, V. D., Fontoura, L. M., & Silva, M. A. R. (2020). Tabletop Interface Design: Developing and Using Usability Heuristics. In International Conference on Enterprise Information Systems (pp. 708-729). Cham: Springer International Publishing.
Doumanis, I., & Economou, D. (2019). Affective Communication between ECAs and Users in Collaborative Virtual Environments: The REVERIE European Parliament Use Case. Multimodal Technologies and Interaction, 3(1), 7.
Drubscky, L. (2021). O que é Escaneabilidade? Produza textos melhores facilitando a leitura! Rock Content - BR. [link]. Acesso em 07. mar. 2025.
Franklin, F., Breyer, F., & Kelner, J. (2014). Usability heuristics for collaborative augmented reality remote systems. In 2014 XVI Symposium on Virtual and Augmented Reality (pp. 53-62). IEEE.
Friess, E. (2015). Personas in heuristic evaluation: an exploratory study. IEEE Transactions on Professional Communication, 58(2), 176-191.
Frijns, H. A., & Schmidbauer, C. (2021). Design guidelines for collaborative industrial robot user interfaces. In Human-Computer Interaction–INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30–September 3, 2021, Proceedings, Part III 18 (pp. 407-427). Springer International Publishing.
Gallardo, J., Molina, A. I., Bravo, C., Redondo, M. Á., & Collazos, C. A. (2011). Empirical and heuristic-based evaluation of collaborative modeling systems: an evaluation framework. Group Decision and Negotiation, 20, 535-562.
Geszten, D., Hámornik, B. P., & Hercegfi, K. (2024). Team usability testing: development and validation of a groupware usability evaluation method. Cognition, Technology & Work, 26(3), 487-506.
Ha, S., Ho, S. H., Bae, Y. H., Lee, M., Kim, J. H., Kim, J. H., & Lee, J. (2023). Digital health equity and tailored health care service for people with disability: user-centered design and usability study. Journal of Medical Internet Research, 25, e50029.
Herrmann, T., Jahnke, I., & Nolte, A. (2022). A problem-based approach to the advancement of heuristics for socio-technical evaluation. Behaviour & Information Technology, 41(14), 3087-3109.
Jaferian, P., Hawkey, K., Sotirakopoulos, A., Velez-Rojas, M., & Beznosov, K. (2011). Heuristics for evaluating IT security management tools. In Proceedings of the Seventh Symposium on Usable Privacy and Security (pp. 1-20).
Krischkowsky, A., Weiss, A., Osswald, S., & Tscheligi, M. (2013). Evaluating a social media platform in a large-scale international company: A five action approach. In 2013 International Conference on Collaboration Technologies and Systems (CTS) (pp. 99-106). IEEE.
Ladis. (2016). Sistema MonitoraEA | Ladis. Disponível em: [link]. Acesso em 22. mar. 2025.
Lopes, L. A., Guilhermino, D. F., Coleti, T. A., Sgarbi, E. M., & de Oliveira, T. F. (2015). Heuristic to support the sociability evaluation in virtual communities of practices. In Human-Computer Interaction: Users and Contexts: 17th International Conference, HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, Part III 17 (pp. 3-14). Springer International Publishing.
Luna, H., Mendoza, R., Vargas, M., Munoz, J., Alvarez, F. J., & Rodriguez, L. C. (2015). Using design patterns as usability heuristics for mobile groupware systems. IEEE Latin America Transactions, 13(12), 4004-4010.
Mazlan, M. F. B., Sivaji, A., Tzuaan, S. S., & Lokman, A. M. (2012). Enhancing the heuristic evaluation (HE) by development and validation of a collaborative design measurement system (CDMS): Collaborative design and measurement system for designers and testers. In 2012 IEEE Colloquium on Humanities, Science and Engineering (CHUSER) (pp. 473-478). IEEE.
Munoz, R., & Chalegre, V. (2012). Defining virtual worlds usability heuristics. In 2012 Ninth International Conference on Information Technology-New Generations (pp. 690-695). IEEE.
Nielsen, J. (1994). 10 Usability Heuristics for User Interface Design. Computer Science. Disponível em: [link]. Acesso em 20 fev. 2025.
Oliveira, R., Cappelli, C., & Oliveira, J. (2023). Gráficos em Linguagem Simples. Sociedade Brasileira de Computação. DOI: 10.5753/sbc.12145.5
Quiñones, D., & Rusu, C. (2017). How to develop usability heuristics: A systematic literature review. Computer standards & interfaces, 53, 89-122.
Raymundo, M. H. A., Branco, E. A., Biasoli, S. A., & Sorrentino, M. (2019). MonitoraEA: processo participativo para a construção do sistema brasileiro de Monitoramento e avaliação de políticas públicas de educação ambiental. Avaliação e monitoramento de políticas públicas de educação ambiental no Brasil, 27.
Santos, N. S., Ferreira, L. S., & Prates, R. O. (2012). An overview of evaluation methods for collaborative systems. In 2012 Brazilian Symposium on Collaborative Systems (pp. 127-135). IEEE.
Souza, E. C., Costa, R., Gomes, G., Galvao, L., Lauschner, T., & Gadelha, B. (2024). Match Musical: Avaliando a UX de Recursos Colaborativos no Spotify. In Simpósio Brasileiro de Sistemas Colaborativos (SBSC) (pp. 98-111). SBC.
Steves, M. P., Morse, E., Gutwin, C., & Greenberg, S. (2001). A comparison of usage evaluation and inspection methods for assessing groupware usability. In Proceedings of the 2001 ACM International Conference on Supporting Group Work (pp. 125-134).
Viol, R. S., Fernandes, P. C., Lacerda, I. I., Melo, K. G. F., Nunes, A. J. D. A., Pimenta, A. S. G., ... & Delabrida, S. (2025). EduVR Collab: A tool for management immersive collaborative learning. Journal on Interactive Systems, 16(1), 120-136.
Ward, W. S., & Given, L. M. (2019). Assessing intercultural communication: Testing technology tools for information sharing in multinational research teams. Journal of the Association for Information Science and Technology, 70(4), 338-350.
W3C. (2018). ActivityPub. Disponível em: [link]. Acesso em 20 abr. 2025.
Yablonski, J. (2024). Jakob’s Law. Laws of UX. Disponível em: [link]. Acesso em 07. mar. 2025.
Publicado
02/06/2025
Como Citar
OLIVEIRA, Rodrigo; BRANCO, Evandro Albiach; ZYLBERGELD, Ricardo; AMORIM, Ana Maria.
Avaliação Heurística Combinada de uma Plataforma Colaborativa de Monitoramento e Avaliação de Educação Ambiental. In: SIMPÓSIO BRASILEIRO DE SISTEMAS COLABORATIVOS (SBSC), 20. , 2025, Manaus/AM.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2025
.
p. 190-202.
ISSN 2326-2842.
DOI: https://doi.org/10.5753/sbsc.2025.8382.
