ABSTRACT
Context: A heuristic evaluation is an investigation method used by practitioners to perform usability tests on interfaces. Problem: Notwithstanding the importance of a heuristic evaluation in the execution of usability tests, it is a lengthy process that requires practitioners to explore all parts of a system with critical and meticulous attention to detail. Solution: This work proposes the development of a tool called Tuhm to support practitioners in the execution of heuristic evaluations on mobile applications. IS Theory: Design Theory relates to the heuristic evaluation of the development process of systems and Software Systems Theory relates to the ethical aspect of tools. Method: A validation study was conducted in which specialists were divided into two groups to evaluate a given application using Tuhm. One group used Tuhm during evaluation, and the other group performed the manual analysis of the application. Summary of Results: Our findings reveal that Tuhm made the evaluation process faster and more objective. In addition, it is easy to use, having a fast data entry format and an organized categorization of the problems found. Contributions and Impact in the IS area: Our findings also revealed a difficulty for specialists in reading the set of usability heuristics, as it is an overlong set. Therefore, it was identified the need for improving the presentation of the usability heuristics.
- Carmelo Ardito, Rosa Lanzilotti, Paolo Buono, and Antonio Piccinno. 2006. A tool to support usability inspection. In Proceedings of the working conference on Advanced visual interfaces, AVI 2006, Venezia, Italy, May 23-26, 2006. ACM Press, 10.1145/1133265.1133322, 278–281.Google ScholarDigital Library
- Luca Ardito, Riccardo Coppola, Giovanni Malnati, and Marco Torchiano. 2020. Effectiveness of Kotlin vs. Java in android app development tasks. Inf. Softw. Technol. 127 (2020), 106374. https://doi.org/10.1016/j.infsof.2020.106374Google ScholarCross Ref
- Janne Bergman and Janne Vainio. 2010. Interacting with the flow. In Proceedings of the 12th Conference on Human-Computer Interaction with Mobile Devices and Services, Mobile HCI(ACM International Conference Proceeding Series). ACM, 10.1145/1851600.1851641, 249–252.Google ScholarDigital Library
- Ruyther Parente da Costa and Edna Dias Canedo. 2019. A Set of Usability Heuristics for Mobile Applications. In HCI (1)(Lecture Notes in Computer Science, Vol. 11566). Springer, https://doi.org/10.1007/978-3-030-22646-6_13, 180–193.Google ScholarDigital Library
- Ruyther Parente da Costa, Edna Dias Canedo, Rafael Timóteo de Sousa Júnior, Robson de Oliveira Albuquerque, and Luis Javier García-Villalba. 2019. Set of Usability Heuristics for Quality Assessment of Mobile Applications on Smartphones. IEEE Access 7 (2019), 116145–116161. https://doi.org/10.1109/ACCESS.2019.2910778Google ScholarCross Ref
- Walter Lucas Monteiro de Mendonça, Pedro Henrique Teixeira Costa, Emille Catarine Rodrigues Cançado, Fernanda Lima, Edna Dias Canedo, Rodrigo Bonifácio, and Luis Henrique Vieira Amaral. 2020. From Dusk till Dawn: Reflections on the Impact of COVID-19 on theDevelopment Practices of a R & D Project. In SBES ’20: 34th Brazilian Symposium on Software Engineering. ACM, 10.1145/3422392.3422446, 596–605.Google ScholarDigital Library
- Google. 2021. Android developers. https://developer.android.com/ accessed on 09/08/2021.Google Scholar
- Rodolfo Inostroza, Cristian Rusu, Silvana Roncagliolo, and Cristhy Jiménez Granizo. 2012. Usability Heuristics Validation through Empirical Evidences: A Touchscreen-Based Mobile Devices Proposal. In 31st International Conference of the Chilean Computer Science Society, SCCC 2012, Valparaíso, Chile. IEEE Computer Society, 10.1109/SCCC.2012.15, 60–68.Google ScholarDigital Library
- Sung Woo Kim, Han Kyung Jo, and Da Yun Ha. 2011. Different UI, Same UX: A Design Concept for Implementing a Locally-Optimized and Globally-Unified User Experience. In First International Conference, DUXU 2011, Held as Part of HCI International, Proceedings, Part II(Lecture Notes in Computer Science, Vol. 6770). Springer, 10.1007/978-3-642-21708-1_50, 440–448.Google ScholarCross Ref
- Zoltan A. Kocsis and Jerry Swan. 2017. Dependency Injection for Programming by Optimization. CoRR abs/1707.04016 (2017), 1–16. http://arxiv.org/abs/1707.04016Google Scholar
- Young Seok Lee, Sang W. Hong, Tonya L. Smith-Jackson, Maury A. Nussbaum, and Kei Tomioka. 2006. Systematic evaluation methodology for cell phone user interfaces. Interact. Comput. 18, 2 (2006), 304–325. https://doi.org/10.1016/j.intcom.2005.04.002Google ScholarDigital Library
- Jakob Nielsen. 1992. Finding usability problems through heuristic evaluation. In Conference on Human Factors in Computing Systems, CHI 1992, Monterey, CA, USA, May 3-7, 1992, Proceedings. ACM, 10.1145/142750.142834, 373–380.Google ScholarDigital Library
- Jakob Nielsen. 1994. Usability engineering. Morgan Kaufmann, 10.1109/2.121503.Google Scholar
- Jakob Nielsen. 1994. Usability inspection methods. In Conference on Human Factors in Computing Systems, CHI 1994, Boston, Massachusetts, USA. ACM, 10.1145/259963.260531, 413–414.Google ScholarDigital Library
- Jakob Nielsen and Rolf Molich. 1990. Heuristic evaluation of user interfaces. In Conference on Human Factors in Computing Systems, CHI 1990, Proceedings. ACM, 10.1145/97243.97281, 249–256.Google ScholarDigital Library
- Janne Yukiko Y. Oeiras, David Leonardo M. Bentolila, and Mayara Costa Figueiredo. 2008. Heva: uma ferramenta de suporte à avaliação heurística para sistemas web. In IHC(ACM International Conference Proceeding Series, Vol. 378). ACM, 978-85-7669-203-4, 136–145.Google Scholar
- Mouad E. L. Omari, Mohammed Erramdani, and Abdelkader Rhouati. 2020. Getting Model of MVVM Pattern from UML Profile. Int. J. Recent Contributions Eng. Sci. IT 8, 1 (2020), 36–47.Google ScholarCross Ref
- Rafael Marcus da Costa Patrono. 2019. MHET: um aplicativo móvel para avaliação de websites utilizando o método de avaliação heurística.Universidade Federal de Ouro Preto 1 (2019), 1–39.Google Scholar
- Luis Rivero and Tayana Conte. 2012. Using the Results from a Systematic Mapping Extension to Define a Usability Inspection Method for Web Applications. In Proceedings of the 24th International Conference on Software Engineering & Knowledge Engineering (SEKE’2012). Knowledge Systems Institute Graduate School, 1-891706-31-4, 582–587.Google Scholar
- Luis Rivero, Davi Viana, and Tayana Conte. 2013. Mockup DUE: Uma Ferramenta de Apoio ao Processo de Inspeção de Usabilidade de Mockups de Aplicações Web. In IX Workshop Anual do MPS (WAMPS 2013). IX Workshop Anual do MPS (WAMPS 2013), 1–8. https://www.researchgate.net/publication/294580666_Mockup_DUE_Uma_ Ferramenta_de_Apoio_ao_Processo_de_Inspecao_de_Usabilidade_de_Mockups_de _Aplicacoes_WebGoogle Scholar
- Kalpna Sagar and Anju Saha. 2017. A systematic review of software usability studies. International Journal of Information Technology 14 (11 Dec 2017), 1–24.Google ScholarCross Ref
- Francis Santos, Glívia Barbosa, Ismael Silva, and Flávio Coutinho. 2017. THEM: Ferramenta colaborativa para suporte a avaliações de interfaces baseadas na Avaliação Heurística. In Anais do XIV Simpósio Brasileiro de Sistemas Colaborativos (São Paulo). SBC, 10.5753/sbsc.2017.9954, 110–124.Google Scholar
- Paula Alexandra Silva, Kelly Holden, and Phillip Jordan. 2015. Towards a List of Heuristics to Evaluate Smartphone Apps Targeted at Older Adults: A Study with Apps that Aim at Promoting Health and Well-Being. In 48th Hawaii International Conference on System Sciences, HICSS. IEEE Computer Society, 10.1109/HICSS.2015.390, 3237–3246.Google ScholarDigital Library
- Christian Zeidler, Christian Kittl, and Otto Petrovic. 2008. An integrated product development process for mobile software. Int. J. Mob. Commun. 6, 3 (2008), 345–356. https://doi.org/10.1504/IJMC.2008.017515Google ScholarDigital Library
Index Terms
- Tuhm: A Tool for Supporting Usability Tests on Mobile Applications
Recommendations
Detailed Usability Heuristics: A Breakdown of Usability Heuristics to Enhance Comprehension for Novice Evaluators
HCI International 2020 - Late Breaking Papers: User Experience Design and Case StudiesAbstractHeuristic evaluation (HE) is one of the most commonly used usability evaluation methods. In HE, 3–5 evaluators evaluate a certain system guided by a list of usability heuristics with the goal of detecting usability issues. Although HE is popular ...
How to develop usability heuristics
Numerous sets of usability heuristics have been designed for specific domains, as traditional heuristics do not evaluate the specific features of particular applications. A substantial portion of the existing research focuses on designing new sets of ...
A methodology to develop usability / user experience heuristics
Interacción '17: Proceedings of the XVIII International Conference on Human Computer InteractionUsability is an important element to consider in the development of different software products. Because sets of generic usability heuristics may not evaluate specific features of different applications, several authors have developed new sets of ...
Comments