Exploring UX in Conversational Interfaces: perceptions from a preliminary literature review

• Jéssica Favero Ribeiro UFRGS
• Leticia dos Santos Machado UFRGS
• Marcelo Soares Pimenta UFRGS

DOI: https://doi.org/10.5753/ihc_estendido.2024.244012

Abstract

This paper presents a rapid review of the literature on user experience (UX) methods and techniques for evaluating conversational interfaces and identifying current practices. The analysis of 25 articles from the ACM and Scopus databases reveals a diversity of approaches, including usability questionnaires and qualitative methods such as interviews and focus groups. The absence of a universal standard in UX evaluation highlights the need for in-depth studies to consolidate best practices and provide a foundation for future research. This work aims to build a more cohesive and practical field of study, addressing the growing demands for human interactions with complex and intelligent computational systems.

References

Cartaxo, B., Pinto, G., and Soares, S. (2018). The role of rapid reviews in supporting decision-making in software engineering practice. In Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018, pages 24–34.

Fadhil, A. and Gabrielli, S. (2017). Addressing challenges in promoting healthy lifestyles: the al-chatbot approach. In Proceedings of the 11th EAI international conference on pervasive computing technologies for healthcare, pages 261–265.

Guerino, G. C., Silva, W. A. F., Coleti, T. A., and Valentim, N. M. C. (2021). Assessing a technology for usability and user experience evaluation of conversational systems: An exploratory study. In ICEIS (2), pages 463–473.

ISO (2019). Ergonomics of human-system interaction – part 210: Human-centred design for interactive systems (2nd ed.). Standard, International Organization for Standardization (2019).

Schuetzler, R. M., Grimes, G. M., and Giboney, J. S. (2019). The effect of conversational agent skill on user behavior during deception. Computers in Human Behavior, 97:250–259.

Tricco, A. C., Antony, J., Zarin, W., Strifler, L., Ghassemi, M., Ivory, J., Perrier, L., Hutton, B., Moher, D., and Straus, S. E. (2015). A scoping review of rapid review methods. BMC medicine, 13:1–15.

Trippas, J. R., Spina, D., Thomas, P., Sanderson, M., Joho, H., and Cavedon, L. (2020). Towards a model for spoken conversational search. Information Processing & Management, 57(2):102162.

van der Zandt, L., van der Stappen, E., and van Turnhout, K. (2021). Towards real-life adoption of conversational interfaces: Exploring the challenges in designing chatbots that live up to user expectations. In 34th British HCI Conference, pages 306–311. BCS Learning & Development.