Providing Task Execution Capabilities in LLM-Based Conversational Assistants
Resumo
Context: Conversational assistants (CAs) powered by Large Language Models (LLMs) excel in generating coherent responses, but struggle with task execution requiring long-term memory or temporal awareness. This research addresses such limitations, particularly in healthcare applications where task continuity is crucial. Problem: Existing CAs often fail to meet user expectations in scenarios requiring long-term task management, such as scheduling reminders or monitoring chronic health conditions. This lack of temporal reasoning and memory continuity undermines user trust and engagement. Proposed Solution: We propose a multi-agent system integrating LLMs with structured data processing, that enables CAs to recognize, manage, and execute user requests, such as scheduling reminders or tracking tasks over time. The solution bridges the gap between conversational fluency and actionable outcomes. IT Theory: The study draws on theories of Human-Computer Interaction (HCI) and Temporal Awareness in Information Technology for allowing structured task execution. Method: The research combines proof-of-concept implementation with healthcare case studies. Two experimental phases evaluated the solution: a pilot test with 35 users and an expanded trial with 437 participants focusing on chronic disease management. Summarization of Results: Results demonstrated an improvement in task fulfillment and user engagement. The assistant successfully addressed 82% of task requests in simulations, with reduced user frustration and longer interactions during real-world trials. Contributions and Impact on IT: The study enhances the capabilities of conversational assistants by introducing temporal reasoning and structured task execution, making them more effective in managing real-world tasks. These advancements improve the applicability of CAs, particularly in domains like healthcare, where accurate and timely task management is critical.
Referências
Serena Barello, Guendalina Graffigna, and Elena Vegni. 2012. Patient engagement as an emerging challenge for healthcare services: Mapping the literature. Nurs Res Pract 2012 (2012). DOI: 10.1155/2012/905934
Ghazala Bilquise, Samar Ibrahim, and Khaled Shaalan. 2022. Emotionally Intelligent Chatbots: A Systematic Literature Review. Human Behavior and Emerging Technologies (2022). DOI: 10.1155/2022/9601630
G Dosovitsky, BS Pineda, NC Jacobson, C Chang, M Escoredo, and EL Bunge. 2020. Artificial intelligence chatbot for depression: descriptive study of usage. JMIR Formative Research 4 (2020), e17065. DOI: 10.2196/17065
Meghana Gudala, Sunitha Mogalla, Mandi Lyons, Padmavathy Ramaswamy, Mary Ellen Ross, and Kirk Roberts. 2022. Benefits Of, Barriers To, and Needs for an Artificial Intelligence–Powered Medication Information Voice Chatbot for Older Adults: Interview Study With Geriatrics Experts. Jmir Aging (2022). DOI: 10.2196/32169
Magdalena Görtz, Kilian Baumgärtner, T Schmid, Marc Muschko, Philipp Woessner, Axel Gerlach, Michael Byczkowski, Holger Sültmann, Stefan Duensing, and Markus Hohenfellner. 2023. An Artificial Intelligence-Based Chatbot for Prostate Cancer Education: Design and Patient Evaluation Study. Digital Health (2023). DOI: 10.1177/20552076231173304
Kien Hoa Ly, Ann-Marie Ly, and Gerhard Andersson. 2017. A fully automated conversational agent for promoting mental well-being: a pilot RCT using mixed methods. Internet Interventions 10 (2017), 39–46. DOI: 10.1016/j.invent.2017.10.002
Abdollah Mahdavi, Masoud Amanzadeh, Mahnaz Hamedan, and Roya Naemi. 2023. Artificial Intelligence Based Chatbots to Combat COVID-19 Pandemic: A Scoping Review. (2023). DOI: 10.21203/rs.3.rs-2565141/v1
Robert R Morris, Kareem Kouddous, Rohan Kshirsagar, and Stephen M Schueller. 2018. Towards an artificially empathic conversational agent for mental health applications: system design and user perceptions. Journal of Medical Internet Research 20 (2018), e10148. DOI: 10.2196/10148
OpenAI. [n. d.]. OpenAI GPT API Documentation. [link]. Acesso em: 14/03/2024.
