Experiences and challenges of a redesign process with the support of an AI assistant on an educational platform
Resumo
Artificial Intelligence (AI) has contributed to the advancement of many knowledge areas. In particular, Large Language Models (LLMs) has become a trending topic and its application has been studied in different contexts, including human-computer interaction (HCI) and interface design research. Interaction design (IxD) and interface design (UI) benefit from these technologies, in which some tasks can be automated with new tools for creating more efficient interfaces. This experience report explores the integration of AI in the redesign process of the educational platform Classroom eXperience (CX), utilizing models such as GPT-4 and Gemini 1.5. The study shows that AI can complement the work of designers, providing precise analyses and suggestions to improve usability and user experience, although human supervision remains essential to validate and implement these improvements.
Palavras-chave:
User Interface, Interface Design, LLM, Online Learning Environment
Referências
Rafael D. Araújo, Taffarel Brant-Ribeiro, Renan G. Cattelan, Sandra A. de Amo, and Hiran N.M. Ferreira. 2013. Personalization of Interactive Digital Media in Ubiquitous Educational Environments. In 2013 IEEE International Conference on Systems, Man, and Cybernetics. 3955–3960. DOI: 10.1109/SMC.2013.675
Rafael D. Araújo, Taffarel Brant-Ribeiro, Hiran N. M. Ferreira, Fabiano A. Dorça, and Renan G. Cattelan. 2020. Using Learning Styles for Creating and Personalizing Educational Content in Ubiquitous Learning Environments. Revista Brasileira de Informática na Educação 28, 0 (2020), 133–149. DOI: 10.5753/rbie.2020.28.0.133
Simone Diniz Junqueira Barbosa, BS da Silva, Milene Selbach Silveira, Isabela Gasparini, Ticianne Darin, and Gabriel Diniz Junqueira Barbosa. 2021. Interação humano-computador e experiência do usuario. Auto publicação (2021).
J. B. Brooke. 1996. SUS: A ’Quick and Dirty’ Usability Scale. [link]
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. arXiv:2005.14165 [cs.CL]
Edward Y. Chang. 2023. Prompting Large Language Models With the Socratic Method. arXiv:2303.08769 [cs.LG]
Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Hao Zhang, Banghua Zhu, Michael Jordan, Joseph E. Gonzalez, and Ion Stoica. 2024. Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference. arXiv:2403.04132 [cs.AI]
Nathalia da Cruz Alves, Leonardo Kreuch, and Christiane Gresse von Wangenheim. 2022. Analyzing structural similarity of user interface layouts of Android apps using deep learning. In Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC ’22). Association for Computing Machinery, New York, NY, USA, Article 4, 11 pages. DOI: 10.1145/3554364.3559111
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv:1810.04805 [cs.CL]
Shiying Ding, Xinyi Chen, Yan Fang, Wenrui Liu, Yiwu Qiu, and Chunlei Chai. 2023. DesignGPT: Multi-Agent Collaboration in Design. arXiv:2311.11591 [cs.AI]
Peitong Duan, Jeremy Warner, Yang Li, and Bjoern Hartmann. 2024. Generating Automatic Feedback on UI Mockups with Large Language Models. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24). ACM. DOI: 10.1145/3613904.3642782
H. Ferreira, G.P. de Oliveira, R. Araújo, F. Dorça, and R. Cattelan. 2019. Technology-enhanced assessment visualization for smart learning environments. Smart Learning Environments 6, 14 (2019). DOI: 10.1186/s40561-0190096z
Hiran N. M. Ferreira, Rafael Araújo, Fabiano Dorça, and Renan Cattelan.2023. Integração de técnicas de inteligência artificial para modelagem probabilística do estudante em ambientes virtuais de aprendizagem. Tecnologias, Sociedade e Conhecimento 10, 2(dez.2023), 38–67. DOI: 10.20396/tsc.v10i2.18365
Agatha Freitas, Taiane Farias, and Karla Pacheco. 2022. Usabilidade em Ambientes Virtuais de Aprendizagem: Estudo de caso sobre o Google Classroom. [re]Design 1(122022), 27–48. DOI: 10.35818/redesign.v1i1.1122
Gemini Team. 2024. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. arXiv:2403.05530 [cs.CL]
Toshali Goel, Orit Shaer, C. Delcourt, Quan Gu, and Angel Cooper. 2023. Preparing Future Designers for Human-AI Collaboration in Persona Creation. Proceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work (2023). DOI: 10.1145/3596671.3598574
Kristina Höök, David Benyon, and Alan Munro. 2003. Designing Information Spaces: The Social Navigation Approach. DOI: 10.1007/978-1-447100355
Jie Li, Hancheng Cao, Laura Lin, Youyang Hou, Ruihao Zhu, and Abdallah El Ali. 2024. User Experience Design Professionals’ Perceptions of Generative Artificial Intelligence. arXiv:2309.15237 [cs.CY]
Michael Muller, Anna Kantosalo, Mary Lou Maher, Charles Patrick Martin, and Greg Walsh. 2024. GenAICHI 2024: Generative AI and HCI at CHI 2024. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’24). Association for Computing Machinery, New York, NY, USA, Article 470, 7 pages. DOI: 10.1145/3613905.3636294
Jakob Nielsen. 1994. Heuristic evaluation. In Usability Inspection Methods, J. Nielsen and R. L. Mack (Eds.). John Wiley & Sons.
Jakob Nielsen. 2005. Ten usability heuristics. [link]
Jakob Nielsen. 2024. Multi-Craft Specialized Content in the AI Era. UXTigers (February 2024). [link] Accessed: February 22, 2024.
Don Norman. 2007. Emotional design: Why we love (or hate) everyday things. Basic books.
Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic books.
José Luiz Nunes, Gabriel D. J. Barbosa, Clarisse Sieckenius de Souza, Helio Lopes, and Simone D. J. Barbosa. 2022. Using model cards for ethical reflection: a qualitative exploration. In Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC ’22). Association for Computing Machinery, New York, NY, USA, Article 29, 11 pages. DOI: 10.1145/3554364.3559117
OpenAI. 2023. GPT-4 Technical Report. [link]
J. Preece, H. Sharp, and Y. Rogers. 2015. Interaction Design: Beyond Human-Computer Interaction. Wiley. [link]
Chen Qian, Yufan Dang, Jiahao Li, Wei Liu, Weize Chen, Cheng Yang, Zhiyuan Liu, and Maosong Sun. 2023. Experiential Co-Learning of Software-Developing Agents. arXiv:2312.17025 [cs.CL]
Yang Shi, Tian Gao, Xiaohan Jiao, and Nan Cao. 2023. Understanding Design Collaboration Between Designers and Artificial Intelligence: A Systematic Literature Review. Proc. ACM Hum.-Comput. Interact. 7, CSCW2, Article 368 (oct 2023), 35 pages. DOI: 10.1145/3610217
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Curran Associates, Inc.
Zhengyuan Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Chung-Ching Lin, Zicheng Liu, and Lijuan Wang. 2023. The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision). ArXiv abs/2309.17421 (2023). DOI: 10.48550/arXiv.2309.17421
Chuanyang Zheng, Zhengying Liu, Enze Xie, Zhenguo Li, and Yu Li. 2023. Progressive-Hint Prompting Improves Reasoning in Large Language Models. arXiv:2304.09797 [cs.CL]
Rafael D. Araújo, Taffarel Brant-Ribeiro, Hiran N. M. Ferreira, Fabiano A. Dorça, and Renan G. Cattelan. 2020. Using Learning Styles for Creating and Personalizing Educational Content in Ubiquitous Learning Environments. Revista Brasileira de Informática na Educação 28, 0 (2020), 133–149. DOI: 10.5753/rbie.2020.28.0.133
Simone Diniz Junqueira Barbosa, BS da Silva, Milene Selbach Silveira, Isabela Gasparini, Ticianne Darin, and Gabriel Diniz Junqueira Barbosa. 2021. Interação humano-computador e experiência do usuario. Auto publicação (2021).
J. B. Brooke. 1996. SUS: A ’Quick and Dirty’ Usability Scale. [link]
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. arXiv:2005.14165 [cs.CL]
Edward Y. Chang. 2023. Prompting Large Language Models With the Socratic Method. arXiv:2303.08769 [cs.LG]
Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Hao Zhang, Banghua Zhu, Michael Jordan, Joseph E. Gonzalez, and Ion Stoica. 2024. Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference. arXiv:2403.04132 [cs.AI]
Nathalia da Cruz Alves, Leonardo Kreuch, and Christiane Gresse von Wangenheim. 2022. Analyzing structural similarity of user interface layouts of Android apps using deep learning. In Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC ’22). Association for Computing Machinery, New York, NY, USA, Article 4, 11 pages. DOI: 10.1145/3554364.3559111
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv:1810.04805 [cs.CL]
Shiying Ding, Xinyi Chen, Yan Fang, Wenrui Liu, Yiwu Qiu, and Chunlei Chai. 2023. DesignGPT: Multi-Agent Collaboration in Design. arXiv:2311.11591 [cs.AI]
Peitong Duan, Jeremy Warner, Yang Li, and Bjoern Hartmann. 2024. Generating Automatic Feedback on UI Mockups with Large Language Models. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24). ACM. DOI: 10.1145/3613904.3642782
H. Ferreira, G.P. de Oliveira, R. Araújo, F. Dorça, and R. Cattelan. 2019. Technology-enhanced assessment visualization for smart learning environments. Smart Learning Environments 6, 14 (2019). DOI: 10.1186/s40561-0190096z
Hiran N. M. Ferreira, Rafael Araújo, Fabiano Dorça, and Renan Cattelan.2023. Integração de técnicas de inteligência artificial para modelagem probabilística do estudante em ambientes virtuais de aprendizagem. Tecnologias, Sociedade e Conhecimento 10, 2(dez.2023), 38–67. DOI: 10.20396/tsc.v10i2.18365
Agatha Freitas, Taiane Farias, and Karla Pacheco. 2022. Usabilidade em Ambientes Virtuais de Aprendizagem: Estudo de caso sobre o Google Classroom. [re]Design 1(122022), 27–48. DOI: 10.35818/redesign.v1i1.1122
Gemini Team. 2024. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. arXiv:2403.05530 [cs.CL]
Toshali Goel, Orit Shaer, C. Delcourt, Quan Gu, and Angel Cooper. 2023. Preparing Future Designers for Human-AI Collaboration in Persona Creation. Proceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work (2023). DOI: 10.1145/3596671.3598574
Kristina Höök, David Benyon, and Alan Munro. 2003. Designing Information Spaces: The Social Navigation Approach. DOI: 10.1007/978-1-447100355
Jie Li, Hancheng Cao, Laura Lin, Youyang Hou, Ruihao Zhu, and Abdallah El Ali. 2024. User Experience Design Professionals’ Perceptions of Generative Artificial Intelligence. arXiv:2309.15237 [cs.CY]
Michael Muller, Anna Kantosalo, Mary Lou Maher, Charles Patrick Martin, and Greg Walsh. 2024. GenAICHI 2024: Generative AI and HCI at CHI 2024. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’24). Association for Computing Machinery, New York, NY, USA, Article 470, 7 pages. DOI: 10.1145/3613905.3636294
Jakob Nielsen. 1994. Heuristic evaluation. In Usability Inspection Methods, J. Nielsen and R. L. Mack (Eds.). John Wiley & Sons.
Jakob Nielsen. 2005. Ten usability heuristics. [link]
Jakob Nielsen. 2024. Multi-Craft Specialized Content in the AI Era. UXTigers (February 2024). [link] Accessed: February 22, 2024.
Don Norman. 2007. Emotional design: Why we love (or hate) everyday things. Basic books.
Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic books.
José Luiz Nunes, Gabriel D. J. Barbosa, Clarisse Sieckenius de Souza, Helio Lopes, and Simone D. J. Barbosa. 2022. Using model cards for ethical reflection: a qualitative exploration. In Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC ’22). Association for Computing Machinery, New York, NY, USA, Article 29, 11 pages. DOI: 10.1145/3554364.3559117
OpenAI. 2023. GPT-4 Technical Report. [link]
J. Preece, H. Sharp, and Y. Rogers. 2015. Interaction Design: Beyond Human-Computer Interaction. Wiley. [link]
Chen Qian, Yufan Dang, Jiahao Li, Wei Liu, Weize Chen, Cheng Yang, Zhiyuan Liu, and Maosong Sun. 2023. Experiential Co-Learning of Software-Developing Agents. arXiv:2312.17025 [cs.CL]
Yang Shi, Tian Gao, Xiaohan Jiao, and Nan Cao. 2023. Understanding Design Collaboration Between Designers and Artificial Intelligence: A Systematic Literature Review. Proc. ACM Hum.-Comput. Interact. 7, CSCW2, Article 368 (oct 2023), 35 pages. DOI: 10.1145/3610217
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Curran Associates, Inc.
Zhengyuan Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Chung-Ching Lin, Zicheng Liu, and Lijuan Wang. 2023. The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision). ArXiv abs/2309.17421 (2023). DOI: 10.48550/arXiv.2309.17421
Chuanyang Zheng, Zhengying Liu, Enze Xie, Zhenguo Li, and Yu Li. 2023. Progressive-Hint Prompting Improves Reasoning in Large Language Models. arXiv:2304.09797 [cs.CL]
Publicado
07/11/2024
Como Citar
BORGES, Jonathan Martins; ARAÚJO, Rafael Dias.
Experiences and challenges of a redesign process with the support of an AI assistant on an educational platform. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 23. , 2024, Brasília/DF.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 98-109.
