From Real-Time Conversation to User Story: Leveraging Agile Requirements through LLM
Resumo
User stories have become the most widely adopted technique for requirements elicitation and documentation in agile teams. However, ensuring high-quality requirements through user stories remains a significant challenge. Natural Language Processing (NLP) techniques have been proposed to enhance the quality of these artifacts, but technological constraints have limited their effectiveness. More recently, the emergence of Large Language Models (LLMs) has prompted new approaches. Nonetheless, existing proposals remain preliminary and constrained. This research presents a conceptual framework for an LLM-based approach designed to support the generation of high-quality user stories from real-time conversations with end-users, thereby reducing the reliance on traditional requirements documents. The approach integrates context-specific information and incorporates automated and manual validation steps to ensure the quality of LLM-generated content and mitigate hallucinations. A preliminary evaluation was conducted with software engineering experts to evaluate the proposed approach's adherence to real-world problems. The proposal was perceived as easy to use, effective, and capable of producing high-quality outcomes. Furthermore, participants expressed a positive experience with both the introduction to the approach and their involvement in the evaluation. This engagement prompted reflections on novel opportunities for integrating LLMs into their professional practices.
Referências
M. Kassab, “The changing landscape of requirements engineering practices over the past decade,” in 5th International Workshop on Empirical Requirements Engineering, EmpiRE 2015 - Proceedings, 2016. DOI: 10.1109/EmpiRE.2015.7431299.
G. Lucassen, F. Dalpiaz, J. M. E. M. van der Werf, and S. Brinkkemper, “Improving agile requirements: the Quality User Story framework and tool,” Requir Eng, vol. 21, no. 3, pp. 383–403, Sep. 2016, DOI: 10.1007/s00766-016-0250-x.
X. Wang, L. Zhao, Y. Wang, and J. Sun, “The Role of Requirements Engineering Practices in Agile Development: An Empirical Study,” in Communications in Computer and Information Science, 2014. DOI: 10.1007/978-3-662-43610-3_15.
A. M. Moreno and A. Yagüe, “Agile user stories enriched with usability,” in Lecture Notes in Business Information Processing, 2012. DOI: 10.1007/978-3-642-30350-0_12.
J. Choma, L. A. M. Zaina, and D. Beraldo, “UserX story: Incorporating UX aspects into user stories elaboration,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2016. DOI: 10.1007/978-3-319-39510-4_13.
H. Ordóñez, A. F. E. Villada, D. L. V. Vanegas, C. Cobos, A. Ordóñez, and R. Segovia, “An impact study of business process models for requirements elicitation in XP,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2015. DOI: 10.1007/978-3-319-21404-7_22.
M. Trkman, J. Mendling, and M. Krisper, “Using business process models to better understand the dependencies among user stories,” Inf Softw Technol, vol. 71, 2016, DOI: 10.1016/j.infsof.2015.10.006.
Y. Wautelet, S. Heng, M. Kolp, and I. Mirbel, “Unifying and Extending User Story Models,” in Lecture Notes in Computer Science, 2014, pp. 211–225. DOI: 10.1007/978-3-319-07881-6_15.
A. R. Amna and G. Poels, “Systematic Literature Mapping of User Story Research,” IEEE Access, vol. 10, pp. 51723–51746, 2022, DOI: 10.1109/ACCESS.2022.3173745.
Z. Zhang, M. Rayhan, T. Herda, M. Goisauf, and P. Abrahamsson, “LLM-based agents for automating the enhancement of user story quality: An early report,” in International Conference on Agile Software Development, 2024, pp. 117–126.
D. V. Rodriguez et al., “Leveraging Generative AI Tools to Support the Development of Digital Solutions in Health Care Research: Case Study,” JMIR Hum Factors, vol. 11, no. 1, 2024, DOI: 10.2196/52885.
C. N. Coelho Jr et al., “Effort and Size Estimation in Software Projects with Large Language Model-based Intelligent Interfaces,” 2024. [Online]. Available: [link]
K. Ronanki, C. Berger, and J. Horkoff, “Investigating ChatGPT’s Potential to Assist in Requirements Elicitation Processes,” in Proceedings - 2023 49th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2023, 2023. DOI: 10.1109/SEAA60479.2023.00061.
T. Johann, C. Stanik, A. M. B. Alizadeh, and W. Maalej, “SAFE: A Simple Approach for Feature Extraction from App Descriptions and App Reviews,” in Proceedings - 2017 IEEE 25th International Requirements Engineering Conference, RE 2017, 2017. DOI: 10.1109/RE.2017.71.
M. Arias, A. Buccella, and A. Cechich, “A Framework for Managing Requirements of Software Product Lines,” Electron Notes Theor Comput Sci, vol. 339, 2018, DOI: 10.1016/j.entcs.2018.06.002.
N. H. Bakar, Z. M. Kasirun, N. Salleh, and H. A. Jalab, “Extracting features from online software reviews to aid requirements reuse,” Applied Soft Computing Journal, vol. 49, 2016, DOI: 10.1016/j.asoc.2016.07.048.
I. K. Raharjana, D. Siahaan, and C. Fatichah, “User Stories and Natural Language Processing: A Systematic Literature Review,” IEEE Access, vol. 9, 2021, DOI: 10.1109/ACCESS.2021.3070606.
M. Cohn, User Stories Applied: For Agile Software Development (Addison Wesley Signature Series), vol. 1, no. 0. 2004.
B. Wake, “INVEST in Good Stories, and SMART Tasks,” XP123: Exploring Extreme Programming. Accessed: Oct. 09, 2024. [Online]. Available: [link]
R. Jeffries, “Essential XP: Card, conversation, confirmation,” Ronjeffries.Com. Accessed: Oct. 09, 2024. [Online]. Available: [link]
J. Patton, User Story Mapping: Discover the Whole Story, Build the Right Product, 1st edition. O’Reilly Media, 2014.
G. Lucassen, F. Dalpiaz, J. M. E. M. Van Der Werf, and S. Brinkkemper, “Forging high-quality User Stories: Towards a discipline for Agile Requirements,” in 2015 IEEE 23rd International Requirements Engineering Conference, RE 2015 - Proceedings, 2015. DOI: 10.1109/RE.2015.7320415.
F. D. Davis, “A technology acceptance model for empirically testing new end-user information systems: Theory and results,” Management, vol. Ph.D., 1985, DOI: oclc/56932490.
T. Rahman and Y. Zhu, “Automated User Story Generation with Test Case Specification Using Large Language Model,” Apr. 2024, Accessed: Sep. 30, 2024. [Online]. Available: [link]
