UX research in the software industry: an investigation of long-term UX practices
Resumo
Software industry has sought to apply practices that provide a more meaningful User eXperience (UX) and help maintain a sustainable business. UX Research practices allows conducting research and evaluations with users from the application of methods and techniques. Some UX Research practices reveal longitudinal UX research actions (i.e., Long-Term UX) when they track products’ use by users over time. The literature is scarce about studies that discuss the UX Research practices adopted by the software industry and their relationship with the different moments of product use (i.e., before, during, or after). Therefore, we surveyed the UX Research practices which are applied in software development in industry following the systematic literature review process. We selected 45 papers and conducted a qualitative analysis by applying coding techniques. As a result, we identify 38 practices which are classified into six categories, i.e. research planning, data collection with users, data analysis, design with research, organization and communication, and training for the research. Our findings show that 15 of 38 practices are related to Long-Term UX. We also identified the attitudes and needs of Long-Term UX experienced by the software industry.
Palavras-chave:
User eXperience, UX Research, Long-Term UX, Software Industry, Systematic Literature Review, Qualitative Analysis
Referências
ISO: 9241-210:2010. 2009. Ergonomics of Human System Interaction-Part 210: Human-Centred Design for Interactive Systems. [link]. In International Standardization Organization. (ISO), Switzerland. Online; accessed 03 May 2022.
Obead Alhadreti. 2020. Exploring UX Maturity in Software Development Environments in Saudi Arabia. International Journal of Advanced Computer Science and Applications (IJACSA) 11, 12 (2020), 168--174.
Alisa Ananjeva, John Stouby Persson, and Anders Bruun. 2020. Integrating UX work with agile development through user stories: An action research study in a small software company. Journal of Systems and Software 170 (2020), 110785.
Carmelo Ardito, Paolo Buono, Danilo Caivano, Maria Francesca Costabile, and Rosa Lanzilotti. 2014. Investigating and promoting UX practice in industry: An experimental study. International Journal of Human-Computer Studies 72, 6 (2014), 542--551. Interplay between User Experience Evaluation and System Development.
Irene Au, Richard Boardman, Robin Jeffries, Patrick Larvie, Antonella Pavese, Jens Riegelsberger, Kerry Rodden, and Molly Stevens. 2008. User Experience at Google: Focus on the User and All Else Will Follow. In SIGCHI Conference on Human Factors in Computing Systems (CHI '08) (Florence, Italy). Association for Computing Machinery, New York, NY, USA, 3681--3686.
Katryna Balboni, Lizzy Burnam, Roberta Dombrowski, Lily Hanes, and Holly Holden. 2022. The State of User Research 2022. [link]. User Interviews. Online; accessed 22 March 2022.
Kristine Bang, Martin Akto Kanstrup, Adam Kjems, and Jan Stage. 2017. Adoption of UX Evaluation in Practice: An Action Research Study in a Software Organization. In Human-Computer Interaction (INTERACT 2017). Springer International Publishing, Cham, 169--188.
Javier Bargas-Avila and Kasper Hornbæk. 2011. Old Wine in New Bottles or Novel Challenges: A Critical Analysis of Empirical Studies of User Experience. In 29th SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada). Association for Computing Machinery, New York, NY, USA, 2689--2698.
Daiana Biduski, Ericles Bellei, João Pedro Rodriguez, Luciana Zaina, and Ana Carolina De Marchi. 2020. Assessing long-term user experience on a mobile health application through an in-app embedded conversation-based questionnaire. Computers in Human Behavior 104 (2020), 106169.
Jay Brewer, Ger Joyce, and Saurabh Dutta. 2017. Converging Data with Design Within Agile and Continuous Delivery Environments. In Design, User Experience, and Usability: Theory, Methodology, and Management. Springer International Publishing, Cham, 533--542.
Michael Budwig, Soojin Jeong, and Kuldeep Kelkar. 2009. When User Experience Met Agile: A Case Study. In SIGCHI Extended Abstracts on Human Factors in Computing Systems (CHI '09) (Boston, MA, USA). Association for Computing Machinery, New York, NY, USA, 3075--3084.
Åsa Cajander, Marta Larusdottir, and Jan Gulliksen. 2013. Existing but not explicit-the user perspective in scrum projects in practice. In IFIP Conference on Human-Computer Interaction. Springer International Publishing, Cham, 762--779.
Parmit Chilana, Christina Holsberry, Flavio Oliveira, and Amy Ko. 2012. Designing for a Billion Users: A Case Study of Facebook. In Extended Abstracts on Human Factors in Computing Systems (CHI '12) (Austin, Texas, USA). Association for Computing Machinery, New York, NY, USA, 419--432.
Joelma Choma, Luciana Zaina, and Daniela Beraldo. 2016. UserX Story: Incorporating UX Aspects into User Stories Elaboration. In Human-Computer Interaction. Theory, Design, Development and Practice. Springer International Publishing, Cham, 131--140.
Joelma Choma, Luciana Zaina, and Tiago Da Silva. 2015. Towards an Approach Matching CMD and DSR to Improve the Academia-Industry Software Development Partnership: A Case of Agile and UX Integration. In 29th Brazilian Symposium on Software Engineering. IEEE, Belo Horizonte, Brazil, 51--60.
Joelma Choma, Luciana A. M. Zaina, and Daniela Beraldo. 2015. Communication of Design Decisions and Usability Issues: A Protocol Based on Personas and Nielsen's Heuristics. In Human-Computer Interaction: Design and Evaluation. Springer International Publishing, Cham, 163--174.
Robert DeLine, Andrew Bragdon, Kael Rowan, Jens Jacobsen, and Steven Reiss. 2012. Debugger Canvas: Industrial experience with the code bubbles paradigm. In 34th International Conference on Software Engineering. IEEE, Zurich, Switzerland, 1064--1073.
Joan DiMicco and Nancy Mann. 2016. User Research to Inform Product Design: Turning Failure into Small Successes. In SIGCHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16) (California, USA). Association for Computing Machinery, New York, NY, USA, 872--879.
Tore Dybå and Torgeir Dingsøyr. 2008. Strength of Evidence in Systematic Reviews in Software Engineering. In In 2nd ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (Kaiserslautern, Germany). Association for Computing Machinery, New York, NY, USA, 178--187.
Tore Dybå and Torgeir Dingsøyr. 2008. Empirical studies of agile software development: A systematic review. Information and Software Technology 50 (08 2008), 833--859.
Josh Evnin and Marjorie Pries. 2008. Are You Sure? Really? A Contextual Approach to Agile User Research. In Agile Conference 2008. IEEE, Toronto, ON, Canada, 537--542.
Susan Farrell. 2017. UX Research Cheat Sheet. [link]. Nielsen Norman Group (NNGroup). Online; accessed 22 March 2021.
Melissa Federoff and Catherine Courage. 2009. Successful User Experience in an Agile Enterprise Environment. In Human Interface and the Management of Information. Designing Information Environments. Springer Berlin Heidelberg, Berlin, Heidelberg, 233--242.
Joseph L. Fleiss. 1981. Statistical Methods for Rates and Proportions. Wiley,.
Interaction Design Foundation. 2021. UX Research. [link]. Interaction Design Foundation, 2021. Online; accessed 22 March 2021.
Graham Gibbs. 2018. Analyzing Qualitative Data (2 ed.). SAGE Publications Ltd.
Colin M. Gray. 2016. "It's More of a Mindset Than a Method": UX Practitioners' Conception of Design Methods. In Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 4044--4055.
Guilherme Guerino, Marcos de Assumpção, Thiago da Silva, Laura Hokkanen, Renato Balancieri, and Gislaine Leal. 2022. User Experience Practices in Software Startups: A Systematic Mapping Study. Advances in Human-Computer Interaction 2022 (2022), 13 pages.
Hang Guo. 2016. Lean but not Mean UX: Towards a Spiral UX Design Model. In Design, User Experience, and Usability: Design Thinking and Methods. Springer International Publishing, Cham, 25--33.
Marc Hassenzahl. 2018. The Thing and I (Summer of '17 Remix). In Funology 2: From Usability to Enjoyment. Springer International Publishing, Cham, 17--31.
Marc Hassenzahl, Michael Burmester, and Franz Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In Berichte des German Chapter of the ACM. Vol. 57. Mensch & Computer 2003, Vieweg+Teubner Verlag, 187--196.
Marc Hassenzahl and Noam Tractinsky. 2006. User experience-a research agenda. Behaviour & information technology 25, 2 (2006), 91--97.
P. Hodgetts. 2005. Experiences integrating sophisticated user experience design practices into agile processes. In Agile Development Conference (ADC'05). IEEE, Denver, CO, USA, 235--242.
Laura Hokkanen, Kati Kuusinen, and Kaisa Väänänen. 2016. Minimum viable user experience: A framework for supporting product design in startups. In Agile Processes, in Software Engineering, and Extreme Programming (XP 2016), Vol. 251. Springer International Publishing, Cham, 66--78.
Laura Hokkanen and Marko Leppänen. 2015. Three patterns for user involvement in startups. In 20th European Conference on Pattern Languages of Programs (Kaufbeuren, Germany). Association for Computing Machinery, New York, NY, USA, Article 51, 8 pages.
Laura Hokkanen and Kaisa Väänänen-Vainio-Mattila. 2015. UX Work in Startups: Current Practices and Future Needs. In Agile Processes in Software Engineering and Extreme Programming (XP 2015). Springer International Publishing, Cham, 81--92.
Eleonora Ibragimova, Leanda Verboom, and Nick Mueller. 2017. Building a Team to Champion User-Centered Design Within an Agile Process. In Design, User Experience, and Usability: Theory, Methodology, and Management. Springer International Publishing, Cham, 584--596.
Minna Isomursu, Andrey Sirotkin, Petri Voltti, and Markku Halonen. 2012. User Experience Design Goes Agile in Lean Transformation - A Case Study. In Agile Conference 2012. IEEE, Dallas, TX, USA, 1--10.
Gabriela Jurca, Theodore D. Hellmann, and Frank Maurer. 2014. Integrating Agile and User-Centered Design: A Systematic Mapping and Review of Evaluation and Validation Studies of Agile-UX. In Agile Conference 2014. IEEE, Kissimmee, FL, USA, 24--32.
Evangelos Karapanos, Jean-Bernard Martens, and Marc Hassenzahl. 2010. On the Retrospective Assessment of Users' Experiences over Time: Memory or Actuality? In Extended Abstracts on Human Factors in Computing Systems (CHI '10). Association for Computing Machinery, New York, NY, USA, 4075--4080.
Evangelos Karapanos, Jean-Bernard Martens, and Marc Hassenzahl. 2012. Reconstructing experiences with iScale. International Journal of Human-Computer Studies 70, 11 (2012), 849--865.
Pariya Kashfi, Robert Feldt, and Agneta Nilsson. 2019. Integrating UX principles and practices into software development organizations: A case study of influencing events. Journal of Systems and Software 154 (2019), 37--58.
Pariya Kashfi, Agneta Nilsson, and Robert Feldt. 2017. Integrating User eXperience practices into software development processes: implications of the UX characteristics. PeerJ Computer Science 3:e130 (2017), 40 pages.
Vincent Kervyn de Meerendré, Luka Rukonić, and Suzanne Kieffer. 2019. Overcoming Organizational Barriers to the Integration of UX Methods in Software Development: A Case Study. In Design, User Experience, and Usability. Practice and Case Studies, Vol. 11586. Springer International Publishing, Cham, 263--276.
Katja Kevic, Brendan Murphy, Laurie Williams, and Jennifer Beckmann. 2017. Characterizing Experimentation in Continuous Deployment: A Case Study on Bing. In 39th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP). IEEE, Buenos Aires, Argentina, 123--132.
Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. Technical Report EBSE 2007-001. Keele University and Durham University Joint Report. 57 pages. https://www.elsevier.com/_data/promis_misc/525444systematicreviewsguide.pdf.
Edna Kropp and Kolja Koischwitz. 2014. User-centered-design in agile RE through an On-site User Experience Consultant. In 2nd International Workshop on Usability and Accessibility Focused Requirements Engineering (UsARE). IEEE, Karlskrona, Sweden, 9--12.
Kelly Krout, Juan Pablo Carrascal, and Travis Lowdermilk. 2020. Lean UX Research at Scale: A Case Study. In Conference on Mensch und Computer (MuC '20) (Magdeburg, Germany). Association for Computing Machinery, New York, NY, USA, 53--59.
Sari Kujala, Virpi Roto, Kaisa Väänänen-Vainio-Mattila, Evangelos Karapanos, and Arto Sinnelä. 2011. UX Curve: A method for evaluating long-term user experience. Interacting with computers 23, 5 (2011), 473--483.
Sari Kujala, Marlene Vogel, Anna E. Pohlmeyer, and Marianna Obrist. 2013. Lost in Time: The Meaning of Temporal Aspects in User Experience. In Extended Abstracts on Human Factors in Computing Systems (CHI EA '13) (Paris, France). Association for Computing Machinery, New York, NY, USA, 559--564.
Kati Kuusinen. 2015. Overcoming Challenges in Agile User Experience Work: Cross-Case Analysis of Two Large Software Organizations. In 41st Euromicro Conference on Software Engineering and Advanced Applications. IEEE, ., 454--458.
Kati Kuusinen, Martin Kjølbye Sørensen, Nicklas Frederiksen, Niclas Laugesen, and Søren Juul. 2019. From Startup to Scaleup: An Interview Study of the Development of User Experience Work in a Data-Intensive Company. In Human-Centered Software Engineering, Vol. 11262. Springer International Publishing, Cham, 3--14.
Richard Landis and Gary Koch. 1977. The measurement of observer agreement for categorical data. International Biometric Society, JSTOR 33 (1977), 159--174.
Marta Lárusdóttir, Åsa Cajander, and Jan Gulliksen. 2012. The Big Picture of UX is Missing in Scrum Projects. In 7th Nordic Conference on Human-Computer Interaction, NordiCHI 2012. Association for Computing Machinery, Copenhagen, Denmark, 42--48. [link].
Effie Lai-Chong Law and Marta Lárusdóttir. 2015. Whose Experience Do We Care About? Analysis of the Fitness of Scrum and Kanban to User Experience. International Journal of Human-Computer Interaction 31, 9 (2015), 584--602.
Effie Lai-Chong Law, Paul van Schaik, and Virpi Roto. 2014. Attitudes towards user experience (UX) measurement. International Journal of Human-Computer Studies 72, 6 (2014), 526--541. Interplay between User Experience Evaluation and System Development.
Khalid Majrashi and Areej Al-Wabil. 2018. HCI Practices in Software-Development Environments in Saudi Arabia. In Cross-Cultural Design. Methods, Tools, and Users, Vol. 10911. Springer International Publishing, Cham, 58--77.
Patrizia Marti and Iolanda Iacono. 2016. Anticipated, momentary, episodic, remembered: the many facets of User eXperience. In Federated Conference on Computer Science and Information Systems (FedCSIS 2016). IEEE, Gdansk, Poland, 1647--1655. https://ieeexplore.ieee.org/document/7733474
Alexandra Matz and Panagiotis Germanakos. 2016. Increasing the Quality of Use Case Definition Through a Design Thinking Collaborative Method and an Alternative Hybrid Documentation Style. In Learning and Collaboration Technologies, Vol. 9753. Springer International Publishing, Cham, 48--59.
Beverly May. 2012. Applying Lean Startup: An Experience Report-Lean & Lean UX by a UX Veteran: Lessons Learned in Creating & Launching a Complex Consumer App. In Agile Conference 2012. IEEE, Dallas, TX, USA, 141--147.
Faith McCreary, Anne McEwan, Derrick Schloss, and Marla Gomez. 2014. Envisioning a New Future for the Enterprise with a Big Data Experience Framework. In New Perspectives in Information Systems and Technologies. Springer International Publishing, Cham, 199--209.
Don Norman and Jacob Nielsen. 2020. The Definition of User Experience (UX). https://www.nngroup.com/articles/definition-user-experience/. Nielsen Norman Group (NNGroup), 2020. Online; accessed 22 March 2021.
Abiodun Ogunyemi, David Lamas, and Emmanuel Eze. 2018. Exploring the state of human-centred design practice in software development companies: A cross-case analysis of three Nigerian software companies. Interacting with Computers 30, 5 (2018), 444--467.
Tina Øvad, Nis Bornoe, Lars Bo Larsen, and Jan Stage. 2015. Teaching Software Developers to Perform UX Tasks. In Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI '15) (Parkville, VIC, Australia). Association for Computing Machinery, New York, NY, USA, 397--406.
Nicolò Paternoster, Carmine Giardino, Michael Unterkalmsteiner, Tony Gorschek, and Pekka Abrahamsson. 2014. Software development in startup companies: A systematic mapping study. Information and Software Technology 56, 10 (2014), 1200--1218.
Korina Pazitka. 2019. The UX Research Methods Every Designer Needs To Know. [link]. CareerFoundry, 2019. Online; accessed 22 March 2021.
Narendren Pillay and Jeanette Wing. 2019. Agile UX: Integrating good UX development practices in Agile. In Conference on Information Communications Technology and Society (ICTAS 2019). IEEE, Durban, South Africa, 1--6.
Luis Rivero and Tayana Conte. 2017. A Systematic Mapping Study on Research Contributions on UX Evaluation Technologies. In XVI Brazilian Symposium on Human Factors in Computing Systems (Joinville, Brazil). Association for Computing Machinery, New York, NY, USA, Article 5, 10 pages.
Maria Rosala and Rachel Krause. 2019. User Experience Careers: What a Career in UX Looks Like Today. [link]. Nielsen Norman Group (NNGroup). Online; accessed 22 March 2021.
Virpi Roto, EL-C Law, Arnold POS Vermeeren, and Jettie Hoonhout. 2011. User experience white paper: Bringing clarity to the concept of user experience. Dagstuhl seminar on demarcating user experience 1 (2011), 12 pages. http://www.allaboutux.org/files/UX-WhitePaper.pdf (september 15--18, 2010).
Jullia Saad, Suéllen Martinelli, Leticia Machado, Cleidson de Souza, Alexandre Alvaro, and Luciana Zaina. 2021. UX work in software startups: A thematic analysis of the literature. Information and Software Technology 140 (2021), 106688.
Dina Salah, Richard F. Paige, and Paul Cairns. 2014. A Systematic Literature Review for Agile Development Processes and User Centred Design Integration. In 18th International Conference on Evaluation and Assessment in Software Engineering (London, England, UK). Association for Computing Machinery, New York, NY, USA, Article 5, 10 pages.
Eva-Maria Schön, Dominique Winter, Jan Uhlenbrok, María José Escalona Cuaresma, and Jörg Thomaschewski. 2016. Enterprise experience into the integration of human-centered design and Kanban. In 11th International Joint Conference on Software Technologies. ScitePress Digital Library, Lisbon, Portugal, 133--140.
Eva-Maria Schön, Jörg Thomaschewski, and María José Escalona. 2020. Lean User Research for Agile Organizations. IEEE Access 8 (2020), 129763--129773.
Bhuvana Sekar. 2017. Enterprise Software Experience Design: Journey and Lessons. In Human-Computer Interaction (INTERACT 2017), Vol. 10516. Springer International Publishing, Cham, 356--359.
Sedef Süner-Pla-Cerdà, Gülşen Töre Yargin, Hilal Şahin, and Semih Daniş. 2021. Examining the Impact of Covid-19 Pandemic on UX Research Practice Through UX Blogs. In Design, User Experience, and Usability: UX Research and Design, Vol. 12779. Springer International Publishing, Cham, 579--592.
Degif Teka, Yvonne Dittrich, and Mesfin Kifle. 2018. Adapting Lightweight User-Centered Design with the Scrum-Based Development Process. In International Conference on Software Engineering in Africa (SEiA '18) (Gothenburg, Sweden). Association for Computing Machinery, New York, NY, USA, 35--42.
Jim Ungar. 2008. The design studio: Interface design for agile teams. In Agile Conference 2008. IEEE, Toronto, ON, Canada, 519--524.
Michael Unterkalmsteiner, Pekka Abrahamsson, Xiaofeng Wang, Anh Nguyen-Duc, Syed QA Shah, Sohaib Shahid Bajwa, Guido H Baltes, Kieran Conboy, Eoin Cullina, Denis Dennehy, et al. 2016. Software startups-a research agenda. e-Informatica Software Engineering Journal 10, 1 (2016), 89--123.
Jari Varsaluoma and Farrukh Sahar. 2014. Usefulness of Long-Term User Experience Evaluation to Product Development: Practitioners' Views from Three Case Studies. In 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (Helsinki, Finland). Association for Computing Machinery, New York, NY, USA, 79--88.
Arnold Vermeeren, Effie Lai-Chong Law, Virpi Roto, Marianna Obrist, Jettie Hoonhout, and Kaisa Väänänen-Vainio-Mattila. 2010. User experience evaluation methods: current state and development needs. In 6th Nordic conference on human-computer interaction: Extending boundaries. Association for Computing Machinery, Reykjavik, Iceland, 521--530.
Jorick Vissers, Lode De Bot, and Bieke Zaman. 2013. MemoLine: Evaluating Long-Term UX with Children. In 12th International Conference on Interaction Design and Children (IDC '13) (New York, USA). Association for Computing Machinery, New York, NY, USA, 285--288.
Adeola Yetunde Wale-Kolade. 2015. Integrating usability work into a large inter-organisational agile development project: Tactics developed by usability designers. Journal of Systems and Software 100 (2015), 54--66.
Jeff Winter, Kari Ronkko, and Mats Hellman. 2009. Reporting usability metrics experiences. In Workshop on Cooperative and Human Aspects on Software Engineering (ICSE 2009). IEEE, Vancouver, BC, Canada, 108--115.
Tong Xia, Sumit Bhardwaj, Pavel Dmitriev, and Aleksander Fabijan. 2019. Safe Velocity: A Practical Guide to Software Deployment at Scale using Controlled Rollout. In 41st International Conference on Software Engineering: Software Engineering in Practice. IEEE, Montreal, QC, Canada, 11--20.
Tina Øvad and Lars Bo Larsen. 2015. The Prevalence of UX Design in Agile Development Processes in Industry. In Agile Conference 2015. IEEE, National Harbor, MD, USA, 40--49.
Tina Øvad and Lars Bo Larsen. 2016. How to reduce the UX bottleneck - train your software developers. Behaviour & Information Technology 35, 12 (2016), 1080--1090.
Obead Alhadreti. 2020. Exploring UX Maturity in Software Development Environments in Saudi Arabia. International Journal of Advanced Computer Science and Applications (IJACSA) 11, 12 (2020), 168--174.
Alisa Ananjeva, John Stouby Persson, and Anders Bruun. 2020. Integrating UX work with agile development through user stories: An action research study in a small software company. Journal of Systems and Software 170 (2020), 110785.
Carmelo Ardito, Paolo Buono, Danilo Caivano, Maria Francesca Costabile, and Rosa Lanzilotti. 2014. Investigating and promoting UX practice in industry: An experimental study. International Journal of Human-Computer Studies 72, 6 (2014), 542--551. Interplay between User Experience Evaluation and System Development.
Irene Au, Richard Boardman, Robin Jeffries, Patrick Larvie, Antonella Pavese, Jens Riegelsberger, Kerry Rodden, and Molly Stevens. 2008. User Experience at Google: Focus on the User and All Else Will Follow. In SIGCHI Conference on Human Factors in Computing Systems (CHI '08) (Florence, Italy). Association for Computing Machinery, New York, NY, USA, 3681--3686.
Katryna Balboni, Lizzy Burnam, Roberta Dombrowski, Lily Hanes, and Holly Holden. 2022. The State of User Research 2022. [link]. User Interviews. Online; accessed 22 March 2022.
Kristine Bang, Martin Akto Kanstrup, Adam Kjems, and Jan Stage. 2017. Adoption of UX Evaluation in Practice: An Action Research Study in a Software Organization. In Human-Computer Interaction (INTERACT 2017). Springer International Publishing, Cham, 169--188.
Javier Bargas-Avila and Kasper Hornbæk. 2011. Old Wine in New Bottles or Novel Challenges: A Critical Analysis of Empirical Studies of User Experience. In 29th SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada). Association for Computing Machinery, New York, NY, USA, 2689--2698.
Daiana Biduski, Ericles Bellei, João Pedro Rodriguez, Luciana Zaina, and Ana Carolina De Marchi. 2020. Assessing long-term user experience on a mobile health application through an in-app embedded conversation-based questionnaire. Computers in Human Behavior 104 (2020), 106169.
Jay Brewer, Ger Joyce, and Saurabh Dutta. 2017. Converging Data with Design Within Agile and Continuous Delivery Environments. In Design, User Experience, and Usability: Theory, Methodology, and Management. Springer International Publishing, Cham, 533--542.
Michael Budwig, Soojin Jeong, and Kuldeep Kelkar. 2009. When User Experience Met Agile: A Case Study. In SIGCHI Extended Abstracts on Human Factors in Computing Systems (CHI '09) (Boston, MA, USA). Association for Computing Machinery, New York, NY, USA, 3075--3084.
Åsa Cajander, Marta Larusdottir, and Jan Gulliksen. 2013. Existing but not explicit-the user perspective in scrum projects in practice. In IFIP Conference on Human-Computer Interaction. Springer International Publishing, Cham, 762--779.
Parmit Chilana, Christina Holsberry, Flavio Oliveira, and Amy Ko. 2012. Designing for a Billion Users: A Case Study of Facebook. In Extended Abstracts on Human Factors in Computing Systems (CHI '12) (Austin, Texas, USA). Association for Computing Machinery, New York, NY, USA, 419--432.
Joelma Choma, Luciana Zaina, and Daniela Beraldo. 2016. UserX Story: Incorporating UX Aspects into User Stories Elaboration. In Human-Computer Interaction. Theory, Design, Development and Practice. Springer International Publishing, Cham, 131--140.
Joelma Choma, Luciana Zaina, and Tiago Da Silva. 2015. Towards an Approach Matching CMD and DSR to Improve the Academia-Industry Software Development Partnership: A Case of Agile and UX Integration. In 29th Brazilian Symposium on Software Engineering. IEEE, Belo Horizonte, Brazil, 51--60.
Joelma Choma, Luciana A. M. Zaina, and Daniela Beraldo. 2015. Communication of Design Decisions and Usability Issues: A Protocol Based on Personas and Nielsen's Heuristics. In Human-Computer Interaction: Design and Evaluation. Springer International Publishing, Cham, 163--174.
Robert DeLine, Andrew Bragdon, Kael Rowan, Jens Jacobsen, and Steven Reiss. 2012. Debugger Canvas: Industrial experience with the code bubbles paradigm. In 34th International Conference on Software Engineering. IEEE, Zurich, Switzerland, 1064--1073.
Joan DiMicco and Nancy Mann. 2016. User Research to Inform Product Design: Turning Failure into Small Successes. In SIGCHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16) (California, USA). Association for Computing Machinery, New York, NY, USA, 872--879.
Tore Dybå and Torgeir Dingsøyr. 2008. Strength of Evidence in Systematic Reviews in Software Engineering. In In 2nd ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (Kaiserslautern, Germany). Association for Computing Machinery, New York, NY, USA, 178--187.
Tore Dybå and Torgeir Dingsøyr. 2008. Empirical studies of agile software development: A systematic review. Information and Software Technology 50 (08 2008), 833--859.
Josh Evnin and Marjorie Pries. 2008. Are You Sure? Really? A Contextual Approach to Agile User Research. In Agile Conference 2008. IEEE, Toronto, ON, Canada, 537--542.
Susan Farrell. 2017. UX Research Cheat Sheet. [link]. Nielsen Norman Group (NNGroup). Online; accessed 22 March 2021.
Melissa Federoff and Catherine Courage. 2009. Successful User Experience in an Agile Enterprise Environment. In Human Interface and the Management of Information. Designing Information Environments. Springer Berlin Heidelberg, Berlin, Heidelberg, 233--242.
Joseph L. Fleiss. 1981. Statistical Methods for Rates and Proportions. Wiley,.
Interaction Design Foundation. 2021. UX Research. [link]. Interaction Design Foundation, 2021. Online; accessed 22 March 2021.
Graham Gibbs. 2018. Analyzing Qualitative Data (2 ed.). SAGE Publications Ltd.
Colin M. Gray. 2016. "It's More of a Mindset Than a Method": UX Practitioners' Conception of Design Methods. In Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 4044--4055.
Guilherme Guerino, Marcos de Assumpção, Thiago da Silva, Laura Hokkanen, Renato Balancieri, and Gislaine Leal. 2022. User Experience Practices in Software Startups: A Systematic Mapping Study. Advances in Human-Computer Interaction 2022 (2022), 13 pages.
Hang Guo. 2016. Lean but not Mean UX: Towards a Spiral UX Design Model. In Design, User Experience, and Usability: Design Thinking and Methods. Springer International Publishing, Cham, 25--33.
Marc Hassenzahl. 2018. The Thing and I (Summer of '17 Remix). In Funology 2: From Usability to Enjoyment. Springer International Publishing, Cham, 17--31.
Marc Hassenzahl, Michael Burmester, and Franz Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In Berichte des German Chapter of the ACM. Vol. 57. Mensch & Computer 2003, Vieweg+Teubner Verlag, 187--196.
Marc Hassenzahl and Noam Tractinsky. 2006. User experience-a research agenda. Behaviour & information technology 25, 2 (2006), 91--97.
P. Hodgetts. 2005. Experiences integrating sophisticated user experience design practices into agile processes. In Agile Development Conference (ADC'05). IEEE, Denver, CO, USA, 235--242.
Laura Hokkanen, Kati Kuusinen, and Kaisa Väänänen. 2016. Minimum viable user experience: A framework for supporting product design in startups. In Agile Processes, in Software Engineering, and Extreme Programming (XP 2016), Vol. 251. Springer International Publishing, Cham, 66--78.
Laura Hokkanen and Marko Leppänen. 2015. Three patterns for user involvement in startups. In 20th European Conference on Pattern Languages of Programs (Kaufbeuren, Germany). Association for Computing Machinery, New York, NY, USA, Article 51, 8 pages.
Laura Hokkanen and Kaisa Väänänen-Vainio-Mattila. 2015. UX Work in Startups: Current Practices and Future Needs. In Agile Processes in Software Engineering and Extreme Programming (XP 2015). Springer International Publishing, Cham, 81--92.
Eleonora Ibragimova, Leanda Verboom, and Nick Mueller. 2017. Building a Team to Champion User-Centered Design Within an Agile Process. In Design, User Experience, and Usability: Theory, Methodology, and Management. Springer International Publishing, Cham, 584--596.
Minna Isomursu, Andrey Sirotkin, Petri Voltti, and Markku Halonen. 2012. User Experience Design Goes Agile in Lean Transformation - A Case Study. In Agile Conference 2012. IEEE, Dallas, TX, USA, 1--10.
Gabriela Jurca, Theodore D. Hellmann, and Frank Maurer. 2014. Integrating Agile and User-Centered Design: A Systematic Mapping and Review of Evaluation and Validation Studies of Agile-UX. In Agile Conference 2014. IEEE, Kissimmee, FL, USA, 24--32.
Evangelos Karapanos, Jean-Bernard Martens, and Marc Hassenzahl. 2010. On the Retrospective Assessment of Users' Experiences over Time: Memory or Actuality? In Extended Abstracts on Human Factors in Computing Systems (CHI '10). Association for Computing Machinery, New York, NY, USA, 4075--4080.
Evangelos Karapanos, Jean-Bernard Martens, and Marc Hassenzahl. 2012. Reconstructing experiences with iScale. International Journal of Human-Computer Studies 70, 11 (2012), 849--865.
Pariya Kashfi, Robert Feldt, and Agneta Nilsson. 2019. Integrating UX principles and practices into software development organizations: A case study of influencing events. Journal of Systems and Software 154 (2019), 37--58.
Pariya Kashfi, Agneta Nilsson, and Robert Feldt. 2017. Integrating User eXperience practices into software development processes: implications of the UX characteristics. PeerJ Computer Science 3:e130 (2017), 40 pages.
Vincent Kervyn de Meerendré, Luka Rukonić, and Suzanne Kieffer. 2019. Overcoming Organizational Barriers to the Integration of UX Methods in Software Development: A Case Study. In Design, User Experience, and Usability. Practice and Case Studies, Vol. 11586. Springer International Publishing, Cham, 263--276.
Katja Kevic, Brendan Murphy, Laurie Williams, and Jennifer Beckmann. 2017. Characterizing Experimentation in Continuous Deployment: A Case Study on Bing. In 39th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP). IEEE, Buenos Aires, Argentina, 123--132.
Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. Technical Report EBSE 2007-001. Keele University and Durham University Joint Report. 57 pages. https://www.elsevier.com/_data/promis_misc/525444systematicreviewsguide.pdf.
Edna Kropp and Kolja Koischwitz. 2014. User-centered-design in agile RE through an On-site User Experience Consultant. In 2nd International Workshop on Usability and Accessibility Focused Requirements Engineering (UsARE). IEEE, Karlskrona, Sweden, 9--12.
Kelly Krout, Juan Pablo Carrascal, and Travis Lowdermilk. 2020. Lean UX Research at Scale: A Case Study. In Conference on Mensch und Computer (MuC '20) (Magdeburg, Germany). Association for Computing Machinery, New York, NY, USA, 53--59.
Sari Kujala, Virpi Roto, Kaisa Väänänen-Vainio-Mattila, Evangelos Karapanos, and Arto Sinnelä. 2011. UX Curve: A method for evaluating long-term user experience. Interacting with computers 23, 5 (2011), 473--483.
Sari Kujala, Marlene Vogel, Anna E. Pohlmeyer, and Marianna Obrist. 2013. Lost in Time: The Meaning of Temporal Aspects in User Experience. In Extended Abstracts on Human Factors in Computing Systems (CHI EA '13) (Paris, France). Association for Computing Machinery, New York, NY, USA, 559--564.
Kati Kuusinen. 2015. Overcoming Challenges in Agile User Experience Work: Cross-Case Analysis of Two Large Software Organizations. In 41st Euromicro Conference on Software Engineering and Advanced Applications. IEEE, ., 454--458.
Kati Kuusinen, Martin Kjølbye Sørensen, Nicklas Frederiksen, Niclas Laugesen, and Søren Juul. 2019. From Startup to Scaleup: An Interview Study of the Development of User Experience Work in a Data-Intensive Company. In Human-Centered Software Engineering, Vol. 11262. Springer International Publishing, Cham, 3--14.
Richard Landis and Gary Koch. 1977. The measurement of observer agreement for categorical data. International Biometric Society, JSTOR 33 (1977), 159--174.
Marta Lárusdóttir, Åsa Cajander, and Jan Gulliksen. 2012. The Big Picture of UX is Missing in Scrum Projects. In 7th Nordic Conference on Human-Computer Interaction, NordiCHI 2012. Association for Computing Machinery, Copenhagen, Denmark, 42--48. [link].
Effie Lai-Chong Law and Marta Lárusdóttir. 2015. Whose Experience Do We Care About? Analysis of the Fitness of Scrum and Kanban to User Experience. International Journal of Human-Computer Interaction 31, 9 (2015), 584--602.
Effie Lai-Chong Law, Paul van Schaik, and Virpi Roto. 2014. Attitudes towards user experience (UX) measurement. International Journal of Human-Computer Studies 72, 6 (2014), 526--541. Interplay between User Experience Evaluation and System Development.
Khalid Majrashi and Areej Al-Wabil. 2018. HCI Practices in Software-Development Environments in Saudi Arabia. In Cross-Cultural Design. Methods, Tools, and Users, Vol. 10911. Springer International Publishing, Cham, 58--77.
Patrizia Marti and Iolanda Iacono. 2016. Anticipated, momentary, episodic, remembered: the many facets of User eXperience. In Federated Conference on Computer Science and Information Systems (FedCSIS 2016). IEEE, Gdansk, Poland, 1647--1655. https://ieeexplore.ieee.org/document/7733474
Alexandra Matz and Panagiotis Germanakos. 2016. Increasing the Quality of Use Case Definition Through a Design Thinking Collaborative Method and an Alternative Hybrid Documentation Style. In Learning and Collaboration Technologies, Vol. 9753. Springer International Publishing, Cham, 48--59.
Beverly May. 2012. Applying Lean Startup: An Experience Report-Lean & Lean UX by a UX Veteran: Lessons Learned in Creating & Launching a Complex Consumer App. In Agile Conference 2012. IEEE, Dallas, TX, USA, 141--147.
Faith McCreary, Anne McEwan, Derrick Schloss, and Marla Gomez. 2014. Envisioning a New Future for the Enterprise with a Big Data Experience Framework. In New Perspectives in Information Systems and Technologies. Springer International Publishing, Cham, 199--209.
Don Norman and Jacob Nielsen. 2020. The Definition of User Experience (UX). https://www.nngroup.com/articles/definition-user-experience/. Nielsen Norman Group (NNGroup), 2020. Online; accessed 22 March 2021.
Abiodun Ogunyemi, David Lamas, and Emmanuel Eze. 2018. Exploring the state of human-centred design practice in software development companies: A cross-case analysis of three Nigerian software companies. Interacting with Computers 30, 5 (2018), 444--467.
Tina Øvad, Nis Bornoe, Lars Bo Larsen, and Jan Stage. 2015. Teaching Software Developers to Perform UX Tasks. In Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI '15) (Parkville, VIC, Australia). Association for Computing Machinery, New York, NY, USA, 397--406.
Nicolò Paternoster, Carmine Giardino, Michael Unterkalmsteiner, Tony Gorschek, and Pekka Abrahamsson. 2014. Software development in startup companies: A systematic mapping study. Information and Software Technology 56, 10 (2014), 1200--1218.
Korina Pazitka. 2019. The UX Research Methods Every Designer Needs To Know. [link]. CareerFoundry, 2019. Online; accessed 22 March 2021.
Narendren Pillay and Jeanette Wing. 2019. Agile UX: Integrating good UX development practices in Agile. In Conference on Information Communications Technology and Society (ICTAS 2019). IEEE, Durban, South Africa, 1--6.
Luis Rivero and Tayana Conte. 2017. A Systematic Mapping Study on Research Contributions on UX Evaluation Technologies. In XVI Brazilian Symposium on Human Factors in Computing Systems (Joinville, Brazil). Association for Computing Machinery, New York, NY, USA, Article 5, 10 pages.
Maria Rosala and Rachel Krause. 2019. User Experience Careers: What a Career in UX Looks Like Today. [link]. Nielsen Norman Group (NNGroup). Online; accessed 22 March 2021.
Virpi Roto, EL-C Law, Arnold POS Vermeeren, and Jettie Hoonhout. 2011. User experience white paper: Bringing clarity to the concept of user experience. Dagstuhl seminar on demarcating user experience 1 (2011), 12 pages. http://www.allaboutux.org/files/UX-WhitePaper.pdf (september 15--18, 2010).
Jullia Saad, Suéllen Martinelli, Leticia Machado, Cleidson de Souza, Alexandre Alvaro, and Luciana Zaina. 2021. UX work in software startups: A thematic analysis of the literature. Information and Software Technology 140 (2021), 106688.
Dina Salah, Richard F. Paige, and Paul Cairns. 2014. A Systematic Literature Review for Agile Development Processes and User Centred Design Integration. In 18th International Conference on Evaluation and Assessment in Software Engineering (London, England, UK). Association for Computing Machinery, New York, NY, USA, Article 5, 10 pages.
Eva-Maria Schön, Dominique Winter, Jan Uhlenbrok, María José Escalona Cuaresma, and Jörg Thomaschewski. 2016. Enterprise experience into the integration of human-centered design and Kanban. In 11th International Joint Conference on Software Technologies. ScitePress Digital Library, Lisbon, Portugal, 133--140.
Eva-Maria Schön, Jörg Thomaschewski, and María José Escalona. 2020. Lean User Research for Agile Organizations. IEEE Access 8 (2020), 129763--129773.
Bhuvana Sekar. 2017. Enterprise Software Experience Design: Journey and Lessons. In Human-Computer Interaction (INTERACT 2017), Vol. 10516. Springer International Publishing, Cham, 356--359.
Sedef Süner-Pla-Cerdà, Gülşen Töre Yargin, Hilal Şahin, and Semih Daniş. 2021. Examining the Impact of Covid-19 Pandemic on UX Research Practice Through UX Blogs. In Design, User Experience, and Usability: UX Research and Design, Vol. 12779. Springer International Publishing, Cham, 579--592.
Degif Teka, Yvonne Dittrich, and Mesfin Kifle. 2018. Adapting Lightweight User-Centered Design with the Scrum-Based Development Process. In International Conference on Software Engineering in Africa (SEiA '18) (Gothenburg, Sweden). Association for Computing Machinery, New York, NY, USA, 35--42.
Jim Ungar. 2008. The design studio: Interface design for agile teams. In Agile Conference 2008. IEEE, Toronto, ON, Canada, 519--524.
Michael Unterkalmsteiner, Pekka Abrahamsson, Xiaofeng Wang, Anh Nguyen-Duc, Syed QA Shah, Sohaib Shahid Bajwa, Guido H Baltes, Kieran Conboy, Eoin Cullina, Denis Dennehy, et al. 2016. Software startups-a research agenda. e-Informatica Software Engineering Journal 10, 1 (2016), 89--123.
Jari Varsaluoma and Farrukh Sahar. 2014. Usefulness of Long-Term User Experience Evaluation to Product Development: Practitioners' Views from Three Case Studies. In 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (Helsinki, Finland). Association for Computing Machinery, New York, NY, USA, 79--88.
Arnold Vermeeren, Effie Lai-Chong Law, Virpi Roto, Marianna Obrist, Jettie Hoonhout, and Kaisa Väänänen-Vainio-Mattila. 2010. User experience evaluation methods: current state and development needs. In 6th Nordic conference on human-computer interaction: Extending boundaries. Association for Computing Machinery, Reykjavik, Iceland, 521--530.
Jorick Vissers, Lode De Bot, and Bieke Zaman. 2013. MemoLine: Evaluating Long-Term UX with Children. In 12th International Conference on Interaction Design and Children (IDC '13) (New York, USA). Association for Computing Machinery, New York, NY, USA, 285--288.
Adeola Yetunde Wale-Kolade. 2015. Integrating usability work into a large inter-organisational agile development project: Tactics developed by usability designers. Journal of Systems and Software 100 (2015), 54--66.
Jeff Winter, Kari Ronkko, and Mats Hellman. 2009. Reporting usability metrics experiences. In Workshop on Cooperative and Human Aspects on Software Engineering (ICSE 2009). IEEE, Vancouver, BC, Canada, 108--115.
Tong Xia, Sumit Bhardwaj, Pavel Dmitriev, and Aleksander Fabijan. 2019. Safe Velocity: A Practical Guide to Software Deployment at Scale using Controlled Rollout. In 41st International Conference on Software Engineering: Software Engineering in Practice. IEEE, Montreal, QC, Canada, 11--20.
Tina Øvad and Lars Bo Larsen. 2015. The Prevalence of UX Design in Agile Development Processes in Industry. In Agile Conference 2015. IEEE, National Harbor, MD, USA, 40--49.
Tina Øvad and Lars Bo Larsen. 2016. How to reduce the UX bottleneck - train your software developers. Behaviour & Information Technology 35, 12 (2016), 1080--1090.
Publicado
17/10/2022
Como Citar
MARTINELLI, Suéllen; LOPES, Larissa; ZAINA, Luciana.
UX research in the software industry: an investigation of long-term UX practices. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 21. , 2022, Diamantina.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
