Perceptions about Usefulness and Attitudes toward UX work: a survey with software startup Brazilian professionals

Resumo


User eXperience (UX) work in the software industry involves employing user-centered practices and techniques to obtain and apply knowledge about the users. In this sense, UX work can help software startups to have a competitive advantage since these companies have a challenging context characterized by small teams and a lack of resources. However, the perspectives of startup professionals on UX work are yet to be explored, despite growing interest in the field. This paper aims to explore the perceptions of startup professionals about the usefulness of the methods and techniques used in UX work and at what moments of user interaction with the product or service they are using. To achieve this goal, we conducted a survey with 90 professionals from software startups in Brazil. For data analysis, we adopted descriptive and inferential statistical methods. We identified that software startup professionals seek to understand user needs, capture feedback, and test with users, these being the most attitudes applied toward UX work. Interviews are the most used method, but usability testing, competitive analysis, and high-fidelity prototyping are also useful for startups in different stages of maturity. Besides, UX data is collected at distinct moments, particularly during user interactions with the product. Our findings allowed us to verify the perceived usefulness of software startup professionals toward UX work, but this view varies according to the startup stage.
Palavras-chave: Software Startup, User Experience, UX Attitudes, Long-Term UX, Survey, Quantitative Analysis

Referências

ISO: 9241-210:2009. 2009. Ergonomics of Human System Interaction-Part 210: Human-Centred Design for Interactive Systems. [link]. In International Standardization Organization. (ISO), Switzerland. Online; accessed 03 May 2022.

Obead Alhadreti. 2020. Exploring UX Maturity in Software Development Environments in Saudi Arabia. International Journal of Advanced Computer Science and Applications (IJACSA) 11, 12 (2020), 168–174. DOI: 10.14569/IJACSA.2020.0111221

Daniel Domingos Alves and Ecivaldo Matos. 2019. A Survey on Interaction Design in Distributed Software Development. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems (Vitória, Espírito Santo, Brazil) (IHC ’19). Association for Computing Machinery, New York, NY, USA. DOI: 10.1145/3357155.3358485

Associação Brasileira de Startups. 2020. Fases de uma startup: saiba tudo sobre cada etapa. [link]. Abstartup, 2020. Online; accessed 02 May 2023.

Irene Au, Richard Boardman, Robin Jeffries, Patrick Larvie, Antonella Pavese, Jens Riegelsberger, Kerry Rodden, and Molly Stevens. 2008. User Experience at Google: Focus on the User and All Else Will Follow. In SIGCHI Conference on Human Factors in Computing Systems (CHI ’08) (Florence, Italy). Association for Computing Machinery, New York, NY, USA, 3681–3686. DOI: 10.1145/1358628.1358912

Javier Bargas-Avila and Kasper Hornbæk. 2011. Old Wine in New Bottles or Novel Challenges: A Critical Analysis of Empirical Studies of User Experience. In 29th SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada). Association for Computing Machinery, New York, NY, USA, 2689–2698. DOI: 10.1145/1978942.1979336

Elizabeth Bjarnason. 2021. Prototyping practices in software startups: Initial case study results. In IEEE 29th International Requirements Engineering Conference Workshops (REW). IEEE, Notre Dame, IN, USA, 206–211.

Jay Brewer, Ger Joyce, and Saurabh Dutta. 2017. Converging Data with Design Within Agile and Continuous Delivery Environments. In Design, User Experience, and Usability: Theory, Methodology, and Management. Springer International Publishing, Cham, 533–542. DOI: 10.1007/978-3-319-58634-2_39

Parmit Chilana, Christina Holsberry, Flavio Oliveira, and Amy Ko. 2012. Designing for a Billion Users: A Case Study of Facebook. In Extended Abstracts on Human Factors in Computing Systems (CHI ’12) (Austin, Texas, USA). Association for Computing Machinery, New York, NY, USA, 419–432. DOI: 10.1145/2212776.2212819

Joelma Choma, Eduardo M. Guerra, Alexandre Alvaro, Roberto Pereira, and Luciana Zaina. 2022. Influences of UX factors in the Agile UX context of software startups. Information and Software Technology 152 (2022), 107041. DOI: 10.1016/j.infsof.2022.107041

Teresita de Jesús Álvarez Robles, Francisco Javier Álvarez Rodríguez, Edgard Benítez-Guerrero, and Cristian Rusu. 2019. Adapting card sorting for blind people: Evaluation of the interaction design in TalkBack. Computer Standards & Interfaces 66 (2019), 103356. DOI: 10.1016/j.csi.2019.103356

Ed de Quincey and James Mitchell. 2022. Card Sorting for User Experience Design. Interacting with Computers 33, 4 (06 2022), 442–457. DOI: 10.1093/iwc/iwac002 [link]

Critchlow E Douglas and Fligner A Michael. 1991. On distribution-free multiple comparisons in the one-way analysis of variance. Communications in Statistics-Theory and Methods 20, 1 (1991), 127–139.

Ahmad Nauman Ghazi, Kai Petersen, Sri Sai Vijay Raj Reddy, and Harini Nekkanti. 2019. Survey Research in Software Engineering: Problems and Mitigation Strategies. IEEE Access 7 (2019), 24703–24718. DOI: 10.1109/ACCESS.2018.2881041

Carmine Giardino, Sohaib Shahid Bajwa, Xiaofeng Wang, and Pekka Abrahamsson. 2015. Key Challenges in Early-Stage Software Startups. In Agile Processes in Software Engineering and Extreme Programming. Springer International Publishing, Cham, 52–63. DOI: 10.1007/978-3-319-18612-2_5

Carmine Giardino, Michael Unterkalmsteiner, Nicolò Paternoster, Tony Gorschek, and Pekka Abrahamsson. 2014. What Do We Know about Software Development in Startups?IEEE Software 31, 5 (2014), 28–32. DOI: 10.1109/MS.2014.129

Guilherme Guerino, Marcos de Assumpção, Thiago da Silva, Laura Hokkanen, Renato Balancieri, and Gislaine Leal. 2022. User Experience Practices in Software Startups: A Systematic Mapping Study. Advances in Human-Computer Interaction 2022 (2022), 13 pages. DOI: 10.1155/2022/9701739

Guilherme Corredato Guerino, Nayra Suellen Borges Cruz Dias, Rafael Chanin, Rafael Prikladnicki, Renato Balancieri, and Gislaine Camila Lapasini Leal. 2021. User Experience Practices in Early-Stage Software Startups - An Exploratory Study. In Software Business, Xiaofeng Wang, Antonio Martini, Anh Nguyen-Duc, and Viktoria Stray (Eds.). Springer International Publishing, Cham, 122–136.

Hang Guo. 2016. Lean but not Mean UX: Towards a Spiral UX Design Model. In Design, User Experience, and Usability: Design Thinking and Methods. Springer International Publishing, Cham, 25–33. DOI: 10.1007/978-3-319-40409-7_3

Yan Ru Guo and Dion Hoe-Lian Goh. 2016. From Storyboard to Software: User Evaluation of an Information Literacy Game. In Proceedings of the 31st Annual ACM Symposium on Applied Computing (Pisa, Italy) (SAC ’16). Association for Computing Machinery, New York, NY, USA, 199–201. DOI: 10.1145/2851613.2851909

Marc Hassenzahl. 2018. The Thing and I (Summer of ’17 Remix). In Funology 2: From Usability to Enjoyment. Springer International Publishing, Cham, 17–31. DOI: 10.1007/978-3-319-68213-6_2

Marc Hassenzahl and Noam Tractinsky. 2006. User experience-a research agenda. Behaviour & information technology 25, 2 (2006), 91–97. DOI: 10.1080/01449290500330331

Laura Hokkanen, Kati Kuusinen, and Kaisa Väänänen. 2016. Minimum viable user experience: A framework for supporting product design in startups. In Agile Processes, in Software Engineering, and Extreme Programming (XP 2016), Vol. 251. Springer International Publishing, Cham, 66–78. DOI: 10.1007/978-3-319-33515-5_6

Laura Hokkanen and Marko Leppänen. 2015. Three patterns for user involvement in startups. In 20th European Conference on Pattern Languages of Programs (Kaufbeuren, Germany). Association for Computing Machinery, New York, NY, USA, Article 51, 8 pages. DOI: 10.1145/2855321.2855373

Laura Hokkanen and Kaisa Väänänen-Vainio-Mattila. 2015. UX Work in Startups: Current Practices and Future Needs. In Agile Processes in Software Engineering and Extreme Programming (XP 2015). Springer International Publishing, Cham, 81–92. DOI: 10.1007/978-3-319-18612-2_7

Laura Hokkanen, Yueqiang Xu, and Kaisa Väänänen. 2016. Focusing on User Experience and Business Models in Startups: Investigation of Two-Dimensional Value Creation. In 20th International Academic Mindtrek Conference. ACM, New York, NY, USA, 59–67. DOI: 10.1145/2994310.2994371

Pariya Kashfi, Robert Feldt, and Agneta Nilsson. 2019. Integrating UX principles and practices into software development organizations: A case study of influencing events. Journal of Systems and Software 154 (2019), 37–58. DOI: 10.1016/j.jss.2019.03.066

Katja Kevic, Brendan Murphy, Laurie Williams, and Jennifer Beckmann. 2017. Characterizing Experimentation in Continuous Deployment: A Case Study on Bing. In 39th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP). IEEE, Buenos Aires, Argentina, 123–132. DOI: 10.1109/ICSE-SEIP.2017.19

S. Kieffer, L. Rukonic, V. K. de Meerendré, and J. Vanderdonckt. 2019. Specification of a UX process reference model towards the strategic planning of UX activities. In VISIGRAPP 2019 - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Vol. 2. SCITEPRESS – Science and Technology Publications, Prague, Czech Republic, 74–85.

Barbara A. Kitchenham and Shari L. Pfleeger. 2008. Personal Opinion Surveys. Springer London, London, 63–92. DOI: 10.1007/978-1-84800-044-5_3

Eriks Klotins, Michael Unterkalmsteiner, Panagiota Chatzipetrou, Tony Gorschek, Rafael Prikladnicki, Nirnaya Tripathi, and Leandro Pompermaier. 2019. A Progression Model of Software Engineering Goals, Challenges, and Practices in Start-Ups. IEEE Transactions on Software Engineering 47, 3 (2019), 498 – 521. DOI: 10.1109/TSE.2019.2900213

E. Klotins, M. Unterkalmsteiner, and T. Gorschek. 2019. Software engineering in start-up companies: An analysis of 88 experience reports. Empirical Software Engineering 24, 68–102 (2019), 68–102. DOI: 10.1007/s10664-018-9620-y

Sari Kujala, Virpi Roto, Kaisa Väänänen-Vainio-Mattila, Evangelos Karapanos, and Arto Sinnelä. 2011. UX Curve: A method for evaluating long-term user experience. Interacting with computers 23, 5 (2011), 473–483. DOI: 10.1016/j.intcom.2011.06.005

Sari Kujala, Marlene Vogel, Anna E. Pohlmeyer, and Marianna Obrist. 2013. Lost in Time: The Meaning of Temporal Aspects in User Experience. In Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13) (Paris, France). Association for Computing Machinery, New York, NY, USA, 559–564. DOI: 10.1145/2468356.2468455

Youetta Kunneman, Mauricy Alves da Motta-Filho, and Jasper van der Waa. 2022. Data science for service design: An introductory overview of methods and opportunities. The Design Journal 25, 2 (2022), 186–204. DOI: 10.1080/14606925.2022.2042108

Kati Kuusinen. 2015. Overcoming Challenges in Agile User Experience Work: Cross-Case Analysis of Two Large Software Organizations. In 41st Euromicro Conference on Software Engineering and Advanced Applications. IEEE, Madeira, Portugal, 454–458. DOI: 10.1109/SEAA.2015.38

Kati Kuusinen, Martin Kjølbye Sørensen, Nicklas Mandrup Frederiksen, Niclas Kildahl Laugesen, and Søren Holm Juul. 2019. From Startup to Scaleup: An Interview Study of the Development of User Experience Work in a Data-Intensive Company. In Human-Centered Software Engineering. Springer International Publishing, Cham, 3–14. DOI: 10.1007/978-3-030-05909-5_1

Eveliina Lindgren and Jürgen Münch. 2016. Raising the odds of success: the current state of experimentation in product development. Information and Software Technology 77 (2016), 80–91. DOI: 10.1016/j.infsof.2016.04.008

Patrizia Marti and Iolanda Iacono. 2016. Anticipated, momentary, episodic, remembered: the many facets of User eXperience. In Federated Conference on Computer Science and Information Systems (FedCSIS 2016). IEEE, Gdansk, Poland, 1647–1655. [link]

Suéllen Martinelli, Larissa Lopes, and Luciana Zaina. 2022. UX Research in the Software Industry: An Investigation of Long-Term UX Practices. In Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC ’22). Association for Computing Machinery, New York, NY, USA, Article 30, 13 pages. DOI: 10.1145/3554364.3559126

Evie McCrum-Gardner. 2008. Which is the correct statistical test to use?British Journal of Oral and Maxillofacial Surgery 46, 1 (2008), 38–41.

M. Meingast, H. Packard, T. Ballew, R. Edwards, E. Nordquist, C. Sader, and D. Smith. 2013. Agile and UX: The road to integration-The challenges of the UX practitioner in an agile environment. Proceedings of the Human Factors and Ergonomics Society 57 (2013), 1002–1006. DOI: 10.1177/1541931213571224

Bianca Melo and Ticianne Darin. 2019. Scope and Definition of User Experience in Brazil: A Survey to Explore Community’s Perspectives. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems (Vitória, Espírito Santo, Brazil) (IHC ’19). Association for Computing Machinery, New York, NY, USA. DOI: 10.1145/3357155.3358444

Emmanuel Mkpojiogu, Obianuju Okeke-Uzodike, and Victor Omopariola. 2022. Methods for the Evaluation of UX Over Time. In International Conferences Interfaces and Human Computer Interaction (IHCI). Lisbon, Portugal, 1–9. [link]

Anh Nguyen-Duc, Xiaofeng Wang, and Pekka Abrahamsson. 2017. What influences the speed of prototyping? An empirical investigation of twenty software startups. In Agile Processes in Software Engineering and Extreme Programming: 18th International Conference, XP 2017, Cologne, Germany, May 22-26, 2017, Proceedings 18. Springer International Publishing, Cologne, Germany, 20–36. DOI: 10.1007/978-3-319-57633-6_2

Don Norman and Jacob Nielsen. 2020. The Definition of User Experience (UX). [link]. Nielsen Norman Group (NNGroup), 2020. Online; accessed 02 May 2023.

Nicolò Paternoster, Carmine Giardino, Michael Unterkalmsteiner, Tony Gorschek, and Pekka Abrahamsson. 2014. Software development in startup companies: A systematic mapping study. Information and Software Technology 56, 10 (2014), 1200–1218. DOI: 10.1016/j.infsof.2014.04.014

Talita Cristina Pagani Britto Pichiliani and Ednaldo Brigante Pizzolato. 2019. A Survey on the Awareness of Brazilian Web Development Community about Cognitive Accessibility. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems (Vitória, Espírito Santo, Brazil) (IHC ’19). Association for Computing Machinery, New York, NY, USA. DOI: 10.1145/3357155.3358448

Anna Pohlmeyer. 2012. Identifying Attribute Importance in Early Product Development. Exemplified by Interactive Technologies and Age. Doctoral Thesis. Technische Universität Berlin. DOI: 10.14279/depositonce-3158

Luis Rivero and Tayana Conte. 2017. A Systematic Mapping Study on Research Contributions on UX Evaluation Technologies. In XVI Brazilian Symposium on Human Factors in Computing Systems (Joinville, Brazil). Association for Computing Machinery, New York, NY, USA, Article 5, 10 pages. DOI: 10.1145/3160504.3160512

Virpi Roto, EL-C Law, Arnold POS Vermeeren, and Jettie Hoonhout. 2011. User experience white paper: Bringing clarity to the concept of user experience. Dagstuhl seminar on demarcating user experience 1 (2011), 12 pages. [link] (september 15-18, 2010).

Jullia Saad, Suéllen Martinelli, Leticia S. Machado, Cleidson R.B. de Souza, Alexandre Alvaro, and Luciana Zaina. 2021. UX work in software startups: A thematic analysis of the literature. Information and Software Technology 140 (2021), 106688. DOI: 10.1016/j.infsof.2021.106688

André de Lima Salgado, Leandro A. Amaral, André Pimenta Freire, and Renata Pontin M. Fortes. 2016. Usability and UX Practices in Small Enterprises: Lessons from a Survey of the Brazilian Context. In Proceedings of the 34th ACM International Conference on the Design of Communication (Silver Spring, MD, USA) (SIGDOC ’16). Association for Computing Machinery, New York, NY, USA, Article 18, 9 pages. DOI: 10.1145/2987592.2987616

Sofia A. M. Silveira, Joelma Choma, Roberto Pereira, Eduardo M. Guerra, and Luciana A. M. Zaina. 2021. UX Work in Software Start-Ups: Challenges from the Current State of Practice. In Agile Processes in Software Engineering and Extreme Programming. Springer International Publishing, Cham, 19–35. DOI: 10.1007/978-3-030-78098-2_2

Degif Teka, Yvonne Dittrich, and Mesfin Kifle. 2018. Adapting Lightweight User-Centered Design with the Scrum-Based Development Process. In International Conference on Software Engineering in Africa (SEiA ’18) (Gothenburg, Sweden). Association for Computing Machinery, New York, NY, USA, 35–42. DOI: 10.1145/3195528.3195530

Tom Tullis and Bill Albert. 2013. Measuring the User Experience (second edition ed.). Morgan Kaufmann, Boston. 301 pages. DOI: 10.1016/C2011-0-00016-9

Michael Unterkalmsteiner, Pekka Abrahamsson, Xiaofeng Wang, Anh Nguyen-Duc, Syed QA Shah, Sohaib Shahid Bajwa, Guido H Baltes, Kieran Conboy, Eoin Cullina, Denis Dennehy, 2016. Software startups–a research agenda. e-Informatica Software Engineering Journal 10, 1 (2016), 89–123. DOI: 10.5277/e-Inf160105

Jari Varsaluoma and Farrukh Sahar. 2014. Usefulness of Long-Term User Experience Evaluation to Product Development: Practitioners’ Views from Three Case Studies. In 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (Helsinki, Finland). Association for Computing Machinery, New York, NY, USA, 79–88. DOI: 10.1145/2639189.2641218

Eliane Zambon Victorelli, Julio Cesar Dos Reis, Heiko Hornung, and Alysson Bolognesi Prado. 2020. Understanding human-data interaction: Literature review and recommendations for design. International Journal of Human-Computer Studies 134 (2020), 13–32. DOI: 10.1016/j.ijhcs.2019.09.004

Dijana Plantak Vukovac, Miso Dzeko, Zlatko Stapic, and Tihomir Orehovacki. 2019. User Experience Design and Architecture of IoT Ecosystem Employed in Students’ Activities Tracking. In International Conference on Ergonomics in Design (AHFE 2018)(Advances in Intelligent Systems and Computing, Vol. 777), F Rebelo and MM Soares (Eds.). Springer International Publishing, Orlando, FL, USA, 440–452. DOI: 10.1007/978-3-319-94706-8_48

Claes Wohlin, Per Runeson, Martin Höst, Magnus C Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in software engineering. Springer Science & Business Media, Springer Berlin, Heidelberg. 236 pages.

Luciana Zaina, Joelma Choma, Jullia Saad, Leonor Barroca, Helen Sharp, Leticia S. Machado, and Cleidson R.B. de Souza. 2023. What do software startups need from UX work?Empirical Software Engineering 80 (2023), 45. DOI: 10.1007/s10664-023-10322-x

Luciana A.M. Zaina, Helen Sharp, and Leonor Barroca. 2021. UX information in the daily work of an agile team: A distributed cognition analysis. International Journal of Human-Computer Studies 147 (2021), 102574. DOI: 10.1016/j.ijhcs.2020.102574
Publicado
16/10/2023
GUERINO, Guilherme Corredato; MARTINELLI, Suéllen; CHOMA, Joelma; LEAL, Gislaine Camila Lapasini; BALANCIERI, Renato; ZAINA, Luciana. Perceptions about Usefulness and Attitudes toward UX work: a survey with software startup Brazilian professionals. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 22. , 2023, Maceió/AL. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2023 .