Assessment of visual aesthetics through human judgments: a systematic mapping
Resumo
Visual aesthetics is an essential factor of the perceived usability, credibility, and general quality of graphical user interfaces (GUIs). Its assessment as part of the software process is critical but highly subjective, making it difficult to obtain reliable and valid results. This article presents a systematic mapping analyzing measures and data collection instruments to understand how humans can assess GUI visual aesthetics with reliability and validity. We encountered 148 studies assessing visual aesthetics through human judgments, either as an unidimensional or a multidimensional construct. Most studies that assess visual aesthetics as a composition of multiple dimensions apply the classical/expressive or the VisAWI questionnaire. Yet, we observed large variability regarding research design, including the number of assessed GUIs, ratings, and raters. Although most studies report demographic data, very few analyze their influence on the results. Less than half of the studies evaluate reliability or validity. We expect the results to contribute to subjective assessments of GUI visual aesthetics, help practitioners select and use appropriate methods, and point out research opportunities in this area.
Palavras-chave:
visual aesthetics, GUI design, subjective assessment, systematic mapping
Referências
Anshu Agarwal and Alan Hedge. 2008. The Impact of Web Page Usability Guideline Implementation on Aesthetics and Perceptions of the E-Retailer. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 52, 6 (Sept. 2008), 528--532. Publisher: SAGE Publications Inc.
Ons Al-Shamaileh and Alistair Sutcliffe. 2012. The Effect of Website Interactivity and Repeated Exposure on User Experience. In Proceedings of the 4th Mexican Conference on Human-Computer Interaction (MexIHC '12). Association for Computing Machinery, New York, NY, USA, 1--8.
Ons Al-Shamaileh and Alistair Sutcliffe. 2012. Investigating a Multi-faceted View of User Experience. In Proceedings of the 24th Australian Computer-Human Interaction Conference (OzCHI '12). Association for Computing Machinery, New York, NY, USA, 9--18.
Ahamed Altaboli and Yingzi Lin. 2010. Experimental Investigation of Effects of Balance, Unity, and Sequence on Interface and Screen Design Aesthetics. In IADIS International Conference Interfaces and Human Computer Interaction 2010 (part of MCCSIS 2010). 243--250. [link].
Ahamed Altaboli and Yingzi Lin. 2012. Effects of Unity of Form and Symmetry on Visual Aesthetics of Website Interface Design. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56, 1 (Sept. 2012), 728--732. Publisher: SAGE Publications Inc.
Maxim Bakaev, Maximilian Speicher, Sebastian Heil, and Martin Gaedke. 2020. I Don't Have That Much Data! Reusing User Behavior Models for Websites from Different Domains. In Web Engineering (Lecture Notes in Computer Science), Maria Bielikova, Tommi Mikkonen, and Cesare Pautasso (Eds.). Springer International Publishing, Cham, 146--162.
Michael Bauerly and Yili Liu. 2006. Computational modeling and experimental investigation of effects of compositional elements on interface and design aesthetics. International Journal of Human-Computer Studies 64, 8 (Aug. 2006), 670--682.
Michael Bauerly and Yili Liu. 2008. Effects of Symmetry and Number of Compositional Elements on Interface and Design Aesthetics. International Journal of Human-Computer Interaction 24, 3 (March 2008), 275--287. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/10447310801920508.
Michael Bauerly and Yili Liu. 2009. Evaluation and Improvement of Interface Aesthetics with an Interactive Genetic Algorithm. International Journal of Human-Computer Interaction 25, 2 (2009), 155--166. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/10447310802629801.
Amanda Baughan, Tal August, Naomi Yamashita, and Katharina Reinecke. 2020. Keep it Simple: How Visual Complexity and Preferences Impact Search Efficiency on Websites. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--10.
Upasna Bhandari, Klarissa Chang, and Tillmann Neben. 2019. Understanding the Impact of Perceived Visual Aesthetics on User Evaluations: An Emotional perspective. Information & Management 56, 1 (2019), 85--93.
Upasna Bhandari, Tillman Neben, and Klarissa Chang. 2015. Understanding Visual Appeal and Quality Perceptions of Mobile Apps: An Emotional Perspective. In Human-Computer Interaction: Design and Evaluation (Lecture Notes in Computer Science), Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 451--459.
Upasna Bhandari, Tillmann Neben, Klarissa Chang, and Wen Yong Chua. 2017. Effects of Interface Design Factors on Affective Responses and Quality Evaluations in Mobile Applications. Computers in Human Behavior 72 (2017), 525--534. Place: Netherlands Publisher: Elsevier Science.
Anol Bhattacherjee. 2012. Social Science Research: Principles, Methods, and Practices (2nd edition ed.). CreateSpace Independent Publishing Platform.
John Brooke. 1996. SUS: A 'Quick and Dirty' Usability Scale. In Usability Evaluation In Industry. CRC Press, 189--194. Google-Books-ID: IfUsRmzAqvEC.
D. Chang, F. Li, and L. Huang. 2020. A User-centered Evaluation and Redesign Approach for E-Government APP. In 2020 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM). 270--274.
Aline Chevalier, Anne-Claire Maury, and Nicolas Fouquereau. 2014. The Influence of the Search Complexity and the Familiarity with the Website on the Subjective Appraisal of Aesthetics, Mental Effort and Usability. Behaviour & Information Technology 33, 2 (2014), 117--132. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/0144929X.2013.819936.
Louis Cohen, Lawrence Manion, and Keith Morrison. 2017. Research Methods in Education (8th edition ed.). Routledge, London; New York.
Sara M. Conklin, Richard J. Koubek, James A. Thurman, and Leah C. Newman. 2006. The Effects of Aesthetics and Cognitive, Style on Perceived Usability. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 18 (Oct. 2006), 2153--2157. Publisher: SAGE Publications Inc.
Mick P. Couper, Roger Tourangeau, Frederick G. Conrad, and Eleanor Singer. 2006. Evaluating the Effectiveness of Visual Analog Scales: A Web Experiment. Social Science Computer Review 24, 2 (May 2006), 227--245. Publisher: SAGE Publications Inc.
Eli P. Cox. 1980. The Optimal Number of Response Alternatives for a Scale: A Review. Journal of Marketing Research 17, 4 (Nov. 1980), 407--422. Publisher: SAGE Publications Inc.
Dianne Cyr, Milena Head, and Alex Ivanov. 2006. Design aesthetics leading to m-loyalty in mobile commerce. Information & Management 43, 8 (Dec. 2006), 950--963.
Hannah Dames, Gerrit Hirschfeld, Timo Sackmann, and Meinald T Thielsch. 2019. Searching vs. Browsing---The Influence of Consumers' Goal Directedness on Website Evaluations. Interacting with Computers 31, 1 (Jan. 2019), 95--112.
Antonella De Angeli, Alistair Sutcliffe, and Jan Hartmann. 2006. Interaction, usability and aesthetics: what influences users' preferences?. In Proceedings of the 6th conference on Designing Interactive systems (DIS '06). Association for Computing Machinery, New York, NY, USA, 271--280.
Henrica C. W. de Vet, Caroline B. Terwee, Dirk L. Knol, and Lex M. Bouter. 2006. When to Use Agreement Versus Reliability Measures. Journal of Clinical Epidemiology 59, 10 (Oct. 2006), 1033--1039.
Soussan Djamasbi, Marisa Siegel, Jeanine Skorinko, and Tom Tullis. 2011. Online Viewing and Aesthetic Preferences of Generation Y and the Baby Boom Generation: Testing User Web Site Experience Through Eye Tracking. International Journal of Electronic Commerce 15, 4 (2011), 121--158. Publisher: Routledge _eprint: https://doi.org/10.2753/JEC1086-4415150404.
Maria Douneva, Rafael Jaron, and Meinald T. Thielsch. 2016. Effects of Different Website Designs on First Impressions, Aesthetic Judgements and Memory Performance after Short Presentation. Interacting with Computers 28, 4 (June 2016), 552--567.
Sophie Dupuy-Chessa, Yann Laurillau, and Eric Céret. 2016. Considering aesthetics and usability temporalities in a model based development process. In Actes de la 28ième conference francophone sur l'Interaction Homme-Machine (IHM '16). Association for Computing Machinery, New York, NY, USA, 25--35.
Ron Garland. 1991. The Mid-Point on a Rating Scale: Is it Desirable? Marketing Bulletin 2, 1 (1991), 66--70. [link]
Natasa Gisev, J. Simon Bell, and Timothy F. Chen. 2013. Interrater Agreement and Interrater Reliability: Key Concepts, Approaches, and Applications. Research in Social and Administrative Pharmacy 9, 3 (May 2013), 330--338.
Johanna K. P. Greeson, Daniel Treglia, Seth Morones, Marcia Hopkins, and Dominique Mikell. 2020. Development, Usability, Usefulness, & Accessibility of a Mobile Web-based App for Homeless and Unstably Housed Youth. Children and Youth Services Review 108 (Jan. 2020), 104586.
Christiane Gresse von Wangenheim, João V. Araujo Porto, Jean C. R. Hauck, and Adriano F. Borgatto. 2018. Do We Agree on User Interface Aesthetics of Android Apps? arXiv (Dec. 2018), 1--5. http://arxiv.org/abs/1812.09049
Zhenyu Gu, Chenhao Jin, Danny Chang, and Liqun Zhang. 2021. Predicting Webpage Aesthetics with Heatmap Entropy. Behaviour & Information Technology 40, 7 (May 2021), 676--690. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/0144929X.2020.1717626.
Jan Hartmann, Alistair Sutcliffe, and Antonella De Angeli. 2008. Towards a Theory of User Judgment of Aesthetics and User Interface Quality. ACM Transactions on Computer-Human Interaction 15, 4 (2008), 15:1--15:30.
Marc Hassenzahl. 2004. The Interplay of Beauty, Goodness, and Usability in Interactive Products. Human-Computer Interaction 19, 4 (Dec. 2004), 319--349. Publisher: Taylor & Francis _eprint: [link].
Roberta Heale and Alison Twycross. 2015. Validity and Reliability in Quantitative Studies. Evidence-Based Nursing 18, 3 (July 2015), 66--67. Publisher: Royal College of Nursing Section: Research made simple.
Shih-Miao Huang. 2013. A Study of Affective Meanings Predicting Aesthetic Preferences of Interactive Skins. In 2013 IEEE International Conference on Industrial Engineering and Engineering Management. 781--785. ISSN: 2157-362X.
Quan Huynh-Thu, Marie-Neige Garcia, Filippo Speranza, Philip Corriveau, and Alexander Raake. 2011. Study of Rating Scales for Subjective Quality Assessment of High-Definition Video. IEEE Transactions on Broadcasting 57, 1 (March 2011), 1--14. Conference Name: IEEE Transactions on Broadcasting.
ISO. 2011. ISO/IEC 25010:2011, Systems and Software Engineering --- Systems and Software Quality Requirements and Evaluation (SQuaRE) --- System and Software Quality Models. [link].
Alex Ivanov and Christoph Schneider. 2010. The Effects of Perceived Visual Aesthetics on Process Satisfaction in GSS Use. In 2010 43rd Hawaii International Conference on System Sciences. 1--10. ISSN: 1530-1605.
Carole L. Kimberlin and Almut G. Winterstein. 2008. Validity and Reliability of Measurement Instruments Used in Research. American Journal of Health-System Pharmacy 65, 23 (Dec. 2008), 2276--2284.
Jurek Kirakowski and Bozena Cierlik. 1998. Measuring the Usability of Web Sites. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 42, 4 (Oct. 1998), 424--428. Publisher: SAGE Publications Inc.
Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. Technical Report EBSE-2007-01.
Jan Kottner, Laurent Audige, Stig Brorson, Allan Donner, Byron J. Gajewski, Asbjørn Hróbjartsson, Chris Roberts, Mohamed Shoukri, and David L. Streiner. 2011. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. International Journal of Nursing Studies 48, 6 (June 2011), 661--671.
Panayiotis Koutsabasis and Theano G. Istikopoulou. 2013. Perceived Website Aesthetics by Users and Designers: Implications for Evaluation Practice. International Journal of Technology and Human Interaction (IJTHI) 9, 2 (2013), 39--52. Publisher: IGI Global.
Louisa Küchler, Guido Hertel, and Meinald T. Thielsch. 2020. Are You Willing to Donate? Relationship Between Perceived Website Design, Trust and Donation Decisions Online. In Proceedings of the Conference on Mensch und Computer (MuC '20). Association for Computing Machinery, New York, NY, USA, 223--227.
Andrés Larco, Carlos Montenegro, Esteban Diaz, and Sergio Luján-Mora. 2018. Underlying Quality Factors in Spanish Language Apps for People with Disabilities. In 2018 International Conference on eDemocracy eGovernment (ICEDEG). 110--116. ISSN: 2573-1998.
Talia Lavie and Noam Tractinsky. 2004. Assessing Dimensions of Perceived Visual Aesthetics of Web Sites. International Journal of Human-Computer Studies 60, 3 (March 2004), 269--298.
James R. Lewis and Oǧuzhan Erdinç. 2017. User Experience Rating Scales with 7, 11, or 101 Points: Does It Matter? Journal of Usability Studies 12, 2 (Feb. 2017), 73--91.
Adriano Luiz de Souza Lima and Christiane Gresse von Wangenheim. 2021. Assessing the Visual Esthetics of User Interfaces: A Ten-Year Systematic Mapping. International Journal of Human-Computer Interaction (June 2021), 1--21. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/10447318.2021.1926118.
Gitte Lindgaard and Cathy Dudek. 2003. What Is This Evasive Beast We Call User Satisfaction? Interacting with Computers 15, 3 (2003), 429--452.
Gitte Lindgaard, Gary Fernandes, Cathy Dudek, and J. Brown. 2006. Attention Web Designers: You Have 50 Milliseconds to Make a Good First Impression! Behaviour & Information Technology 25, 2 (March 2006), 115--126. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/01449290500330448.
Gitte Lindgaard, Justyna Litwinska, and Cathy Dudek. 2008. Judging Web Page Visual Appeal: Do East and West Really Differ?. In Proc. of Interfaces and Human Computer Interaction 2008, Vol. 8. Amsterdam, The Netherlands, 157--164.
Shuqing Liu, Tianyi Liang, Shuai Shao, and Jun Kong. 2020. Evaluating Localized MOOCs: The Role of Culture on Interface Design and User Experience. IEEE Access 8 (2020), 107927--107940. Conference Name: IEEE Access.
Luis M. Lozano, Eduardo García-Cueto, and José Muñiz. 2008. Effect of the Number of Response Categories on the Reliability and Validity of Rating Scales. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences 4, 2 (2008), 73--79. Place: Germany Publisher: Hogrefe & Huber Publishers.
Ranjan Maity and Samit Bhattacharya. 2018. Relating Aesthetics of the GUI Text Elements with Readability using Font Family. In Proceedings of the 2018 ACM Companion International Conference on Interactive Surfaces and Spaces (ISS '18 Companion). Association for Computing Machinery, New York, NY, USA, 63--68.
Alberto Maydeu-Olivares, Uwe Kramp, Carlos García-Forero, David Gallardo-Pujol, and Donna Coffman. 2009. The Effect of Varying the Number of Response Alternatives in Rating Scales: Experimental Evidence from Intra-individual Effects. Behavior Research Methods 41, 2 (May 2009), 295--308.
Marian McDonnell and Tara O'Reilly. 2017. The Effect of Interaction on Visual Appeal and Trust in Online Health Information. 100--108. [link].
Matthew Miller, Gilok Choi, and Lindsay Chell. 2012. Comparison of Three Digital Library Interfaces: Open Library, Google Books, and Hathi Trust. In Proceedings of the 12th ACM/IEEE-CS joint conference on Digital Libraries (JCDL '12). Association for Computing Machinery, New York, NY, USA, 367--368.
Aliaksei Miniukovich and Antonella De Angeli. 2014. Visual Impressions of Mobile App Interfaces. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). Association for Computing Machinery, New York, NY, USA, 31--40.
Aliaksei Miniukovich and Antonella De Angeli. 2015. Computation of Interface Aesthetics. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1163--1172.
Aliaksei Miniukovich and Maurizio Marchese. 2020. Relationship Between Visual Complexity and Aesthetics of Webpages. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13.
Morten Moshagen and Meinald Thielsch. 2010. Facets of Visual Aesthetics. International Journal of Human-Computer Studies 68, 10 (Oct. 2010), 689--709.
Morten Moshagen and Meinald Thielsch. 2013. A Short Version of the Visual Aesthetics of Websites Inventory. Behaviour & Information Technology 32, 12 (Dec. 2013), 1305--1311.
G. A. Moss and R. W. Gunn. 2007. Gender Differences in Website Design: Implications for Education. Journal of Systemics, Cybernetics and Informatics (2007), 38--43. [link].
G. A. Moss and R. W. Gunn. 2009. Gender Differences in Website Production and Preference Aesthetics: Preliminary Implications for ICT in Education and Beyond. Behaviour & Information Technology 28, 5 (Sept. 2009), 447--460. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/01449290802332662.
Gardner Murphy and Rensis Likert. 1938. Public opinion and the individual. A psychological study of student attitudes on public questions, with a retest five years later. Harper, Oxford, England. 316 pages.
Mati Mõttus and David Lamas. 2015. Aesthetics of Interaction Design: A Literature Review. In Proceedings of the Mulitimedia, Interaction, Design and Innnovation (MIDI '15). Association for Computing Machinery, New York, NY, USA, 1--10.
D.C.L. Ngo and J.G. Byrne. 1998. Aesthetic Measures for Screen Design. In Proceedings 1998 Australasian Computer Human Interaction Conference. OzCHI'98 (Cat. No.98EX234). 64--71.
David Chek Ling Ngo. 2001. Measuring the Aesthetic Elements of Screen Designs. Displays 22, 3 (2001), 73--78.
Nordlight Research. 2008. NLR Web Scan Instrumentenentwicklung [NRL web scan development]. [link].
Andreia Nunes, São Luís Castro, and Teresa Limpo. 2020. A Review of Mindfulness-Based Apps for Children. Mindfulness 11, 9 (Sept. 2020), 2089--2101.
Kiemute Oyibo, Ifeoma Adaji, Rita Orji, and Julita Vassileva. 2018. What Drives the Perceived Credibility of Mobile Websites: Classical or Expressive Aesthetics?. In Human-Computer Interaction. Interaction in Context (Lecture Notes in Computer Science), Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 576--594.
Stephen E. Palmer, Karen B. Schloss, and Jonathan Sammartino. 2013. Visual Aesthetics and Human Preference. Annual Review of Psychology 64, 1 (Jan. 2013), 77--107. Publisher: Annual Reviews.
Muzeyyen Pandir and John Knight. 2006. Homepage Aesthetics: The Search for Preference Factors and the Challenges of Subjectivity. Interacting with Computers 18, 6 (Dec. 2006), 1351--1370.
Eleftherios Papachristos and Nikolaos Avouris. 2009. The Subjective and Objective Nature of Website Aesthetic Impressions. In Human-Computer Interaction - INTERACT 2009 (Lecture Notes in Computer Science), Tom Gross, Jan Gulliksen, Paula Kotzé, Lars Oestreicher, Philippe Palanque, Raquel Oliveira Prates, and Marco Winckler (Eds.). Springer, Berlin, Heidelberg, 119--122.
Eleftherios Papachristos and Nikolaos Avouris. 2011. Are First Impressions about Websites Only Related to Visual Appeal?. In Human-Computer Interaction - INTERACT 2011 (Lecture Notes in Computer Science), Pedro Campos, Nicholas Graham, Joaquim Jorge, Nuno Nunes, Philippe Palanque, and Marco Winckler (Eds.). Springer, Berlin, Heidelberg, 489--496.
Supavich (Fone) Pengnate and Rathindra Sarathy. 2017. An experimental investigation of the influence of website emotional design features on trust in unfamiliar online vendors. Computers in Human Behavior 67 (Feb. 2017), 49--60.
Supavich (Fone) Pengnate, Rathindra Sarathy, and JinKyu Lee. 2019. The Engagement of Website Initial Aesthetic Impressions: An Experimental Investigation. International Journal of Human-Computer Interaction 35, 16 (Oct. 2019), 1517--1531. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/10447318.2018.1554319.
Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic Mapping Studies in Software Engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering. BCS Learning & Development Ltd, Bari, Italy, 1--10.
Keith F. Punch. 1998. Introduction to Social Research: Quantitative and Qualitative Approaches (1st edition ed.). SAGE Publications Ltd, London ; Thousand Oaks, Calif.
Helen C. Purchase, John Hamer, Adrian Jamieson, and Oran Ryan. 2011. Investigating objective measures of web page aesthetics and usability. In Proceedings of the Twelfth Australasian User Interface Conference - Volume 117 (AUIC '11). Australian Computer Society, Inc., AUS, 19--28.
Masoud Ramezani Nia and Sajjad Shokouhyar. 2020. Analyzing the effects of visual aesthetic of Web pages on users' responses in online retailing using the VisAWI method. Journal of Research in Interactive Marketing 14, 4 (Jan. 2020), 357--389. Publisher: Emerald Publishing Limited.
Katharina Reinecke and Abraham Bernstein. 2011. Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces. ACM Transactions on Computer-Human Interaction 18, 2 (2011), 8:1--8:29.
Katharina Reinecke and Krzysztof Z. Gajos. 2014. Quantifying visual preferences around the world. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). Association for Computing Machinery, New York, NY, USA, 11--20.
Katharina Reinecke, Tom Yeh, Luke Miratrix, Rahmatri Mardiko, Yuechen Zhao, Jenny Liu, and Krzysztof Z. Gajos. 2013. Predicting Users' First Impressions of Website Aesthetics with a Quantification of Perceived Visual Complexity and Colorfulness. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2049--2058.
Paula Roberts, Helena Priest, and Michael Traynor. 2006. Reliability and Validity in Research. Nursing Standard 20, 44 (July 2006), 41--45.
Carolyn Salimun, Helen C. Purchase, David R. Simmons, and Stephen Brewster. 2010. Preference Ranking of Screen Layout Principles. (Sept. 2010). Publisher: BCS Learning & Development.
George Santayana. 2012. The Sense of Beauty. Dover Publications.
Crispin Sartwell. 2017. Beauty. [link] Last Modified: 2016-10-05.
Sven Schmutz, Andreas Sonderegger, and Juergen Sauer. 2017. Implementing Recommendations From Web Accessibility Guidelines: A Comparative Study of Nondisabled Users and Users With Visual Impairments. Human Factors 59, 6 (Sept. 2017), 956--972. Publisher: SAGE Publications Inc.
Martin Schrepp, Theo Held, and Bettina Laugwitz. 2006. The influence of hedonic quality on the attractiveness of user interfaces of business management software. Interacting with Computers 18, 5 (Sept. 2006), 1055--1069.
Dana Schultchen, Yannik Terhorst, Tanja Holderied, Michael Stach, Eva-Maria Messner, Harald Baumeister, and Lasse B. Sander. 2021. Stay Present with Your Phone: A Systematic Review and Standardized Rating of Mindfulness Apps in European App Stores. International Journal of Behavioral Medicine 28, 5 (Oct. 2021), 552--560.
Mirjam Seckler, Klaus Opwis, and Alexandre N. Tuch. 2015. Linking Objective Design Factors with Subjective Aesthetics: An Experimental Study on How Structure and Color of Websites Affect the Facets of Users' Visual Aesthetic Perception. Computers in Human Behavior 49 (2015), 375--389. Place: Netherlands Publisher: Elsevier Science.
Mirjam Seckler and Alexandre N. Tuch. 2012. Linking Objective Web-design Factors to Facets of Subjective Aesthetic Perception. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design (NordiCHI '12). Association for Computing Machinery, New York, NY, USA, 809--810.
Nahar Singh and Samit Bhattacharya. 2011. A GA-based Approach to Improve Web Page Aesthetics. In Proceedings of the First International Conference on Intelligent Interactive Technologies and Multimedia (IITM '10). Association for Computing Machinery, New York, NY, USA, 29--32.
Andreas Sonderegger, Juergen Sauer, and Janine Eichenberger. 2014. Expressive and Classical Aesthetics: Two Distinct Concepts with Highly Similar Effect Patterns in User-artefact Interaction. Behaviour & Information Technology 33, 11 (Nov. 2014), 1180--1191. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/0144929X.2013.853835.
S. S. Stevens and Lawrence E. Marks. 2017. Psychophysics: Introduction to Its Perceptual, Neural, and Social Prospects. Routledge, New York.
Stoyan R. Stoyanov, Leanne Hides, David J. Kavanagh, Oksana Zelenko, Dian Tjondronegoro, and Madhavan Mani. 2015. Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps. JMIR mHealth and uHealth 3, 1 (March 2015), e3422. Company: JMIR mHealth and uHealth Distributor: JMIR mHealth and uHealth Institution: JMIR mHealth and uHealth Label: JMIR mHealth and uHealth Publisher: JMIR Publications Inc., Toronto, Canada.
Rita Strebe. 2016. Aesthetics on the web: effects on approach and avoidance behaviour. Behaviour & Information Technology 35, 1 (Jan. 2016), 4--20. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/0144929X.2015.1070202.
David L. Streiner. 2003. Starting at the Beginning: An Introduction to Coefficient Alpha and Internal Consistency. Journal of Personality Assessment 80, 1 (Feb. 2003), 99--103. Publisher: Routledge _eprint: https://doi.org/10.1207/S15327752JPA8001_18.
Alistair Sutcliffe. 2001. Heuristic Evaluation of Website Attractiveness and Usability. In Interactive Systems: Design, Specification, and Verification (Lecture Notes in Computer Science), Chris Johnson (Ed.). Springer, Berlin, Heidelberg, 183--198.
Alistair Sutcliffe and Antonella De Angeli. 2005. Assessing Interaction Styles in Web User Interfaces. In Human-Computer Interaction - INTERACT 2005 (Lecture Notes in Computer Science), Maria Francesca Costabile and Fabio Paternò (Eds.). Springer, Berlin, Heidelberg, 405--417.
Meinald T. Thielsch, Iris Blotenberg, and Rafael Jaron. 2014. User Evaluation of Websites: From First Impression to Recommendation. Interacting with Computers 26, 1 (Jan. 2014), 89--102.
Robert M. Thorndike and Tracy Thorndike-Christ. 2014. Measurement and Evaluation in Psychology and Education (8 ed.). Pearson Education Limited.
Noam Tractinsky, Avivit Cokhavi, Moti Kirschenbaum, and Tal Sharfi. 2006. Evaluating the Consistency of Immediate Aesthetic Perceptions of Web Pages. International Journal of Human-Computer Studies 64, 11 (Nov. 2006), 1071--1083.
Noam Tractinsky, A.S Katz, and D Ikar. 2000. What is Beautiful is Usable. Interacting with Computers 13, 2 (Dec. 2000), 127--145.
Alexandre N. Tuch, Eva E. Presslaber, Markus Stöcklin, Klaus Opwis, and Javier A. Bargas-Avila. 2012. The Role of Visual Complexity and Prototypicality Regarding First Impression of Websites: Working Towards Understanding Aesthetic Judgments. International Journal of Human-Computer Studies 70, 11 (Nov. 2012), 794--811.
Alexandre N. Tuch, Sandra P. Roth, Kasper Hornbæk, Klaus Opwis, and Javier A. Bargas-Avila. 2012. Is Beautiful Really Usable? Toward Understanding the Relation Between Usability, Aesthetics, and Affect in HCI. Computers in Human Behavior 28, 5 (Sept. 2012), 1596--1607.
Karl Ulrich. 2006. Design: Creation of Artifacts in Society. University of Philadelphia.
Silvia Uribe, Federico Álvarez, and José Manuel Menéndez. 2017. User's Web Page Aesthetics Opinion: A Matter of Low-Level Image Descriptors Based on MPEG-7. ACM Transactions on the Web 11, 1 (March 2017), 5:1--5:25.
Paul van Schaik and Jonathan Ling. 2009. The Role of Context in Perceptions of the Aesthetics of Web Pages over Time. International Journal of Human-Computer Studies 67, 1 (Jan. 2009), 79--89.
Martin Varela, Lea Skorin-Kapov, Toni Mäki, and Tobias Hoßfeld. 2015. QoE in the Web: A dance of design and performance. In 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX). 1--7.
Julien Venni and Mireille Bétrancourt. 2020. Aesthetics in Hypermedia: Impact of Colour Harmony on Implicit Memory and User Experience. In Companion Publication of the 2020 International Conference on Multimodal Interaction (ICMI '20 Companion). Association for Computing Machinery, New York, NY, USA, 215--219.
Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in Software Engineering. Springer Science & Business Media. Google-Books-ID: QPVsM1_U8nkC.
Chun Mao Wu and Pei Li. 2019. The Visual Aesthetics Measurement on Interface Design Education. Journal of the Society for Information Display 27, 3 (2019), 138--146. : https://onlinelibrary.wiley.com/doi/pdf/10.1002/jsid.751.
Ou Wu, Yunfei Chen, Bing Li, and Weiming Hu. 2011. Evaluating the Visual Quality of Web Pages Using a Computational Aesthetic Approach. In Proceedings of the fourth ACM international conference on Web search and data mining (WSDM '11). Association for Computing Machinery, New York, NY, USA, 337--346.
Ou Wu, Haiqiang Zuo, Weiming Hu, and Bing Li. 2016. Multimodal Web Aesthetics Assessment Based on Structural SVM and Multitask Fusion Learning. IEEE Transactions on Multimedia 18, 6 (June 2016), 1062--1076. Conference Name: IEEE Transactions on Multimedia.
Mathieu Zen and Jean Vanderdonckt. 2016. Assessing User Interface Aesthetics based on the Inter-subjectivity of Judgment. In Proceedings of the 30th International BCS Human Computer Interaction Conference. BCS Learning & Development, Poole, UK.
Ons Al-Shamaileh and Alistair Sutcliffe. 2012. The Effect of Website Interactivity and Repeated Exposure on User Experience. In Proceedings of the 4th Mexican Conference on Human-Computer Interaction (MexIHC '12). Association for Computing Machinery, New York, NY, USA, 1--8.
Ons Al-Shamaileh and Alistair Sutcliffe. 2012. Investigating a Multi-faceted View of User Experience. In Proceedings of the 24th Australian Computer-Human Interaction Conference (OzCHI '12). Association for Computing Machinery, New York, NY, USA, 9--18.
Ahamed Altaboli and Yingzi Lin. 2010. Experimental Investigation of Effects of Balance, Unity, and Sequence on Interface and Screen Design Aesthetics. In IADIS International Conference Interfaces and Human Computer Interaction 2010 (part of MCCSIS 2010). 243--250. [link].
Ahamed Altaboli and Yingzi Lin. 2012. Effects of Unity of Form and Symmetry on Visual Aesthetics of Website Interface Design. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56, 1 (Sept. 2012), 728--732. Publisher: SAGE Publications Inc.
Maxim Bakaev, Maximilian Speicher, Sebastian Heil, and Martin Gaedke. 2020. I Don't Have That Much Data! Reusing User Behavior Models for Websites from Different Domains. In Web Engineering (Lecture Notes in Computer Science), Maria Bielikova, Tommi Mikkonen, and Cesare Pautasso (Eds.). Springer International Publishing, Cham, 146--162.
Michael Bauerly and Yili Liu. 2006. Computational modeling and experimental investigation of effects of compositional elements on interface and design aesthetics. International Journal of Human-Computer Studies 64, 8 (Aug. 2006), 670--682.
Michael Bauerly and Yili Liu. 2008. Effects of Symmetry and Number of Compositional Elements on Interface and Design Aesthetics. International Journal of Human-Computer Interaction 24, 3 (March 2008), 275--287. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/10447310801920508.
Michael Bauerly and Yili Liu. 2009. Evaluation and Improvement of Interface Aesthetics with an Interactive Genetic Algorithm. International Journal of Human-Computer Interaction 25, 2 (2009), 155--166. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/10447310802629801.
Amanda Baughan, Tal August, Naomi Yamashita, and Katharina Reinecke. 2020. Keep it Simple: How Visual Complexity and Preferences Impact Search Efficiency on Websites. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--10.
Upasna Bhandari, Klarissa Chang, and Tillmann Neben. 2019. Understanding the Impact of Perceived Visual Aesthetics on User Evaluations: An Emotional perspective. Information & Management 56, 1 (2019), 85--93.
Upasna Bhandari, Tillman Neben, and Klarissa Chang. 2015. Understanding Visual Appeal and Quality Perceptions of Mobile Apps: An Emotional Perspective. In Human-Computer Interaction: Design and Evaluation (Lecture Notes in Computer Science), Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 451--459.
Upasna Bhandari, Tillmann Neben, Klarissa Chang, and Wen Yong Chua. 2017. Effects of Interface Design Factors on Affective Responses and Quality Evaluations in Mobile Applications. Computers in Human Behavior 72 (2017), 525--534. Place: Netherlands Publisher: Elsevier Science.
Anol Bhattacherjee. 2012. Social Science Research: Principles, Methods, and Practices (2nd edition ed.). CreateSpace Independent Publishing Platform.
John Brooke. 1996. SUS: A 'Quick and Dirty' Usability Scale. In Usability Evaluation In Industry. CRC Press, 189--194. Google-Books-ID: IfUsRmzAqvEC.
D. Chang, F. Li, and L. Huang. 2020. A User-centered Evaluation and Redesign Approach for E-Government APP. In 2020 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM). 270--274.
Aline Chevalier, Anne-Claire Maury, and Nicolas Fouquereau. 2014. The Influence of the Search Complexity and the Familiarity with the Website on the Subjective Appraisal of Aesthetics, Mental Effort and Usability. Behaviour & Information Technology 33, 2 (2014), 117--132. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/0144929X.2013.819936.
Louis Cohen, Lawrence Manion, and Keith Morrison. 2017. Research Methods in Education (8th edition ed.). Routledge, London; New York.
Sara M. Conklin, Richard J. Koubek, James A. Thurman, and Leah C. Newman. 2006. The Effects of Aesthetics and Cognitive, Style on Perceived Usability. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 18 (Oct. 2006), 2153--2157. Publisher: SAGE Publications Inc.
Mick P. Couper, Roger Tourangeau, Frederick G. Conrad, and Eleanor Singer. 2006. Evaluating the Effectiveness of Visual Analog Scales: A Web Experiment. Social Science Computer Review 24, 2 (May 2006), 227--245. Publisher: SAGE Publications Inc.
Eli P. Cox. 1980. The Optimal Number of Response Alternatives for a Scale: A Review. Journal of Marketing Research 17, 4 (Nov. 1980), 407--422. Publisher: SAGE Publications Inc.
Dianne Cyr, Milena Head, and Alex Ivanov. 2006. Design aesthetics leading to m-loyalty in mobile commerce. Information & Management 43, 8 (Dec. 2006), 950--963.
Hannah Dames, Gerrit Hirschfeld, Timo Sackmann, and Meinald T Thielsch. 2019. Searching vs. Browsing---The Influence of Consumers' Goal Directedness on Website Evaluations. Interacting with Computers 31, 1 (Jan. 2019), 95--112.
Antonella De Angeli, Alistair Sutcliffe, and Jan Hartmann. 2006. Interaction, usability and aesthetics: what influences users' preferences?. In Proceedings of the 6th conference on Designing Interactive systems (DIS '06). Association for Computing Machinery, New York, NY, USA, 271--280.
Henrica C. W. de Vet, Caroline B. Terwee, Dirk L. Knol, and Lex M. Bouter. 2006. When to Use Agreement Versus Reliability Measures. Journal of Clinical Epidemiology 59, 10 (Oct. 2006), 1033--1039.
Soussan Djamasbi, Marisa Siegel, Jeanine Skorinko, and Tom Tullis. 2011. Online Viewing and Aesthetic Preferences of Generation Y and the Baby Boom Generation: Testing User Web Site Experience Through Eye Tracking. International Journal of Electronic Commerce 15, 4 (2011), 121--158. Publisher: Routledge _eprint: https://doi.org/10.2753/JEC1086-4415150404.
Maria Douneva, Rafael Jaron, and Meinald T. Thielsch. 2016. Effects of Different Website Designs on First Impressions, Aesthetic Judgements and Memory Performance after Short Presentation. Interacting with Computers 28, 4 (June 2016), 552--567.
Sophie Dupuy-Chessa, Yann Laurillau, and Eric Céret. 2016. Considering aesthetics and usability temporalities in a model based development process. In Actes de la 28ième conference francophone sur l'Interaction Homme-Machine (IHM '16). Association for Computing Machinery, New York, NY, USA, 25--35.
Ron Garland. 1991. The Mid-Point on a Rating Scale: Is it Desirable? Marketing Bulletin 2, 1 (1991), 66--70. [link]
Natasa Gisev, J. Simon Bell, and Timothy F. Chen. 2013. Interrater Agreement and Interrater Reliability: Key Concepts, Approaches, and Applications. Research in Social and Administrative Pharmacy 9, 3 (May 2013), 330--338.
Johanna K. P. Greeson, Daniel Treglia, Seth Morones, Marcia Hopkins, and Dominique Mikell. 2020. Development, Usability, Usefulness, & Accessibility of a Mobile Web-based App for Homeless and Unstably Housed Youth. Children and Youth Services Review 108 (Jan. 2020), 104586.
Christiane Gresse von Wangenheim, João V. Araujo Porto, Jean C. R. Hauck, and Adriano F. Borgatto. 2018. Do We Agree on User Interface Aesthetics of Android Apps? arXiv (Dec. 2018), 1--5. http://arxiv.org/abs/1812.09049
Zhenyu Gu, Chenhao Jin, Danny Chang, and Liqun Zhang. 2021. Predicting Webpage Aesthetics with Heatmap Entropy. Behaviour & Information Technology 40, 7 (May 2021), 676--690. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/0144929X.2020.1717626.
Jan Hartmann, Alistair Sutcliffe, and Antonella De Angeli. 2008. Towards a Theory of User Judgment of Aesthetics and User Interface Quality. ACM Transactions on Computer-Human Interaction 15, 4 (2008), 15:1--15:30.
Marc Hassenzahl. 2004. The Interplay of Beauty, Goodness, and Usability in Interactive Products. Human-Computer Interaction 19, 4 (Dec. 2004), 319--349. Publisher: Taylor & Francis _eprint: [link].
Roberta Heale and Alison Twycross. 2015. Validity and Reliability in Quantitative Studies. Evidence-Based Nursing 18, 3 (July 2015), 66--67. Publisher: Royal College of Nursing Section: Research made simple.
Shih-Miao Huang. 2013. A Study of Affective Meanings Predicting Aesthetic Preferences of Interactive Skins. In 2013 IEEE International Conference on Industrial Engineering and Engineering Management. 781--785. ISSN: 2157-362X.
Quan Huynh-Thu, Marie-Neige Garcia, Filippo Speranza, Philip Corriveau, and Alexander Raake. 2011. Study of Rating Scales for Subjective Quality Assessment of High-Definition Video. IEEE Transactions on Broadcasting 57, 1 (March 2011), 1--14. Conference Name: IEEE Transactions on Broadcasting.
ISO. 2011. ISO/IEC 25010:2011, Systems and Software Engineering --- Systems and Software Quality Requirements and Evaluation (SQuaRE) --- System and Software Quality Models. [link].
Alex Ivanov and Christoph Schneider. 2010. The Effects of Perceived Visual Aesthetics on Process Satisfaction in GSS Use. In 2010 43rd Hawaii International Conference on System Sciences. 1--10. ISSN: 1530-1605.
Carole L. Kimberlin and Almut G. Winterstein. 2008. Validity and Reliability of Measurement Instruments Used in Research. American Journal of Health-System Pharmacy 65, 23 (Dec. 2008), 2276--2284.
Jurek Kirakowski and Bozena Cierlik. 1998. Measuring the Usability of Web Sites. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 42, 4 (Oct. 1998), 424--428. Publisher: SAGE Publications Inc.
Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. Technical Report EBSE-2007-01.
Jan Kottner, Laurent Audige, Stig Brorson, Allan Donner, Byron J. Gajewski, Asbjørn Hróbjartsson, Chris Roberts, Mohamed Shoukri, and David L. Streiner. 2011. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. International Journal of Nursing Studies 48, 6 (June 2011), 661--671.
Panayiotis Koutsabasis and Theano G. Istikopoulou. 2013. Perceived Website Aesthetics by Users and Designers: Implications for Evaluation Practice. International Journal of Technology and Human Interaction (IJTHI) 9, 2 (2013), 39--52. Publisher: IGI Global.
Louisa Küchler, Guido Hertel, and Meinald T. Thielsch. 2020. Are You Willing to Donate? Relationship Between Perceived Website Design, Trust and Donation Decisions Online. In Proceedings of the Conference on Mensch und Computer (MuC '20). Association for Computing Machinery, New York, NY, USA, 223--227.
Andrés Larco, Carlos Montenegro, Esteban Diaz, and Sergio Luján-Mora. 2018. Underlying Quality Factors in Spanish Language Apps for People with Disabilities. In 2018 International Conference on eDemocracy eGovernment (ICEDEG). 110--116. ISSN: 2573-1998.
Talia Lavie and Noam Tractinsky. 2004. Assessing Dimensions of Perceived Visual Aesthetics of Web Sites. International Journal of Human-Computer Studies 60, 3 (March 2004), 269--298.
James R. Lewis and Oǧuzhan Erdinç. 2017. User Experience Rating Scales with 7, 11, or 101 Points: Does It Matter? Journal of Usability Studies 12, 2 (Feb. 2017), 73--91.
Adriano Luiz de Souza Lima and Christiane Gresse von Wangenheim. 2021. Assessing the Visual Esthetics of User Interfaces: A Ten-Year Systematic Mapping. International Journal of Human-Computer Interaction (June 2021), 1--21. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/10447318.2021.1926118.
Gitte Lindgaard and Cathy Dudek. 2003. What Is This Evasive Beast We Call User Satisfaction? Interacting with Computers 15, 3 (2003), 429--452.
Gitte Lindgaard, Gary Fernandes, Cathy Dudek, and J. Brown. 2006. Attention Web Designers: You Have 50 Milliseconds to Make a Good First Impression! Behaviour & Information Technology 25, 2 (March 2006), 115--126. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/01449290500330448.
Gitte Lindgaard, Justyna Litwinska, and Cathy Dudek. 2008. Judging Web Page Visual Appeal: Do East and West Really Differ?. In Proc. of Interfaces and Human Computer Interaction 2008, Vol. 8. Amsterdam, The Netherlands, 157--164.
Shuqing Liu, Tianyi Liang, Shuai Shao, and Jun Kong. 2020. Evaluating Localized MOOCs: The Role of Culture on Interface Design and User Experience. IEEE Access 8 (2020), 107927--107940. Conference Name: IEEE Access.
Luis M. Lozano, Eduardo García-Cueto, and José Muñiz. 2008. Effect of the Number of Response Categories on the Reliability and Validity of Rating Scales. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences 4, 2 (2008), 73--79. Place: Germany Publisher: Hogrefe & Huber Publishers.
Ranjan Maity and Samit Bhattacharya. 2018. Relating Aesthetics of the GUI Text Elements with Readability using Font Family. In Proceedings of the 2018 ACM Companion International Conference on Interactive Surfaces and Spaces (ISS '18 Companion). Association for Computing Machinery, New York, NY, USA, 63--68.
Alberto Maydeu-Olivares, Uwe Kramp, Carlos García-Forero, David Gallardo-Pujol, and Donna Coffman. 2009. The Effect of Varying the Number of Response Alternatives in Rating Scales: Experimental Evidence from Intra-individual Effects. Behavior Research Methods 41, 2 (May 2009), 295--308.
Marian McDonnell and Tara O'Reilly. 2017. The Effect of Interaction on Visual Appeal and Trust in Online Health Information. 100--108. [link].
Matthew Miller, Gilok Choi, and Lindsay Chell. 2012. Comparison of Three Digital Library Interfaces: Open Library, Google Books, and Hathi Trust. In Proceedings of the 12th ACM/IEEE-CS joint conference on Digital Libraries (JCDL '12). Association for Computing Machinery, New York, NY, USA, 367--368.
Aliaksei Miniukovich and Antonella De Angeli. 2014. Visual Impressions of Mobile App Interfaces. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). Association for Computing Machinery, New York, NY, USA, 31--40.
Aliaksei Miniukovich and Antonella De Angeli. 2015. Computation of Interface Aesthetics. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1163--1172.
Aliaksei Miniukovich and Maurizio Marchese. 2020. Relationship Between Visual Complexity and Aesthetics of Webpages. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13.
Morten Moshagen and Meinald Thielsch. 2010. Facets of Visual Aesthetics. International Journal of Human-Computer Studies 68, 10 (Oct. 2010), 689--709.
Morten Moshagen and Meinald Thielsch. 2013. A Short Version of the Visual Aesthetics of Websites Inventory. Behaviour & Information Technology 32, 12 (Dec. 2013), 1305--1311.
G. A. Moss and R. W. Gunn. 2007. Gender Differences in Website Design: Implications for Education. Journal of Systemics, Cybernetics and Informatics (2007), 38--43. [link].
G. A. Moss and R. W. Gunn. 2009. Gender Differences in Website Production and Preference Aesthetics: Preliminary Implications for ICT in Education and Beyond. Behaviour & Information Technology 28, 5 (Sept. 2009), 447--460. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/01449290802332662.
Gardner Murphy and Rensis Likert. 1938. Public opinion and the individual. A psychological study of student attitudes on public questions, with a retest five years later. Harper, Oxford, England. 316 pages.
Mati Mõttus and David Lamas. 2015. Aesthetics of Interaction Design: A Literature Review. In Proceedings of the Mulitimedia, Interaction, Design and Innnovation (MIDI '15). Association for Computing Machinery, New York, NY, USA, 1--10.
D.C.L. Ngo and J.G. Byrne. 1998. Aesthetic Measures for Screen Design. In Proceedings 1998 Australasian Computer Human Interaction Conference. OzCHI'98 (Cat. No.98EX234). 64--71.
David Chek Ling Ngo. 2001. Measuring the Aesthetic Elements of Screen Designs. Displays 22, 3 (2001), 73--78.
Nordlight Research. 2008. NLR Web Scan Instrumentenentwicklung [NRL web scan development]. [link].
Andreia Nunes, São Luís Castro, and Teresa Limpo. 2020. A Review of Mindfulness-Based Apps for Children. Mindfulness 11, 9 (Sept. 2020), 2089--2101.
Kiemute Oyibo, Ifeoma Adaji, Rita Orji, and Julita Vassileva. 2018. What Drives the Perceived Credibility of Mobile Websites: Classical or Expressive Aesthetics?. In Human-Computer Interaction. Interaction in Context (Lecture Notes in Computer Science), Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 576--594.
Stephen E. Palmer, Karen B. Schloss, and Jonathan Sammartino. 2013. Visual Aesthetics and Human Preference. Annual Review of Psychology 64, 1 (Jan. 2013), 77--107. Publisher: Annual Reviews.
Muzeyyen Pandir and John Knight. 2006. Homepage Aesthetics: The Search for Preference Factors and the Challenges of Subjectivity. Interacting with Computers 18, 6 (Dec. 2006), 1351--1370.
Eleftherios Papachristos and Nikolaos Avouris. 2009. The Subjective and Objective Nature of Website Aesthetic Impressions. In Human-Computer Interaction - INTERACT 2009 (Lecture Notes in Computer Science), Tom Gross, Jan Gulliksen, Paula Kotzé, Lars Oestreicher, Philippe Palanque, Raquel Oliveira Prates, and Marco Winckler (Eds.). Springer, Berlin, Heidelberg, 119--122.
Eleftherios Papachristos and Nikolaos Avouris. 2011. Are First Impressions about Websites Only Related to Visual Appeal?. In Human-Computer Interaction - INTERACT 2011 (Lecture Notes in Computer Science), Pedro Campos, Nicholas Graham, Joaquim Jorge, Nuno Nunes, Philippe Palanque, and Marco Winckler (Eds.). Springer, Berlin, Heidelberg, 489--496.
Supavich (Fone) Pengnate and Rathindra Sarathy. 2017. An experimental investigation of the influence of website emotional design features on trust in unfamiliar online vendors. Computers in Human Behavior 67 (Feb. 2017), 49--60.
Supavich (Fone) Pengnate, Rathindra Sarathy, and JinKyu Lee. 2019. The Engagement of Website Initial Aesthetic Impressions: An Experimental Investigation. International Journal of Human-Computer Interaction 35, 16 (Oct. 2019), 1517--1531. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/10447318.2018.1554319.
Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic Mapping Studies in Software Engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering. BCS Learning & Development Ltd, Bari, Italy, 1--10.
Keith F. Punch. 1998. Introduction to Social Research: Quantitative and Qualitative Approaches (1st edition ed.). SAGE Publications Ltd, London ; Thousand Oaks, Calif.
Helen C. Purchase, John Hamer, Adrian Jamieson, and Oran Ryan. 2011. Investigating objective measures of web page aesthetics and usability. In Proceedings of the Twelfth Australasian User Interface Conference - Volume 117 (AUIC '11). Australian Computer Society, Inc., AUS, 19--28.
Masoud Ramezani Nia and Sajjad Shokouhyar. 2020. Analyzing the effects of visual aesthetic of Web pages on users' responses in online retailing using the VisAWI method. Journal of Research in Interactive Marketing 14, 4 (Jan. 2020), 357--389. Publisher: Emerald Publishing Limited.
Katharina Reinecke and Abraham Bernstein. 2011. Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces. ACM Transactions on Computer-Human Interaction 18, 2 (2011), 8:1--8:29.
Katharina Reinecke and Krzysztof Z. Gajos. 2014. Quantifying visual preferences around the world. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). Association for Computing Machinery, New York, NY, USA, 11--20.
Katharina Reinecke, Tom Yeh, Luke Miratrix, Rahmatri Mardiko, Yuechen Zhao, Jenny Liu, and Krzysztof Z. Gajos. 2013. Predicting Users' First Impressions of Website Aesthetics with a Quantification of Perceived Visual Complexity and Colorfulness. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2049--2058.
Paula Roberts, Helena Priest, and Michael Traynor. 2006. Reliability and Validity in Research. Nursing Standard 20, 44 (July 2006), 41--45.
Carolyn Salimun, Helen C. Purchase, David R. Simmons, and Stephen Brewster. 2010. Preference Ranking of Screen Layout Principles. (Sept. 2010). Publisher: BCS Learning & Development.
George Santayana. 2012. The Sense of Beauty. Dover Publications.
Crispin Sartwell. 2017. Beauty. [link] Last Modified: 2016-10-05.
Sven Schmutz, Andreas Sonderegger, and Juergen Sauer. 2017. Implementing Recommendations From Web Accessibility Guidelines: A Comparative Study of Nondisabled Users and Users With Visual Impairments. Human Factors 59, 6 (Sept. 2017), 956--972. Publisher: SAGE Publications Inc.
Martin Schrepp, Theo Held, and Bettina Laugwitz. 2006. The influence of hedonic quality on the attractiveness of user interfaces of business management software. Interacting with Computers 18, 5 (Sept. 2006), 1055--1069.
Dana Schultchen, Yannik Terhorst, Tanja Holderied, Michael Stach, Eva-Maria Messner, Harald Baumeister, and Lasse B. Sander. 2021. Stay Present with Your Phone: A Systematic Review and Standardized Rating of Mindfulness Apps in European App Stores. International Journal of Behavioral Medicine 28, 5 (Oct. 2021), 552--560.
Mirjam Seckler, Klaus Opwis, and Alexandre N. Tuch. 2015. Linking Objective Design Factors with Subjective Aesthetics: An Experimental Study on How Structure and Color of Websites Affect the Facets of Users' Visual Aesthetic Perception. Computers in Human Behavior 49 (2015), 375--389. Place: Netherlands Publisher: Elsevier Science.
Mirjam Seckler and Alexandre N. Tuch. 2012. Linking Objective Web-design Factors to Facets of Subjective Aesthetic Perception. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design (NordiCHI '12). Association for Computing Machinery, New York, NY, USA, 809--810.
Nahar Singh and Samit Bhattacharya. 2011. A GA-based Approach to Improve Web Page Aesthetics. In Proceedings of the First International Conference on Intelligent Interactive Technologies and Multimedia (IITM '10). Association for Computing Machinery, New York, NY, USA, 29--32.
Andreas Sonderegger, Juergen Sauer, and Janine Eichenberger. 2014. Expressive and Classical Aesthetics: Two Distinct Concepts with Highly Similar Effect Patterns in User-artefact Interaction. Behaviour & Information Technology 33, 11 (Nov. 2014), 1180--1191. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/0144929X.2013.853835.
S. S. Stevens and Lawrence E. Marks. 2017. Psychophysics: Introduction to Its Perceptual, Neural, and Social Prospects. Routledge, New York.
Stoyan R. Stoyanov, Leanne Hides, David J. Kavanagh, Oksana Zelenko, Dian Tjondronegoro, and Madhavan Mani. 2015. Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps. JMIR mHealth and uHealth 3, 1 (March 2015), e3422. Company: JMIR mHealth and uHealth Distributor: JMIR mHealth and uHealth Institution: JMIR mHealth and uHealth Label: JMIR mHealth and uHealth Publisher: JMIR Publications Inc., Toronto, Canada.
Rita Strebe. 2016. Aesthetics on the web: effects on approach and avoidance behaviour. Behaviour & Information Technology 35, 1 (Jan. 2016), 4--20. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/0144929X.2015.1070202.
David L. Streiner. 2003. Starting at the Beginning: An Introduction to Coefficient Alpha and Internal Consistency. Journal of Personality Assessment 80, 1 (Feb. 2003), 99--103. Publisher: Routledge _eprint: https://doi.org/10.1207/S15327752JPA8001_18.
Alistair Sutcliffe. 2001. Heuristic Evaluation of Website Attractiveness and Usability. In Interactive Systems: Design, Specification, and Verification (Lecture Notes in Computer Science), Chris Johnson (Ed.). Springer, Berlin, Heidelberg, 183--198.
Alistair Sutcliffe and Antonella De Angeli. 2005. Assessing Interaction Styles in Web User Interfaces. In Human-Computer Interaction - INTERACT 2005 (Lecture Notes in Computer Science), Maria Francesca Costabile and Fabio Paternò (Eds.). Springer, Berlin, Heidelberg, 405--417.
Meinald T. Thielsch, Iris Blotenberg, and Rafael Jaron. 2014. User Evaluation of Websites: From First Impression to Recommendation. Interacting with Computers 26, 1 (Jan. 2014), 89--102.
Robert M. Thorndike and Tracy Thorndike-Christ. 2014. Measurement and Evaluation in Psychology and Education (8 ed.). Pearson Education Limited.
Noam Tractinsky, Avivit Cokhavi, Moti Kirschenbaum, and Tal Sharfi. 2006. Evaluating the Consistency of Immediate Aesthetic Perceptions of Web Pages. International Journal of Human-Computer Studies 64, 11 (Nov. 2006), 1071--1083.
Noam Tractinsky, A.S Katz, and D Ikar. 2000. What is Beautiful is Usable. Interacting with Computers 13, 2 (Dec. 2000), 127--145.
Alexandre N. Tuch, Eva E. Presslaber, Markus Stöcklin, Klaus Opwis, and Javier A. Bargas-Avila. 2012. The Role of Visual Complexity and Prototypicality Regarding First Impression of Websites: Working Towards Understanding Aesthetic Judgments. International Journal of Human-Computer Studies 70, 11 (Nov. 2012), 794--811.
Alexandre N. Tuch, Sandra P. Roth, Kasper Hornbæk, Klaus Opwis, and Javier A. Bargas-Avila. 2012. Is Beautiful Really Usable? Toward Understanding the Relation Between Usability, Aesthetics, and Affect in HCI. Computers in Human Behavior 28, 5 (Sept. 2012), 1596--1607.
Karl Ulrich. 2006. Design: Creation of Artifacts in Society. University of Philadelphia.
Silvia Uribe, Federico Álvarez, and José Manuel Menéndez. 2017. User's Web Page Aesthetics Opinion: A Matter of Low-Level Image Descriptors Based on MPEG-7. ACM Transactions on the Web 11, 1 (March 2017), 5:1--5:25.
Paul van Schaik and Jonathan Ling. 2009. The Role of Context in Perceptions of the Aesthetics of Web Pages over Time. International Journal of Human-Computer Studies 67, 1 (Jan. 2009), 79--89.
Martin Varela, Lea Skorin-Kapov, Toni Mäki, and Tobias Hoßfeld. 2015. QoE in the Web: A dance of design and performance. In 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX). 1--7.
Julien Venni and Mireille Bétrancourt. 2020. Aesthetics in Hypermedia: Impact of Colour Harmony on Implicit Memory and User Experience. In Companion Publication of the 2020 International Conference on Multimodal Interaction (ICMI '20 Companion). Association for Computing Machinery, New York, NY, USA, 215--219.
Claes Wohlin, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in Software Engineering. Springer Science & Business Media. Google-Books-ID: QPVsM1_U8nkC.
Chun Mao Wu and Pei Li. 2019. The Visual Aesthetics Measurement on Interface Design Education. Journal of the Society for Information Display 27, 3 (2019), 138--146. : https://onlinelibrary.wiley.com/doi/pdf/10.1002/jsid.751.
Ou Wu, Yunfei Chen, Bing Li, and Weiming Hu. 2011. Evaluating the Visual Quality of Web Pages Using a Computational Aesthetic Approach. In Proceedings of the fourth ACM international conference on Web search and data mining (WSDM '11). Association for Computing Machinery, New York, NY, USA, 337--346.
Ou Wu, Haiqiang Zuo, Weiming Hu, and Bing Li. 2016. Multimodal Web Aesthetics Assessment Based on Structural SVM and Multitask Fusion Learning. IEEE Transactions on Multimedia 18, 6 (June 2016), 1062--1076. Conference Name: IEEE Transactions on Multimedia.
Mathieu Zen and Jean Vanderdonckt. 2016. Assessing User Interface Aesthetics based on the Inter-subjectivity of Judgment. In Proceedings of the 30th International BCS Human Computer Interaction Conference. BCS Learning & Development, Poole, UK.
Publicado
17/10/2022
Como Citar
LIMA, Adriano Luiz de Souza; GRESSE VON WANGENHEIM, Christiane; BORGATTO, Adriano Ferreti.
Assessment of visual aesthetics through human judgments: a systematic mapping. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 21. , 2022, Diamantina.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
