Show Me The Rules! A User Study On Making Data Validation Rules Explicit in Spreadsheet Applications
Resumo
Spreadsheet applications have become one of the most popular end-user programming environments with innumerous built-in facilities, including arithmetic, financial and statistical operations. Not surprisingly, spreadsheet applications play significant role in decision-making processes in organizations, thus making spreadsheet errors serious threats. Reports from field audits show that spreadsheet errors may cause companies to lose millions of dollars annually. One effective and simple way of helping users to avoid introducing mistakes in their spreadsheets is data validation. Indeed, most spreadsheet applications provide a wide range of built-in functions to restrict the type of the input data or the range of valid values entered into a cell. However, in most of them, the underlying design decisions governing how data input should be entered in a spreadsheet are not explicitly visible to its users. Hiding data validation rules from users may hinder the comprehensibility and the usability of a spreadsheet, thus increasing the risks of entering incorrect data input. To assist end-user programmers in explicitly expressing validation rules in spreadsheets, we propose the SpreadSheet Validation Language (SSVL). We conducted a user study to assess the effectiveness of SSVL. The results show that users using SSVL are faster and more productive in tasks involving the comprehension of data validation rules. This is a promising result suggesting that SSVL can actually improve the usability of spreadsheets.
Palavras-chave:
Validade dos dados, Planilhas, Linguagens específicas de domínio
Referências
S. Aced López, F. Corno, and L. De Russis. Clocks, bars and balls: Design and evaluation of alternative gnomon widgets for children with disabilities. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pages 1654–1660. ACM, 2016.
S. Adepoju and I. Shehu. Usability evaluation of academic websites using automated tools. In User Science and Engineering (i-USEr), 2014 3rd International Conference on, pages 186–191. IEEE, 2014.
A. Aizpurua, M. Arrue, and M. Vigo. Prejudices, memories, expectations and confidence influence experienced accessibility on the web. Computers in Human Behavior, 51:152–160, 2015.
A. Aizpurua, S. Harper, and M. Vigo. Exploring the relationship between web accessibility and user experience. International Journal of Human-Computer Studies, 91:13–23, 2016.
A. Al-Faries, H. S. Al-Khalifa, M. S. Al-Razgan, and M. Al-Duwais. Evaluating the accessibility and usability of top saudi e-government services. In Proceedings of the 7th International Conference on Theory and Practice of Electronic Governance, pages 60–63. ACM, 2013.
H. S. Al-Khalifa. The accessibility of saudi arabia government web sites: an exploratory study. Universal Access in the Information Society, 11(2):201–210, 2012.
H. S. Al-Khalifa, I. Baazeem, and R. Alamer. Revisiting the accessibility of saudi arabia government websites. Universal Access in the Information Society, pages 1–13.
F. Alves dos Santos Medina, V. R. da Silva, S. G. M. Pereira, R. F. Gonçalves, and I. Costa. Interfaces affordable for smartphones to elderly: a screen layout proposal for sending messages. In Proceedings of the 7th International Conference on Management of computational and collective intElligence in Digital EcoSystems, pages 174–179. ACM, 2015.
S. Azenkot and E. Fortuna. Improving public transit usability for blind and deaf-blind people by connecting a braille display to a smartphone. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, pages 317–318. ACM, 2010.
J. P. Bigham, J. T. Brudvik, and B. Zhang. Accessibility by demonstration: enabling end users to guide developers to web accessibility solutions. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, pages 35–42. ACM, 2010.
J. P. Bigham, W. Chisholm, and R. E. Ladner. Webanywhere: Experiences with a new delivery model for access technology. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), page 15. ACM, 2010.
T. J. Bittar, A. K. Almeida, and R. P. de Mattos Fortes. Panorama of the accessibility add-ons use in firefox. Procedia Computer Science, 14:311–318, 2012.
Y. Borodin, J. P. Bigham, G. Dausch, and I. Ramakrishnan. More than meets the eye: a survey of screen-reader browsing strategies. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), page 13. ACM, 2010.
H. Braga, L. S. Pereira, S. B. L. Ferreira, and D. S. Da Silveira. Applying the barrier walkthrough method: Going beyond the automatic evaluation of accessibility. Procedia Computer Science, 27:471–480, 2014.
C. Buzzi, M. Buzzi, F. Donini, B. Leporini, and M. T. Paratore. Haptic reference cues to support the exploration of touchscreen mobile devices by blind users. In Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI, page 28. ACM, 2013.
M. C. Buzzi, M. Buzzi, and B. Leporini. Web 2.0: Twitter and the blind. In Proceedings of the 9th ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction: Facing Complexity, pages 151–156. ACM, 2011.
A. R. Casare, C. G. da Silva, P. S. Martins, and R. L. Moraes. Usability heuristics and accessibility guidelines: a comparison of heuristic evaluation and wcag. In Proceedings of the 31st Annual ACM Symposium on Applied Computing, pages 213–215. ACM, 2016.
T. Catarci, A. Perini, N. Seyff, S. R. Humayoun, and N. A. Qureshi. First international workshop on usability and accessibility focused requirements engineering (usare 2012): summary report. ACM SIGSOFT Software Engineering Notes, 38(1):43–46, 2013.
A. de Lima Salgado, S. S. Rodrigues, and R. P. M. Fortes. Evolving heuristic evaluation for multiple contexts and audiences: Perspectives from a mapping study. In Proceedings of the 34th ACM International Conference on the Design of Communication, page 19. ACM, 2016.
A. E. de Oliveira Siena, A. de Lima Salgado, and R. P. de Mattos Fortes. Florch: Challenges on developing a new social network accessible for senescent users. In Proceedings of the Latin American Conference on Human Computer Interaction, page 7. ACM, 2015.
I. M. de Souza, C. Maciel, and C. Cappelli. The model of accessibility to electronic government: applicability in dataprev. In Proceedings of the 17th International Digital Government Research Conference on Digital Government Research, pages 287–292. ACM, 2016.
Debevc, P. Kosec, and A. Holzinger. Improving multimodal web accessibility for deaf people: sign language interpreter module. Multimedia Tools and Applications, 54(1):181–199, 2011.
A. L. Dias, R. P. de Mattos Fortes, and P. C. Masiero. Heua: A heuristic evaluation with usability and accessibility requirements to assess web systems. In Proceedings of the 11th Web for All Conference, page 18. ACM, 2014.
I. A. Doush, F. Alkhateeb, E. Al Maghayreh, and M. A. Al-Betar. The design of ria accessibility evaluation tool. Advances in Engineering Software, 57:1–7, 2013.
M. Ernst and A. Girouard. Exploring haptics for learning bend gestures for the blind. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pages 2097–2104. ACM, 2016.
M. Fakrudeen, S. Yousef, A. H. Hussein, and M. Ali. Presentation design of e-assessments for blind users using touch screen devices. In Electronics, Computers and Artificial Intelligence (ECAI), 2013 International Conference on, pages 1–6. IEEE, 2013.
D. Fogli and G. Guida. A practical approach to the assessment of quality in use of corporate web sites. Journal of Systems and Software, 99:52–65, 2015.
D. Fogli, L. P. Provenza, and C. Bernareggi. A universal design resource for rich internet applications based on design patterns. Universal access in the information society, 13(2):205–226, 2014.
R. P. Fortes, H. L. Antonelli, and A. de Lima Salgado. Accessibility and usability evaluation of rich internet applications. In Proceedings of the 22nd Brazilian Symposium on Multimedia and the Web, pages 7–8. ACM, 2016.
R. A. Galvez and N. E. Youngblood. e-government in rhode island: what effects do templates have on usability, accessibility, and mobile readiness? Universal Access in the Information Society, 15(2):281–296, 2016.
K. Gerling. Human factors in entertainment computing: designing for diversity. In Proceedings of the 6th International Conference on Foundations of Digital Games, pages 244–246. ACM, 2011.
K. M. Gerling, F. P. Schulte, and M. Masuch. Designing and evaluating digital games for frail elderly persons. In Proceedings of the 8th international conference on advances in computer entertainment technology, page 62. ACM, 2011.
M. Guenaga, I. Mechaca, S. Romero, and A. Eguíluz. A tool to evaluate the level of inclusion of digital learning objects. Procedia Computer Science, 14:148–154, 2012.
M. Guentert. Improving public transit accessibility for blind riders: a train station navigation assistant. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility, pages 317–318. ACM, 2011.
J. L. Hardesty. Bells, whistles, and alarms: Hci lessons using ajax for a page-turning web application. In CHI’11 Extended Abstracts on Human Factors in Computing Systems, pages 827–840. ACM, 2011.
A. Ismail and K. Kuppusamy. Accessibility of indian universities’ homepages: An exploratory study. Journal of King Saud University-Computer and Information Sciences, 2016.
E. Jiménez, S. Márquez, F. Moreno, J. Coret, and F. Alcantud. Analysis of research on web usability for people with cognitive disability from 2002 to 2011. In Proceedings of the 13th International Conference on Interacción Persona-Ordenador, page 25. ACM, 2012.
S. Keates. A pedagogical example of teaching universal access. Universal Access in the Information Society, 14(1):97–110, 2015.
B. A. King and N. E. Youngblood. E-government in alabama: An analysis of county voting and election website content, usability, accessibility, and mobile readiness. Government Information Quarterly, 33(4):715–726, 2016.
L. Kumin, J. Lazar, J. H. Feng, B. Wentz, and N. Ekedebe. A usability evaluation of workplace-related tasks on a multi-touch tablet computer by adults with down syndrome. Journal of Usability Studies, 7(4):118–142, 2012.
J. Lazar. Using community-based service projects to enhance undergraduate hci education: 10 years of experience. In CHI’11 Extended Abstracts on Human Factors in Computing Systems, pages 581–588. ACM, 2011.
J. Lazar, S. Chakraborty, D. Carroll, R. Weir, B. Sizemore, and H. Henderson. Development and evaluation of two prototypes for providing weather map data to blind users through sonification. Journal of Usability Studies, 8(4):93–110, 2013.
J. Lazar, P. T. Jaeger, A. Adams, A. Angelozzi, J. Manohar, J. Marciniak, J. Murphy, P. Norasteh, C. Olsen, E. Poneres, et al. Up in the air: Are airlines following the new dot rules on equal pricing for people with disabilities when websites are inaccessible? Government Information Quarterly, 27(4):329–336, 2010.
J. Lazar, P. T. Jaeger, A. Olalere, M. Algarne, Z. Augustine, C. Brown, F. D’Erasmo, B. Dotson, G. Endiape, L. Govender, et al. Still up in the air: government regulation of airline websites and continuing price inequality for persons with disabilities online. In Proceedings of the 13th Annual International Conference on Digital Government Research, pages 240–245. ACM, 2012.
J. Lazar, A. Olalere, and B. Wentz. Investigating the accessibility and usability of job application web sites for blind users. Journal of Usability Studies, 7(2):68–87, 2012.
J. Lazar, B. Wentz, A. Almalhem, A. Catinella, C. Antonescu, Y. Aynbinder, M. Bands, E. Bastress, B. Chan, B. Chelden, et al. A longitudinal study of state government homepage accessibility in maryland and the role of web page templates for improving accessibility. Government Information Quarterly, 30(3):289–299, 2013.
B. Leporini, M. C. Buzzi, and M. Buzzi. Interacting with mobile devices via voiceover: usability and accessibility issues. In Proceedings of the 24th Australian Computer-Human Interaction Conference, pages 339–348. ACM, 2012.
S.-H. Li, D. C. Yen, W.-H. Lu, and T.-L. Lin. Migrating from wcag 1.0 to wcag 2.0–a comparative study based on web content accessibility guidelines in taiwan. Computers in Human Behavior, 28(1):87–96, 2012.
E. T. Loiacono, S. Djamasbi, and T. Kiryazov. Factors that affect visually impaired users’ acceptance of audio and music websites. International Journal of Human-Computer Studies, 71(3):321–334, 2013.
H. Meutzner, S. Gupta, and D. Kolossa. Constructing secure audio captchas by exploiting differences between humans and machines. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pages 2335–2338. ACM, 2015.
R. Mi˜nón, F. Paternò, M. Arrue, and J. Abascal. Integrating adaptation rules for people with special needs in model-based ui development process. Universal Access in the Information Society, 15(1):153–168, 2016.
F. Moreno, J. Coret, E. Jiménez, S. Márquez, and F. Alcantud. Evaluation of web browsing experience by people with cognitive disability. In Proceedings of the 13th International Conference on Interacción Persona-Ordenador, page 38. ACM, 2012.
G. Moreno, V. Castillo, K. Williams, and N. Menéndez. Characterization of software development companies in panama from usability and accessibility approach. In Proceedings of the XVI International Conference on Human Computer Interaction, page 53. ACM, 2015.
R. Navarrete and S. Luján-Mora. Improving oer websites for learners with disabilities. In Proceedings of the 13th Web for All Conference, page 16. ACM, 2016.
J. Nielsen. 10 usability heuristics for user interface design. Nielsen Norman Group, 1(1), 1995.
T. Nogueira, D. Ferreira, S. Carvalho, and L. Berreta. Evaluating the impact of responsive and non-responsive web design on the experience of blind users. IEEE multimedia, 91:13–23, 2017.
T. d. C. Nogueira et al. Estudo comparativo da experiência de usuários cegos e videntes no design web responsivo e não responsivo. 2015.
T. Obi, D. Ishmatova, and N. Iwasaki. Promoting ict innovations for the ageing population in japan. International journal of medical informatics, 82(4):e47–e62, 2013.
S. K. Oswal. How accessible are the voice-guided automatic teller machines for the visually impaired? In Proceedings of the 30th ACM international conference on Design of communication, pages 65–70. ACM, 2012.
H. Persson, H. ˚Ahman, A. A. Yngling, and J. Gulliksen. Universal design, inclusive design, accessible design, design for all: different concepts—one goal? on the concept of accessibility—historical, methodological and philosophical aspects. Universal Access in the Information Society, 14(4):505–526, 2015.
M. Pozhidaev. The framework for accessible applications: text-based case for blind people. In Proceedings of the 10th Central and Eastern European Software Engineering Conference in Russia, page 22. ACM, 2014.
C. Pribeanu, P. Fogarassy-Neszly, and A. Pătru. Municipal web sites accessibility and usability for blind users: preliminary results from a pilot study. Universal access in the information society, 13(3):339–349, 2014.
S. S. Prietch and L. V. L. Filgueiras. Double testing: potential website resources for deaf people and the evaluation instrument emotion-libras. In Proceedings of the 2013 Chilean Conference on Human-Computer Interaction, pages 10–13. ACM, 2013.
S. Prior. Hci methods for including adults with disabilities in the design of champion. In CHI’10 Extended Abstracts on Human Factors in Computing Systems, pages 2891–2894. ACM, 2010.
L. Rello, G. Kanvinde, and R. Baeza-Yates. Layout guidelines for web text and a web service to improve accessibility for dyslexics. In Proceedings of the international cross-disciplinary conference on web accessibility, page 36. ACM, 2012.
J. A. P. Rocha and T. F. M. de Lima. Análise da relação entre acessibilidade web e usabilidade para pessoas com deficiência visual. In Proceedings of the IX Symposium on Human Factors in Computing Systems, pages 257–258. Brazilian Computer Society, 2010.
D. Rømen and D. Svanæs. Validating wcag versions 1.0 and 2.0 through usability testing with disabled users. Universal Access in the Information Society, 11(4):375–385, 2012.
F. E. Sandnes and A. Zhao. An interactive color picker that ensures wcag2. 0 compliant color contrast levels. Procedia Computer Science, 67:87–94, 2015.
J. G. Schoeberlein and Y. Wang. Accessible collaborative writing for persons who are blind: a usability study. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility, pages 267–268. ACM, 2012.
J. G. Schoeberlein and Y. Wang. Usability evaluation of an accessible collaborative writing prototype for blind users. Journal of Usability Studies, 10(1):26–45, 2014.
M. Schrepp. Goms analysis as a tool to investigate the usability of web units for disabled users. Universal Access in the Information Society, 9(1):77–86, 2010.
A. Seffah and D. Engelberg. Mobile services for everyone, anywhere, at anytime: defying universality as a quality attribute. In Proceedings of the Second ACM International Conference on Mobile Software Engineering and Systems, pages 138–139. IEEE Press, 2015.
C. A. Siebra, T. B. Gouveia, W. Correia, M. Penha, M. Anjos, F. Florentin, F. Q. Silva, A. L. Santos, et al. Usability for accessibility: A consolidation of requirements for mobile applications. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, pages 321–322. ACM, 2015.
I. Smeureanu and N. Isăilă. Disabled users’ perception on the automated systems of training in mathematics. Procedia-Social and Behavioral Sciences, 46:1101–1105, 2012.
T. L. Smith, C. Lewis, and E. B. Moore. Demonstration: Screen reader support for a complex interactive science simulation. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, pages 319–320. ACM, 2016.
F. Spyridonis, P. Moschonas, K. Touliou, A. Tsakiris, and G. Ghinea. Designing accessible ict products and services: the veritas accessibility testing platform. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, pages 113–116. ACM, 2014.
J. Tavares, J. Barbosa, I. Cardoso, C. Costa, A. Yamin, and R. Real. Hefestos: an intelligent system applied to ubiquitous accessibility. Universal Access in the Information Society, 15(4):589–607, 2016.
P. Thiessen. Wai-aria live regions and html5. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility, page 27. ACM, 2011.
P. Thiessen and S. Hockema. Wai-aria live regions: ebuddy im as a case example. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), page 33. ACM, 2010.
P. Thiessen and S. Hockema. Wai-aria live regions: ebuddy im as a case example. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), page 33. ACM, 2010.
T. van der Geest and E. Velleman. Easy-to-read meets accessible web in the e-government context. Procedia computer science, 27:327–333, 2014.
M. Vigo and G. Brajnik. Automatic web accessibility metrics: Where we are and where we can go. Interacting with Computers, 23(2):137–155, 2011.
B. Wentz, J. Lazar, M. Stein, O. Gbenro, E. Holandez, and A. Ramsey. Danger, danger! evaluating the accessibility of web-based emergency alert sign-ups in the northeastern united states. Government Information Quarterly, 31(3):488–497, 2014.
E. G. y Restrepo, C. Benavidez, and H. Gutiérrez. The challenge of teaching to create accessible learning objects to higher education lecturers. Procedia Computer Science, 14:371–381, 2012.
Y. Yesilada, G. Brajnik, M. Vigo, and S. Harper. Understanding web accessibility and its drivers. In Proceedings of the international cross-disciplinary conference on web accessibility, page 19. ACM, 2012.
K. Yoon, T. Newberry, L. Hulscher, and R. Dols. Call for library websites with a separate information architecture for visually impaired users. Proceedings of the American Society for Information Science and Technology, 50(1):1–3, 2013.
N. E. Youngblood and J. Mackiewicz. A usability analysis of municipal government website home pages in alabama. Government Information Quarterly, 29(4):582–588, 2012.
N. E. Youngblood and S. A. Youngblood. User experience and accessibility: An analysis of county web portals. Journal of Usability Studies, 9(1):25–41, 2013.
H. Zou and J. Treviranus. Chartmaster: a tool for interacting with stock market charts using a screen reader. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, pages 107–116. ACM, 2015
S. Adepoju and I. Shehu. Usability evaluation of academic websites using automated tools. In User Science and Engineering (i-USEr), 2014 3rd International Conference on, pages 186–191. IEEE, 2014.
A. Aizpurua, M. Arrue, and M. Vigo. Prejudices, memories, expectations and confidence influence experienced accessibility on the web. Computers in Human Behavior, 51:152–160, 2015.
A. Aizpurua, S. Harper, and M. Vigo. Exploring the relationship between web accessibility and user experience. International Journal of Human-Computer Studies, 91:13–23, 2016.
A. Al-Faries, H. S. Al-Khalifa, M. S. Al-Razgan, and M. Al-Duwais. Evaluating the accessibility and usability of top saudi e-government services. In Proceedings of the 7th International Conference on Theory and Practice of Electronic Governance, pages 60–63. ACM, 2013.
H. S. Al-Khalifa. The accessibility of saudi arabia government web sites: an exploratory study. Universal Access in the Information Society, 11(2):201–210, 2012.
H. S. Al-Khalifa, I. Baazeem, and R. Alamer. Revisiting the accessibility of saudi arabia government websites. Universal Access in the Information Society, pages 1–13.
F. Alves dos Santos Medina, V. R. da Silva, S. G. M. Pereira, R. F. Gonçalves, and I. Costa. Interfaces affordable for smartphones to elderly: a screen layout proposal for sending messages. In Proceedings of the 7th International Conference on Management of computational and collective intElligence in Digital EcoSystems, pages 174–179. ACM, 2015.
S. Azenkot and E. Fortuna. Improving public transit usability for blind and deaf-blind people by connecting a braille display to a smartphone. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, pages 317–318. ACM, 2010.
J. P. Bigham, J. T. Brudvik, and B. Zhang. Accessibility by demonstration: enabling end users to guide developers to web accessibility solutions. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, pages 35–42. ACM, 2010.
J. P. Bigham, W. Chisholm, and R. E. Ladner. Webanywhere: Experiences with a new delivery model for access technology. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), page 15. ACM, 2010.
T. J. Bittar, A. K. Almeida, and R. P. de Mattos Fortes. Panorama of the accessibility add-ons use in firefox. Procedia Computer Science, 14:311–318, 2012.
Y. Borodin, J. P. Bigham, G. Dausch, and I. Ramakrishnan. More than meets the eye: a survey of screen-reader browsing strategies. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), page 13. ACM, 2010.
H. Braga, L. S. Pereira, S. B. L. Ferreira, and D. S. Da Silveira. Applying the barrier walkthrough method: Going beyond the automatic evaluation of accessibility. Procedia Computer Science, 27:471–480, 2014.
C. Buzzi, M. Buzzi, F. Donini, B. Leporini, and M. T. Paratore. Haptic reference cues to support the exploration of touchscreen mobile devices by blind users. In Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI, page 28. ACM, 2013.
M. C. Buzzi, M. Buzzi, and B. Leporini. Web 2.0: Twitter and the blind. In Proceedings of the 9th ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction: Facing Complexity, pages 151–156. ACM, 2011.
A. R. Casare, C. G. da Silva, P. S. Martins, and R. L. Moraes. Usability heuristics and accessibility guidelines: a comparison of heuristic evaluation and wcag. In Proceedings of the 31st Annual ACM Symposium on Applied Computing, pages 213–215. ACM, 2016.
T. Catarci, A. Perini, N. Seyff, S. R. Humayoun, and N. A. Qureshi. First international workshop on usability and accessibility focused requirements engineering (usare 2012): summary report. ACM SIGSOFT Software Engineering Notes, 38(1):43–46, 2013.
A. de Lima Salgado, S. S. Rodrigues, and R. P. M. Fortes. Evolving heuristic evaluation for multiple contexts and audiences: Perspectives from a mapping study. In Proceedings of the 34th ACM International Conference on the Design of Communication, page 19. ACM, 2016.
A. E. de Oliveira Siena, A. de Lima Salgado, and R. P. de Mattos Fortes. Florch: Challenges on developing a new social network accessible for senescent users. In Proceedings of the Latin American Conference on Human Computer Interaction, page 7. ACM, 2015.
I. M. de Souza, C. Maciel, and C. Cappelli. The model of accessibility to electronic government: applicability in dataprev. In Proceedings of the 17th International Digital Government Research Conference on Digital Government Research, pages 287–292. ACM, 2016.
Debevc, P. Kosec, and A. Holzinger. Improving multimodal web accessibility for deaf people: sign language interpreter module. Multimedia Tools and Applications, 54(1):181–199, 2011.
A. L. Dias, R. P. de Mattos Fortes, and P. C. Masiero. Heua: A heuristic evaluation with usability and accessibility requirements to assess web systems. In Proceedings of the 11th Web for All Conference, page 18. ACM, 2014.
I. A. Doush, F. Alkhateeb, E. Al Maghayreh, and M. A. Al-Betar. The design of ria accessibility evaluation tool. Advances in Engineering Software, 57:1–7, 2013.
M. Ernst and A. Girouard. Exploring haptics for learning bend gestures for the blind. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pages 2097–2104. ACM, 2016.
M. Fakrudeen, S. Yousef, A. H. Hussein, and M. Ali. Presentation design of e-assessments for blind users using touch screen devices. In Electronics, Computers and Artificial Intelligence (ECAI), 2013 International Conference on, pages 1–6. IEEE, 2013.
D. Fogli and G. Guida. A practical approach to the assessment of quality in use of corporate web sites. Journal of Systems and Software, 99:52–65, 2015.
D. Fogli, L. P. Provenza, and C. Bernareggi. A universal design resource for rich internet applications based on design patterns. Universal access in the information society, 13(2):205–226, 2014.
R. P. Fortes, H. L. Antonelli, and A. de Lima Salgado. Accessibility and usability evaluation of rich internet applications. In Proceedings of the 22nd Brazilian Symposium on Multimedia and the Web, pages 7–8. ACM, 2016.
R. A. Galvez and N. E. Youngblood. e-government in rhode island: what effects do templates have on usability, accessibility, and mobile readiness? Universal Access in the Information Society, 15(2):281–296, 2016.
K. Gerling. Human factors in entertainment computing: designing for diversity. In Proceedings of the 6th International Conference on Foundations of Digital Games, pages 244–246. ACM, 2011.
K. M. Gerling, F. P. Schulte, and M. Masuch. Designing and evaluating digital games for frail elderly persons. In Proceedings of the 8th international conference on advances in computer entertainment technology, page 62. ACM, 2011.
M. Guenaga, I. Mechaca, S. Romero, and A. Eguíluz. A tool to evaluate the level of inclusion of digital learning objects. Procedia Computer Science, 14:148–154, 2012.
M. Guentert. Improving public transit accessibility for blind riders: a train station navigation assistant. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility, pages 317–318. ACM, 2011.
J. L. Hardesty. Bells, whistles, and alarms: Hci lessons using ajax for a page-turning web application. In CHI’11 Extended Abstracts on Human Factors in Computing Systems, pages 827–840. ACM, 2011.
A. Ismail and K. Kuppusamy. Accessibility of indian universities’ homepages: An exploratory study. Journal of King Saud University-Computer and Information Sciences, 2016.
E. Jiménez, S. Márquez, F. Moreno, J. Coret, and F. Alcantud. Analysis of research on web usability for people with cognitive disability from 2002 to 2011. In Proceedings of the 13th International Conference on Interacción Persona-Ordenador, page 25. ACM, 2012.
S. Keates. A pedagogical example of teaching universal access. Universal Access in the Information Society, 14(1):97–110, 2015.
B. A. King and N. E. Youngblood. E-government in alabama: An analysis of county voting and election website content, usability, accessibility, and mobile readiness. Government Information Quarterly, 33(4):715–726, 2016.
L. Kumin, J. Lazar, J. H. Feng, B. Wentz, and N. Ekedebe. A usability evaluation of workplace-related tasks on a multi-touch tablet computer by adults with down syndrome. Journal of Usability Studies, 7(4):118–142, 2012.
J. Lazar. Using community-based service projects to enhance undergraduate hci education: 10 years of experience. In CHI’11 Extended Abstracts on Human Factors in Computing Systems, pages 581–588. ACM, 2011.
J. Lazar, S. Chakraborty, D. Carroll, R. Weir, B. Sizemore, and H. Henderson. Development and evaluation of two prototypes for providing weather map data to blind users through sonification. Journal of Usability Studies, 8(4):93–110, 2013.
J. Lazar, P. T. Jaeger, A. Adams, A. Angelozzi, J. Manohar, J. Marciniak, J. Murphy, P. Norasteh, C. Olsen, E. Poneres, et al. Up in the air: Are airlines following the new dot rules on equal pricing for people with disabilities when websites are inaccessible? Government Information Quarterly, 27(4):329–336, 2010.
J. Lazar, P. T. Jaeger, A. Olalere, M. Algarne, Z. Augustine, C. Brown, F. D’Erasmo, B. Dotson, G. Endiape, L. Govender, et al. Still up in the air: government regulation of airline websites and continuing price inequality for persons with disabilities online. In Proceedings of the 13th Annual International Conference on Digital Government Research, pages 240–245. ACM, 2012.
J. Lazar, A. Olalere, and B. Wentz. Investigating the accessibility and usability of job application web sites for blind users. Journal of Usability Studies, 7(2):68–87, 2012.
J. Lazar, B. Wentz, A. Almalhem, A. Catinella, C. Antonescu, Y. Aynbinder, M. Bands, E. Bastress, B. Chan, B. Chelden, et al. A longitudinal study of state government homepage accessibility in maryland and the role of web page templates for improving accessibility. Government Information Quarterly, 30(3):289–299, 2013.
B. Leporini, M. C. Buzzi, and M. Buzzi. Interacting with mobile devices via voiceover: usability and accessibility issues. In Proceedings of the 24th Australian Computer-Human Interaction Conference, pages 339–348. ACM, 2012.
S.-H. Li, D. C. Yen, W.-H. Lu, and T.-L. Lin. Migrating from wcag 1.0 to wcag 2.0–a comparative study based on web content accessibility guidelines in taiwan. Computers in Human Behavior, 28(1):87–96, 2012.
E. T. Loiacono, S. Djamasbi, and T. Kiryazov. Factors that affect visually impaired users’ acceptance of audio and music websites. International Journal of Human-Computer Studies, 71(3):321–334, 2013.
H. Meutzner, S. Gupta, and D. Kolossa. Constructing secure audio captchas by exploiting differences between humans and machines. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pages 2335–2338. ACM, 2015.
R. Mi˜nón, F. Paternò, M. Arrue, and J. Abascal. Integrating adaptation rules for people with special needs in model-based ui development process. Universal Access in the Information Society, 15(1):153–168, 2016.
F. Moreno, J. Coret, E. Jiménez, S. Márquez, and F. Alcantud. Evaluation of web browsing experience by people with cognitive disability. In Proceedings of the 13th International Conference on Interacción Persona-Ordenador, page 38. ACM, 2012.
G. Moreno, V. Castillo, K. Williams, and N. Menéndez. Characterization of software development companies in panama from usability and accessibility approach. In Proceedings of the XVI International Conference on Human Computer Interaction, page 53. ACM, 2015.
R. Navarrete and S. Luján-Mora. Improving oer websites for learners with disabilities. In Proceedings of the 13th Web for All Conference, page 16. ACM, 2016.
J. Nielsen. 10 usability heuristics for user interface design. Nielsen Norman Group, 1(1), 1995.
T. Nogueira, D. Ferreira, S. Carvalho, and L. Berreta. Evaluating the impact of responsive and non-responsive web design on the experience of blind users. IEEE multimedia, 91:13–23, 2017.
T. d. C. Nogueira et al. Estudo comparativo da experiência de usuários cegos e videntes no design web responsivo e não responsivo. 2015.
T. Obi, D. Ishmatova, and N. Iwasaki. Promoting ict innovations for the ageing population in japan. International journal of medical informatics, 82(4):e47–e62, 2013.
S. K. Oswal. How accessible are the voice-guided automatic teller machines for the visually impaired? In Proceedings of the 30th ACM international conference on Design of communication, pages 65–70. ACM, 2012.
H. Persson, H. ˚Ahman, A. A. Yngling, and J. Gulliksen. Universal design, inclusive design, accessible design, design for all: different concepts—one goal? on the concept of accessibility—historical, methodological and philosophical aspects. Universal Access in the Information Society, 14(4):505–526, 2015.
M. Pozhidaev. The framework for accessible applications: text-based case for blind people. In Proceedings of the 10th Central and Eastern European Software Engineering Conference in Russia, page 22. ACM, 2014.
C. Pribeanu, P. Fogarassy-Neszly, and A. Pătru. Municipal web sites accessibility and usability for blind users: preliminary results from a pilot study. Universal access in the information society, 13(3):339–349, 2014.
S. S. Prietch and L. V. L. Filgueiras. Double testing: potential website resources for deaf people and the evaluation instrument emotion-libras. In Proceedings of the 2013 Chilean Conference on Human-Computer Interaction, pages 10–13. ACM, 2013.
S. Prior. Hci methods for including adults with disabilities in the design of champion. In CHI’10 Extended Abstracts on Human Factors in Computing Systems, pages 2891–2894. ACM, 2010.
L. Rello, G. Kanvinde, and R. Baeza-Yates. Layout guidelines for web text and a web service to improve accessibility for dyslexics. In Proceedings of the international cross-disciplinary conference on web accessibility, page 36. ACM, 2012.
J. A. P. Rocha and T. F. M. de Lima. Análise da relação entre acessibilidade web e usabilidade para pessoas com deficiência visual. In Proceedings of the IX Symposium on Human Factors in Computing Systems, pages 257–258. Brazilian Computer Society, 2010.
D. Rømen and D. Svanæs. Validating wcag versions 1.0 and 2.0 through usability testing with disabled users. Universal Access in the Information Society, 11(4):375–385, 2012.
F. E. Sandnes and A. Zhao. An interactive color picker that ensures wcag2. 0 compliant color contrast levels. Procedia Computer Science, 67:87–94, 2015.
J. G. Schoeberlein and Y. Wang. Accessible collaborative writing for persons who are blind: a usability study. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility, pages 267–268. ACM, 2012.
J. G. Schoeberlein and Y. Wang. Usability evaluation of an accessible collaborative writing prototype for blind users. Journal of Usability Studies, 10(1):26–45, 2014.
M. Schrepp. Goms analysis as a tool to investigate the usability of web units for disabled users. Universal Access in the Information Society, 9(1):77–86, 2010.
A. Seffah and D. Engelberg. Mobile services for everyone, anywhere, at anytime: defying universality as a quality attribute. In Proceedings of the Second ACM International Conference on Mobile Software Engineering and Systems, pages 138–139. IEEE Press, 2015.
C. A. Siebra, T. B. Gouveia, W. Correia, M. Penha, M. Anjos, F. Florentin, F. Q. Silva, A. L. Santos, et al. Usability for accessibility: A consolidation of requirements for mobile applications. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, pages 321–322. ACM, 2015.
I. Smeureanu and N. Isăilă. Disabled users’ perception on the automated systems of training in mathematics. Procedia-Social and Behavioral Sciences, 46:1101–1105, 2012.
T. L. Smith, C. Lewis, and E. B. Moore. Demonstration: Screen reader support for a complex interactive science simulation. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, pages 319–320. ACM, 2016.
F. Spyridonis, P. Moschonas, K. Touliou, A. Tsakiris, and G. Ghinea. Designing accessible ict products and services: the veritas accessibility testing platform. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, pages 113–116. ACM, 2014.
J. Tavares, J. Barbosa, I. Cardoso, C. Costa, A. Yamin, and R. Real. Hefestos: an intelligent system applied to ubiquitous accessibility. Universal Access in the Information Society, 15(4):589–607, 2016.
P. Thiessen. Wai-aria live regions and html5. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility, page 27. ACM, 2011.
P. Thiessen and S. Hockema. Wai-aria live regions: ebuddy im as a case example. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), page 33. ACM, 2010.
P. Thiessen and S. Hockema. Wai-aria live regions: ebuddy im as a case example. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), page 33. ACM, 2010.
T. van der Geest and E. Velleman. Easy-to-read meets accessible web in the e-government context. Procedia computer science, 27:327–333, 2014.
M. Vigo and G. Brajnik. Automatic web accessibility metrics: Where we are and where we can go. Interacting with Computers, 23(2):137–155, 2011.
B. Wentz, J. Lazar, M. Stein, O. Gbenro, E. Holandez, and A. Ramsey. Danger, danger! evaluating the accessibility of web-based emergency alert sign-ups in the northeastern united states. Government Information Quarterly, 31(3):488–497, 2014.
E. G. y Restrepo, C. Benavidez, and H. Gutiérrez. The challenge of teaching to create accessible learning objects to higher education lecturers. Procedia Computer Science, 14:371–381, 2012.
Y. Yesilada, G. Brajnik, M. Vigo, and S. Harper. Understanding web accessibility and its drivers. In Proceedings of the international cross-disciplinary conference on web accessibility, page 19. ACM, 2012.
K. Yoon, T. Newberry, L. Hulscher, and R. Dols. Call for library websites with a separate information architecture for visually impaired users. Proceedings of the American Society for Information Science and Technology, 50(1):1–3, 2013.
N. E. Youngblood and J. Mackiewicz. A usability analysis of municipal government website home pages in alabama. Government Information Quarterly, 29(4):582–588, 2012.
N. E. Youngblood and S. A. Youngblood. User experience and accessibility: An analysis of county web portals. Journal of Usability Studies, 9(1):25–41, 2013.
H. Zou and J. Treviranus. Chartmaster: a tool for interacting with stock market charts using a screen reader. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, pages 107–116. ACM, 2015
Publicado
17/05/2017
Como Citar
GAVA, Jessica; VILELA, Bruna; CIRILO, Elder; ADACHI, Eiji.
Show Me The Rules! A User Study On Making Data Validation Rules Explicit in Spreadsheet Applications. In: SIMPÓSIO BRASILEIRO DE SISTEMAS DE INFORMAÇÃO (SBSI), 13. , 2017, Lavras.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2017
.
p. 198-205.
DOI: https://doi.org/10.5753/sbsi.2017.6043.
