An Awareness Assessment Model for Collaborative Interfaces
Resumo
[Contexto] A percepção (awareness) tem sido valiosa em sistemas colaborativos desde a sua formação, e pesquisas relacionadas acompanharam a evolução de todo o campo nas últimas décadas. Consideramos a percepção como a espinha dorsal de um ambiente colaborativo, na qual toda a colaboração é alcançada. [Problema] Segundo a literatura, a percepção é um conceito bem conhecido, mas ainda não totalmente alcançado; e pesquisas devem alcançar uma melhor compreensão do apoio concebendo e testando novas tecnologias que ofereçam um suporte adequado. [Objetivo] Este trabalho consiste em estabelecer um modelo de avaliação de percepção para interfaces colaborativas a partir da perspectiva dos participantes, analisando informações de percepção fornecidas pela aplicação. [Resultado] Realizamos um estudo de mapeamento sistemático para identificar o apoio à percepção no contexto do sistema colaborativo e compilamos os resultados em uma taxonomia multidimensional de três dimensões principais de percepção. Com base nestes resultados, apresentamos um novo método de avaliação para percepção e apoio à colaboração centrado na perspectiva do participante, desenvolvendo um instrumento de medição baseado na Teoria de Resposta ao Item – TRI. [Conclusão] A metodologia permitiu-nos construir e interpretar uma escala de qualidade para avaliar o suporte à percepção na perspectiva do participante. Os cenários avaliados demonstraram: i) indicadores adequados do ponto de vista dos dados demográficos e da parametrização da TRI, ii) a aplicabilidade da escala de consciência na perspectiva do participante, e iii) a replicabilidade do modelo para diferentes cenários e contextos.
Referências
BARBOSA, S.; SILVA, B. Interação humano-computador. Rio de Janeiro, RJ: Elsevier Brasil, 2010.
BEECHAM, S. et al. Using an expert panel to validate a requirements process improvement model. Journal of Systems and Software, Elsevier, v. 76, n. 3, p. 251–275, 2005.
BICHLER, M. Design science in information systems research. Wirtschaftsinformatik, Springer, v. 48, n. 2, p. 133–135, 2006.
BRAVO, C. et al. Modeling awareness requirements in groupware: From cards to diagrams. IEEE Transactions on Human-Machine Systems, Institute of Electrical and Electronics Engineers (IEEE), p. 1–12, 2023. ISSN 2168-2305.
CAI, L. Metropolis-hastings robbins-monro algorithm for confirmatory item factor analysis. Journal of Educational and Behavioral Statistics, American Educational Research Association (AERA), v. 35, n. 3, p. 307–335, 6 2010. ISSN 1935-1054.
CHALMERS, R. P. mirt: A multidimensional item response theory package for therenvironment. Journal of Statistical Software, Foundation for Open Access Statistic, v. 48, n. 6, 2012. ISSN 1548-7660.
COLLAZOS, C. A. et al. Descriptive theory of awareness for groupware development. Journal of Ambient Intelligence and Humanized Computing, v. 10, n. 12, p. 4789–4818, 2019. ISSN 1868-5137.
CRONBACH, L. J. Coefficient alpha and the internal structure of tests. psychometrika, Springer, v. 16, n. 3, p. 297–334, 1951.
DEVELLIS, R. F. Scale development: Theory and applications. 4th. ed. London, UK: Sage Publications, Inc, 2016. v. 26. (Applied Social Research Methods 26, v. 26). ISBN 9781506341569.
DOURISH, P.; BELLOTTI, V. Awareness and coordination in shared workspaces. In: Proceedings of the 1992 ACM Conference on Computer-Supported Cooperative Work. New York, NY, USA: Association for Computing Machinery, 1992. (CSCW ’92), p. 107–114. ISBN 0897915429.
ELLIS, C.; GIBBS, S.; REIN, G. Groupware some issues and experiences. Communications of the ACM, ACM New York, NY, USA, v. 34, n. 1, p. 38–58, 1991. ISSN 0001-0782.
FORNELL, C.; LARCKER, D. F. Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research, Sage Publications Sage CA: Los Angeles, CA, v. 18, n. 1, p. 39–50, 1981.
GALLARDO, J.; BRAVO, C.; MOLINA, A. I. A framework for the descriptive specification of awareness support in multimodal user interfaces for collaborative activities. Journal on Multimodal User Interfaces, v. 12, n. 2, p. 145–159, 2018. ISSN 1783-7677.
GEORGE, J. F. Groupware. In: BIDGOLI, H. (Ed.). Encyclopedia of Information Systems. New York, NY, USA: Elsevier, 2003. p. 509–518. ISBN 978-0-12-227240-0.
GROSS, T. Supporting effortless coordination: 25 years of awareness research. Computer Supported Cooperative Work, v. 22, n. 4-6, p. 425–474, 2013. ISSN 0925-9724.
HAIR, J. F. et al. Análise multivariada de dados. Porto Alegre, RS, BR: Bookman editora, 2009.
HOLLAND, P. W.; DORANS, N. J.; PETERSEN, N. S. 6 equating test scores. In: RAO, C.; SINHARAY, S. (Ed.). Psychometrics. Princeton, NJ, USA: Elsevier, 2006, (Handbook of Statistics, v. 26). p. 169–203.
IZQUIERDO, I.; OLEA, J.; ABAD, F. J. Exploratory factor analysis in validation studies: uses and recommendations. Psicothema, Spain, v. 26, n. 3, p. 395–400, 2014.
KITCHENHAM, B.; CHARTERS, S. Guidelines for performing Systematic Literature Reviews in Software Engineering. University of Durham, Durham, UK, 2007.
LOPEZ, G.; GUERRERO, L. A. Awareness supporting technologies used in collaborative systems: A systematic literature review. In: Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing. New York, NY, USA: Association for Computing Machinery, 2017. (CSCW ’17), p. 808–820. ISBN 9781450343350.
MANTAU, M. J.; BENITTI, F. B. The awareness assessment model: measuring the awareness and collaboration support over the participant’s perspective. In: Anais do XVIII Simpósio Brasileiro de Sistemas Colaborativos. [S.l.]: SBC, 2023. p. 30–43.
MANTAU, M. J.; BENITTI, F. B. V. Awareness support in collaborative system: Reviewing last 10 years of cscw research. In: 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD). Hangzhou, China: IEEE, 2022. p. 564–569.
MANTAU, M. J.; BENITTI, F. B. V. Towards an awareness taxonomy. In: 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD). Hangzhou, China: IEEE, 2022. p. 495–500.
MANTAU, M. J.; BENITTI, F. B. V. The awareness assessment model repository. In: . DOI: 10.5281/zenodo.8298950, Zenodo, 2023.
MANTAU, M. J.; BENITTI, F. B. V. The awareness assessment model: measuring awareness and collaboration support over participant’s perspective. Universal Access in the Information Society, Springer Science and Business Media LLC, mar. 2024. ISSN 1615-5297. DOI: 10.1007/s10209-024-01110-5.
NICKERSON, R. C.; VARSHNEY, U.; MUNTERMANN, J. A method for taxonomy development and its application in information systems. European Journal of Information Systems, Springer, v. 22, n. 3, p. 336–359, 2013.
PASQUALI, L. TRI-Teoria de resposta ao item: Teoria, procedimentos e aplicacoes. Curitiba, PR, BR: Editora Appris, 2020.
PASQUALI, L.; PRIMI, R. Fundamentos da teoria da resposta ao item: Tri. Avaliação Psicológica: Interamerican Journal of Psychological Assessment, Instituto Brasileiro de Avaliação Psicológica (IBAP), v. 2, n. 2, p. 99–110, 2003.
PETTICREW, M.; ROBERTS, H. Systematic Reviews in the Social Sciences: A Practical Guide. Main Street, Malden, MA, USA: Blackwell Publishing Ltd, 2006.
POLIT, D. F.; BECK, C. T. Generalization in quantitative and qualitative research: Myths and strategies. International Journal of Nursing Studies, Elsevier BV, v. 47, n. 11, p. 1451–1458, 11 2010. ISSN 0020-7489.
ROGERS, Y.; SHARP, H.; PREECE, J. Design de interação. Porto Alegre, RS, BR: Bookman Editora, 2013.
SAMEJIMA, F. Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement, 1969.
SANTOS, N. S.; FERREIRA, L. S.; PRATES, R. O. An overview of evaluation methods for collaborative systems. In: 2012 Brazilian Symposium on Collaborative Systems. São Paulo, SP, BR: IEEE, 2012.
STANDARDIZATION, I. O. for. Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - Evaluation process. Geneva, CH, 2011. v. 1.
STEINMACHER, I.; CHAVES, A. P.; GEROSA, M. A. Awareness support in distributed software development: A systematic review and mapping of the literature. Computer Supported Cooperative Work (CSCW), Kluwer Academic Publishers, USA, v. 22, n. 2-3, 2013. ISSN 0925-9724.
SZOPINSKI, D.; SCHOORMANN, T.; KUNDISCH, D. Because your taxonomy is worth it: towards a framework for taxonomy evaluation. In: 27th European Conference on Information Systems. Stockholm University, Kista, Sweden: Association for Information Systems, 2019.
TAVAKOL, M.; WETZEL, A. Factor analysis: a means for theory and instrument development in support of construct validity. Int J Med Educ, England, UK, v. 11, p. 245–247, 11 2020.
TENENBERG, J.; ROTH, W.-M.; SOCHA, D. From i-awareness to we-awareness in cscw. Computer Supported Cooperative Work (CSCW), v. 25, n. 4, p. 235–278, 10 2016. ISSN 1573-7551.
TROCHIM, W. M.; DONNELLY, J. P. Research methods knowledge base. New York, NY, USA: Atomic Dog Pub. Macmillan Publishing Company, 2001. v. 2.
USMAN, M. et al. Taxonomies in software engineering: A systematic mapping study and a revised taxonomy development method. Information and Software Technology, v. 85, p. 43–59, 2017. ISSN 0950-5849.
WOHLIN, C. et al. Experimentation in software engineering: an introduction. New York, NY, USA: Springer Science & Business Media, 2012.
YIN, R. K. Case study research: Design and methods. London, UK: Sage Publications, Inc, 2009. v. 5.
BEECHAM, S. et al. Using an expert panel to validate a requirements process improvement model. Journal of Systems and Software, Elsevier, v. 76, n. 3, p. 251–275, 2005.
BICHLER, M. Design science in information systems research. Wirtschaftsinformatik, Springer, v. 48, n. 2, p. 133–135, 2006.
BRAVO, C. et al. Modeling awareness requirements in groupware: From cards to diagrams. IEEE Transactions on Human-Machine Systems, Institute of Electrical and Electronics Engineers (IEEE), p. 1–12, 2023. ISSN 2168-2305.
CAI, L. Metropolis-hastings robbins-monro algorithm for confirmatory item factor analysis. Journal of Educational and Behavioral Statistics, American Educational Research Association (AERA), v. 35, n. 3, p. 307–335, 6 2010. ISSN 1935-1054.
CHALMERS, R. P. mirt: A multidimensional item response theory package for therenvironment. Journal of Statistical Software, Foundation for Open Access Statistic, v. 48, n. 6, 2012. ISSN 1548-7660.
COLLAZOS, C. A. et al. Descriptive theory of awareness for groupware development. Journal of Ambient Intelligence and Humanized Computing, v. 10, n. 12, p. 4789–4818, 2019. ISSN 1868-5137.
CRONBACH, L. J. Coefficient alpha and the internal structure of tests. psychometrika, Springer, v. 16, n. 3, p. 297–334, 1951.
DEVELLIS, R. F. Scale development: Theory and applications. 4th. ed. London, UK: Sage Publications, Inc, 2016. v. 26. (Applied Social Research Methods 26, v. 26). ISBN 9781506341569.
DOURISH, P.; BELLOTTI, V. Awareness and coordination in shared workspaces. In: Proceedings of the 1992 ACM Conference on Computer-Supported Cooperative Work. New York, NY, USA: Association for Computing Machinery, 1992. (CSCW ’92), p. 107–114. ISBN 0897915429.
ELLIS, C.; GIBBS, S.; REIN, G. Groupware some issues and experiences. Communications of the ACM, ACM New York, NY, USA, v. 34, n. 1, p. 38–58, 1991. ISSN 0001-0782.
FORNELL, C.; LARCKER, D. F. Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research, Sage Publications Sage CA: Los Angeles, CA, v. 18, n. 1, p. 39–50, 1981.
GALLARDO, J.; BRAVO, C.; MOLINA, A. I. A framework for the descriptive specification of awareness support in multimodal user interfaces for collaborative activities. Journal on Multimodal User Interfaces, v. 12, n. 2, p. 145–159, 2018. ISSN 1783-7677.
GEORGE, J. F. Groupware. In: BIDGOLI, H. (Ed.). Encyclopedia of Information Systems. New York, NY, USA: Elsevier, 2003. p. 509–518. ISBN 978-0-12-227240-0.
GROSS, T. Supporting effortless coordination: 25 years of awareness research. Computer Supported Cooperative Work, v. 22, n. 4-6, p. 425–474, 2013. ISSN 0925-9724.
HAIR, J. F. et al. Análise multivariada de dados. Porto Alegre, RS, BR: Bookman editora, 2009.
HOLLAND, P. W.; DORANS, N. J.; PETERSEN, N. S. 6 equating test scores. In: RAO, C.; SINHARAY, S. (Ed.). Psychometrics. Princeton, NJ, USA: Elsevier, 2006, (Handbook of Statistics, v. 26). p. 169–203.
IZQUIERDO, I.; OLEA, J.; ABAD, F. J. Exploratory factor analysis in validation studies: uses and recommendations. Psicothema, Spain, v. 26, n. 3, p. 395–400, 2014.
KITCHENHAM, B.; CHARTERS, S. Guidelines for performing Systematic Literature Reviews in Software Engineering. University of Durham, Durham, UK, 2007.
LOPEZ, G.; GUERRERO, L. A. Awareness supporting technologies used in collaborative systems: A systematic literature review. In: Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing. New York, NY, USA: Association for Computing Machinery, 2017. (CSCW ’17), p. 808–820. ISBN 9781450343350.
MANTAU, M. J.; BENITTI, F. B. The awareness assessment model: measuring the awareness and collaboration support over the participant’s perspective. In: Anais do XVIII Simpósio Brasileiro de Sistemas Colaborativos. [S.l.]: SBC, 2023. p. 30–43.
MANTAU, M. J.; BENITTI, F. B. V. Awareness support in collaborative system: Reviewing last 10 years of cscw research. In: 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD). Hangzhou, China: IEEE, 2022. p. 564–569.
MANTAU, M. J.; BENITTI, F. B. V. Towards an awareness taxonomy. In: 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD). Hangzhou, China: IEEE, 2022. p. 495–500.
MANTAU, M. J.; BENITTI, F. B. V. The awareness assessment model repository. In: . DOI: 10.5281/zenodo.8298950, Zenodo, 2023.
MANTAU, M. J.; BENITTI, F. B. V. The awareness assessment model: measuring awareness and collaboration support over participant’s perspective. Universal Access in the Information Society, Springer Science and Business Media LLC, mar. 2024. ISSN 1615-5297. DOI: 10.1007/s10209-024-01110-5.
NICKERSON, R. C.; VARSHNEY, U.; MUNTERMANN, J. A method for taxonomy development and its application in information systems. European Journal of Information Systems, Springer, v. 22, n. 3, p. 336–359, 2013.
PASQUALI, L. TRI-Teoria de resposta ao item: Teoria, procedimentos e aplicacoes. Curitiba, PR, BR: Editora Appris, 2020.
PASQUALI, L.; PRIMI, R. Fundamentos da teoria da resposta ao item: Tri. Avaliação Psicológica: Interamerican Journal of Psychological Assessment, Instituto Brasileiro de Avaliação Psicológica (IBAP), v. 2, n. 2, p. 99–110, 2003.
PETTICREW, M.; ROBERTS, H. Systematic Reviews in the Social Sciences: A Practical Guide. Main Street, Malden, MA, USA: Blackwell Publishing Ltd, 2006.
POLIT, D. F.; BECK, C. T. Generalization in quantitative and qualitative research: Myths and strategies. International Journal of Nursing Studies, Elsevier BV, v. 47, n. 11, p. 1451–1458, 11 2010. ISSN 0020-7489.
ROGERS, Y.; SHARP, H.; PREECE, J. Design de interação. Porto Alegre, RS, BR: Bookman Editora, 2013.
SAMEJIMA, F. Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement, 1969.
SANTOS, N. S.; FERREIRA, L. S.; PRATES, R. O. An overview of evaluation methods for collaborative systems. In: 2012 Brazilian Symposium on Collaborative Systems. São Paulo, SP, BR: IEEE, 2012.
STANDARDIZATION, I. O. for. Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - Evaluation process. Geneva, CH, 2011. v. 1.
STEINMACHER, I.; CHAVES, A. P.; GEROSA, M. A. Awareness support in distributed software development: A systematic review and mapping of the literature. Computer Supported Cooperative Work (CSCW), Kluwer Academic Publishers, USA, v. 22, n. 2-3, 2013. ISSN 0925-9724.
SZOPINSKI, D.; SCHOORMANN, T.; KUNDISCH, D. Because your taxonomy is worth it: towards a framework for taxonomy evaluation. In: 27th European Conference on Information Systems. Stockholm University, Kista, Sweden: Association for Information Systems, 2019.
TAVAKOL, M.; WETZEL, A. Factor analysis: a means for theory and instrument development in support of construct validity. Int J Med Educ, England, UK, v. 11, p. 245–247, 11 2020.
TENENBERG, J.; ROTH, W.-M.; SOCHA, D. From i-awareness to we-awareness in cscw. Computer Supported Cooperative Work (CSCW), v. 25, n. 4, p. 235–278, 10 2016. ISSN 1573-7551.
TROCHIM, W. M.; DONNELLY, J. P. Research methods knowledge base. New York, NY, USA: Atomic Dog Pub. Macmillan Publishing Company, 2001. v. 2.
USMAN, M. et al. Taxonomies in software engineering: A systematic mapping study and a revised taxonomy development method. Information and Software Technology, v. 85, p. 43–59, 2017. ISSN 0950-5849.
WOHLIN, C. et al. Experimentation in software engineering: an introduction. New York, NY, USA: Springer Science & Business Media, 2012.
YIN, R. K. Case study research: Design and methods. London, UK: Sage Publications, Inc, 2009. v. 5.
Publicado
02/06/2025
Como Citar
MANTAU, Márcio J.; BENITTI, Fabiane B. V..
An Awareness Assessment Model for Collaborative Interfaces. In: CONCURSO DE TESES, DISSERTAÇÕES E TCCS EM SISTEMAS COLABORATIVOS - SIMPÓSIO BRASILEIRO DE SISTEMAS COLABORATIVOS (SBSC), 20. , 2025, Manaus/AM.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2025
.
p. 104-116.
DOI: https://doi.org/10.5753/sbsc_estendido.2025.6502.
