The Awareness Assessment Process

  • Márcio J. Mantau UDESC
  • Fabiane B. V. Benitti UFSC

Resumo


Different strategies in the literature seek to help support awareness mechanisms in collaborative applications. However, the most common approaches are projected to a specific context and do not focus on evaluating these mechanisms or the provided support from the user’s point of view. Few studies present methods or processes that provide awareness aspects in collaborative systems; thus, finding a good starting point in the literature can be challenging for beginners in awareness design. We evolve the findings presented by (MANTAU; BENITTI, 2023a), providing contributions towards developing an awareness assessment process that allows accessing the awareness and, consequently, the collaboration support through measuring awareness mechanisms from the participant’s viewpoint. Then, we expose the model’s artifacts to HCI and collaborative system examiners’ appreciation to verify the suitability of the process by reliability and usefulness criteria.

Referências

ALTENBURGER, T. et al. Groupware requirements modelling for adaptive user interface design. eWork and eBusiness in Architecture, Engineering and Construction - Proceedings of the European Conference on Product and Process Modelling 2012, ECPPM 2012, Reykjavik, Iceland, v. 1, n. 1, p. 825–832, 2012.

ANTUNES, P. et al. Structuring dimensions for collaborative systems evaluation. ACM Computing Surveys, v. 44, n. 2, p. 1–28, 2012. ISSN 0360-0300.

ANTUNES, P. et al. Reviewing the quality of awareness support in collaborative applications. Journal of Systems and Software, elsevier, v. 89, n. 1, p. 146–169, 2014. ISSN 0164-1212.

ARAÚJO, L. P. D. et al. Heuristic evaluation for mobile groupware: Evaluating two audience response systems. Journal of Applied Computing Research, v. 3, n. 2, p. 64–77, 2014.

BAKER, F. B.; KIM, S.-H. The basics of item response theory using R. Madision, WI, USA: Springer, 2017.

BARBOSA, S.; SILVA, B. Interação humano-computador. Rio de Janeiro, RJ: Elsevier Brasil, 2010.

BASILI, V. Software modeling and measurement: The goal/question/metric paradigm. Technical Report, Department of Computer Science, University of Maryland, 1992.

BELKADI, F. et al. A situation model to support awareness in collaborative design. International Journal of Human Computer Studies, v. 71, n. 1, p. 110–129, 2013. ISSN 1071-5819.

BERKMAN, M. l.; KARAHOCA, D.; KARAHOCA, A. A measurement and structural model for usability evaluation of shared workspace groupware. International Journal of Human-Computer Interaction, v. 34, n. 1, p. 35–56, 2018. ISSN 1044-7318.

BRAVO, C. et al. Modeling awareness requirements in groupware: From cards to diagrams. IEEE Transactions on Human-Machine Systems, Institute of Electrical and Electronics Engineers (IEEE), p. 1–12, 2023. ISSN 2168-2305.

BREZILLON, P. et al. Context-based awareness in group work. In: Proceeding of the 17th International FLAIRS Conference. Miami, FL, USA: AAAI Press, 2004.

CHALMERS, R. P. mirt: A multidimensional item response theory package for therenvironment. Journal of Statistical Software, Foundation for Open Access Statistic, v. 48, n. 6, 2012. ISSN 1548-7660.

COLLAZOS, C. A. et al. Descriptive theory of awareness for groupware development. Journal of Ambient Intelligence and Humanized Computing, v. 10, n. 12, p. 4789–4818, 2019. ISSN 1868-5137.

CRUZ, A. et al. Towards an overarching classification model of cscw and groupware: A socio-technical perspective. In: Lecture Notes in Computer Science. Raesfeld, Germany: Elsevier, 2012. v. 7493, p. 41–56. ISSN 0302-9743.

DOURISH, P. Where the action is: the foundations of embodied interaction. Cambridge, MA, USA: MIT Press, 2004. ISBN 0262041960.

DOURISH, P.; BELLOTTI, V. Awareness and coordination in shared workspaces. In: Proceedings of the 1992 ACM Conference on Computer-Supported Cooperative Work. New York, NY, USA: Association for Computing Machinery, 1992. (CSCW ’92), p. 107–114. ISBN 0897915429.

GALLARDO, J.; BRAVO, C.; MOLINA, A. I. A framework for the descriptive specification of awareness support in multimodal user interfaces for collaborative activities. Journal on Multimodal User Interfaces, v. 12, n. 2, p. 145–159, 2018. ISSN 1783-7677.

GALLARDO, J. et al. An ontological conceptualization approach for awareness in domain-independent collaborative modeling systems: Application to a model-driven development method. In: . [S.l.]: Elsevier BV, 2011. v. 38, n. 2, p. 1099–1118. ISSN 0957-4174.

GEORGE, J. F. Groupware. In: BIDGOLI, H. (Ed.). Encyclopedia of Information Systems. New York, NY, USA: Elsevier, 2003. p. 509–518. ISBN 978-0-12-227240-0.

GREENBERG, S. Collaborative interfaces for the web. Human factors and web development, Citeseer, v. 18, p. 241–254, 1997.

GROSS, T. Supporting effortless coordination: 25 years of awareness research. Computer Supported Cooperative Work, v. 22, n. 4-6, p. 425–474, 2013. ISSN 0925-9724.

GUTWIN, C. et al. Looking away and catching up: Dealing with brief attentional disconnection in synchronous groupware. In: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. New York, NY, USA: Association for Computing Machinery, 2017. (CSCW ’17), p. 2221–2235. ISBN 9781450343350.

GUTWIN, C.; GREENBERG, S. A descriptive framework of workspace awareness for real-time groupware. Computer Supported Cooperative Work, v. 11, n. 3-4, p. 411–446, 2002. ISSN 0925-9724.

GUTWIN, C.; GREENBERG, S.; ROSEMAN, M. Workspace awareness in real-time distributed groupware: Framework, widgets, and evaluation. In: SASSE, M. A.; CUNNINGHAM, R. J.; WINDER, R. L. (Ed.). People and Computers XI. London: Springer London, 1996. (HCI’96), p. 281–298. ISBN 9781447135883.

HERSKOVIC, V. et al. The iceberg effect: Behind the user interface of mobile collaborative systems. JUCS - Journal of Universal Computer Science, v. 17, n. 2, p. 183–201, 2011.

ISO/IEC 25.040. Systems and Software Engineering - Systems and Software Quality Requirements and Evaluation (SQuaRE) - Evaluation process. Geneva, CH, 2011. v. 1.

KIM, K. T. et al. Hugin: A framework for awareness and coordination in mixed-presence collaborative information visualization. In: ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010. New York, NY, USA: ACM, 2010. p. 231–240.

KIRSCH-PINHEIRO, M.; LIMA, J. V. D.; BORGES, M. R. A framework for awareness support in groupware systems. Computers in Industry, Elsevier, v. 52, n. 1, p. 47–57, 2003.

LOPEZ, G.; GUERRERO, L. A. Awareness supporting technologies used in collaborative systems: A systematic literature review. In: Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing. New York, NY, USA: Association for Computing Machinery, 2017. (CSCW ’17), p. 808–820. ISBN 9781450343350.

MANTAU, M. J.; BENITTI, F. B. V. Awareness support in collaborative system: Reviewing last 10 years of cscw research. In: 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD). Hangzhou, China: IEEE, 2022. p. 564–569.

MANTAU, M. J.; BENITTI, F. B. V. Towards an awareness taxonomy. In: 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD). Hangzhou, China: IEEE, 2022. p. 495–500.

MANTAU, M. J.; BENITTI, F. B. V. The awareness assessment model: measuring the awareness and collaboration support over the participant’s perspective. In: Anais do XVIII Simpósio Brasileiro de Sistemas Colaborativos. [S.l.]: SBC, 2023. p. 30–43.

MANTAU, M. J.; BENITTI, F. B. V. The awareness assessment model repository. In: . DOI: 10.5281/zenodo.8298950, Zenodo, 2023.

MANTAU, M. J.; BENITTI, F. B. V. The awareness assessment model: measuring awareness and collaboration support over participant’s perspective. Universal Access in the Information Society, Springer Science and Business Media LLC, mar. 2024. ISSN 1615-5297. Disponível em: DOI: 10.1007/s10209-024-01110-5.

MANTAU, M. J.; BERKENBROCK, C. D. M.; BERKENBROCK, G. R. Visualization and filtering awareness information in mobile groupware: An action research approach. In: Proceedings of the 2014 IEEE 18th International Conference on Computer Supported Cooperative Work in Design (CSCWD). National Tsing Hua University, Hsinchu, Taiwan: IEEE, 2014. (CSCWD’14, v. 1), p. 563–568.

MANTAU, M. J.; BERKENBROCK, C. D. M.; BERKENBROCK, G. R. Análise de requisitos de percepção em um groupware móvel síncrono. Revista de Sistemas de Informação da FSMA, v. 1, n. 19, p. 16–33, 2017. ISSN 1044-7318.

NICKERSON, R. C.; VARSHNEY, U.; MUNTERMANN, J. A method for taxonomy development and its application in information systems. European Journal of Information Systems, Springer, v. 22, n. 3, p. 336–359, 2013.

NIEMANTSVERDRIET, K. et al. Designing for awareness in interactions with shared systems: The dass framework. ACM Transaction on Computer-Human Interaction, Association for Computing Machinery, New York, NY, USA, v. 26, n. 6, p. 1–41, 11 2019. ISSN 1073-0516.

PASQUALI, L. TRI-Teoria de resposta ao item: Teoria, procedimentos e aplicacoes. Curitiba, PR, BR: Editora Appris, 2020.

PROUZEAU, A.; BEZERIANOS, A.; CHAPUIS, O. Awareness techniques to aid transitions between personal and shared workspaces in multi-display environments. In: ISS 2018 - Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces. Tokyo, Japan: ACM, 2018. p. 291–304.

ROCKER, C. Universal access to awareness information: Using smart artefacts to mediate awareness in distributed teams. Universal Access in the Information Society, v. 11, n. 3, p. 259–271, 2012. ISSN 1615-5289.

ROGERS, Y.; SHARP, H.; PREECE, J. Design de interação. Porto Alegre, RS, BR: Bookman Editora, 2013.

SANTOS, N. S.; FERREIRA, L. S.; PRATES, R. O. An overview of evaluation methods for collaborative systems. In: 2012 Brazilian Symposium on Collaborative Systems. São Paulo, SP, BR: IEEE, 2012.

SCHMIDT, K.; RANDALL, D. Preface to the special issue on ‘reconsidering “awareness” in cscw’. Computer Supported Cooperative Work (CSCW), v. 25, n. 4, p. 229–233, 10 2016. ISSN 1573-7551.

SEEBACH, C.; BECK, R.; PAHLKE, I. Situation awareness through social collaboration platforms in distributed work environments. In: International Conference on Information Systems 2011, ICIS 2011. Shanghai, China: Association for Information Systems, 2011. v. 1, p. 1–22.

SOUZA, L. G.; BARBOSA, S. D. J. Evaluating the molicc notation using the cognitive dimensions of notations framework. In: Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems. New York, NY, USA: Association for Computing Machinery, 2015. (IHC ’15), p. 1–10. ISBN 9781450353625.

STEINMACHER, I.; CHAVES, A. P.; GEROSA, M. A. Awareness support in distributed software development: A systematic review and mapping of the literature. Computer Supported Cooperative Work (CSCW), Kluwer Academic Publishers, USA, v. 22, n. 2-3, 2013. ISSN 0925-9724.

STERNBERG, R. J.; STERNBERG, K.; MIO, J. Cognitive Psychology. Belmont, California, USA: Wadsworth: Cengage Learning, 2012. 167-169 p.

SZOPINSKI, D.; SCHOORMANN, T.; KUNDISCH, D. Because your taxonomy is worth it: towards a framework for taxonomy evaluation. In: 27th European Conference on Information Systems. Stockholm University, Kista, Sweden: Association for Information Systems, 2019.

TALAEI-KHOEI, A. et al. A methodology to develop awareness in computer supported collaborative work using policies. Journal of Computer and System Sciences, v. 80, n. 7, p. 1323–1338, 2014. ISSN 0022-0000.

TENENBERG, J.; ROTH, W.-M.; SOCHA, D. From i-awareness to we-awareness in cscw. Computer Supported Cooperative Work (CSCW), v. 25, n. 4, p. 235–278, 10 2016. ISSN 1573-7551.

YANG, C.-L. et al. Knowing that you know what i know helps? understanding the effects of knowledge transparency in online knowledge transfer. ACM Transaction on Computer-Human Interaction, Association for Computing Machinery, New York, NY, USA, v. 2, n. CSCW, p. 1–21, 11 2018.
Publicado
02/06/2025
MANTAU, Márcio J.; BENITTI, Fabiane B. V.. The Awareness Assessment Process. In: SIMPÓSIO BRASILEIRO DE SISTEMAS COLABORATIVOS (SBSC), 20. , 2025, Manaus/AM. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2025 . p. 228-243. ISSN 2326-2842. DOI: https://doi.org/10.5753/sbsc.2025.6574.