Using Multisensory Technologies to Stimulate People: a Reflexive Paper on Scenagrams
Abstract
This paper aims at discussing the interest to use multisensory technologies for humans cognition training. First it introduces multisensory interactions making a focus on advancement in two fields: Human-Computer Interaction and mulsemedia. Second, it presents two different multisensory systems resulting from Robadom and StimSense projects that could be adapted for the community. Then, this paper defines the concept of scenagram and gives its application scopes, boundaries and use cases, offering a first classification of this new concept.
Keywords:
multisensory interaction, multisensory systems, cognition, user experience, use cases, scenagram
References
A. Dix, “Human–computer interaction, foundations and new paradigms,” J. Vis. Lang. Comput., vol. 42, pp. 122–134, Oct. 2017.
G. Goth and Gregory, “Brave NUI world,” Commun. ACM, vol. 54, no. 12, p. 14, Dec. 2011.
R. Casillas Figueroa, “Personal spaces for multisensory stimulation as support to rehabilitate patients with cognitive disabilities,” in Proceedings of the XVIII International Conference on Human Computer Interaction - Interacción ’17, 2017, pp. 1–2.
A. Covaci, L. Zou, I. Tal, G.-M. Muntean, and G. Ghinea, “Is Multimedia Multisensorial? - A Review of Mulsemedia Systems,” ACM Comput. Surv., vol. 51, no. 5, pp. 1–35, 2018.
Y. Sulema, “Mulsemedia vs. Multimedia: State of the art and future trends,” in 2016 International Conference on Systems, Signals and Image Processing (IWSSIP), 2016, pp. 1–5.
C. Jost, B. Le Pevedic, O. El Barraj, and G. Uzan, “MulseBox: Portable multisensory interactive device,” in Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, 2019, vol. 2019-Octob, pp. 3956–3961.
E. B. Saleme, C. A. S. Santos, and G. Ghinea, “A mulsemedia framework for delivering sensory effects to heterogeneous systems,” Multimed. Syst., vol. 25, no. 4, pp. 421–447, Aug. 2019.
E. B. Saleme, A. Covaci, G. Mesfin, C. A. S. Santos, and G. Ghinea, “Mulsemedia DIY: A survey of devices and a tutorial for building your own mulsemedia environment,” ACM Computing Surveys, vol. 52, no. 3. Association for Computing Machinery, 01-Jun-2019.
K. Brunnström et al., “Qualinet White Paper on Definitions of Quality of Experience,” 2013.
A. Perkis, C. Timmerer, and et al., “QUALINET White Paper on Definitions of Immersive Media Experience (IMEx),” in European Network on Quality of Experience in Multimedia Systems and Services, 14th QUALINET meeting (online), 2019.
N. Murray, O. A. Ademoye, G. Ghinea, and G. M. Muntean, “A tutorial for olfaction-based multisensorial media application design and evaluation,” ACM Comput. Surv., vol. 50, no. 5, Sep. 2017.
S. Baillon, E. van Diepen, and R. Prettyman, “Multi-sensory therapy in psychiatric care,” Adv. Psychiatr. Treat., vol. 8, no. 6, pp. 444– 450, Nov. 2002.
J. C. Chung and C. K. Lai, “Snoezelen for dementia,” Cochrane Database Syst. Rev., no. 4, Oct. 2002
M. Chetouani et al., “Cognitive services for elderly people: The ROBADOM project,” 2010.
C. Jost, B. Le Pévédic, and D. Duhaut, “ArCo: an architecture for children to control a set of robots.”
E. B. Saleme and C. A. S. Santos, “PlaySEM: a Platform for Rendering MulSeMedia Compatible with MPEG-V,” in Proceedings of the 21st Brazilian Symposium on Multimedia and the Web - WebMedia ’15, 2015, pp. 145–148.
S. T. Farias, E. Harrell, C. Neumann, and A. Houtz, “The relationship between neuropsychological performance and daily functioning in individuals with Alzheimer’s disease: ecological validity of neuropsychological tests,” Arch. Clin. Neuropsychol., vol. 18, no. 6, pp. 655– 672, Aug. 2003.
V. Wojtasik, F. Lekeu, A. Quittre, C. Olivier, S. Adam, and É. Salmon, “Réadaptation cognitive pour les activités de vie quotidiennedans la maladie d’Alzheimer,” Gérontologie et société, vol. 32 / n° 130, no. 3, p. 187, 2009.
B. Bouchard, F. Imbeault, A. Bouzouane, and B.-A. J. Menelas, “Developing Serious Games Specifically Adapted to People Suffering from Alzheimer,” Springer, Berlin, Heidelberg, 2012, pp. 243–254.
D. Dmitrenko, E. Maggioni, and M. Obrist, “Towards a framework for validating the matching between notifications and scents in olfactory in-car interaction,” in Conference on Human Factors in Computing Systems - Proceedings, 2019.
G. Goth and Gregory, “Brave NUI world,” Commun. ACM, vol. 54, no. 12, p. 14, Dec. 2011.
R. Casillas Figueroa, “Personal spaces for multisensory stimulation as support to rehabilitate patients with cognitive disabilities,” in Proceedings of the XVIII International Conference on Human Computer Interaction - Interacción ’17, 2017, pp. 1–2.
A. Covaci, L. Zou, I. Tal, G.-M. Muntean, and G. Ghinea, “Is Multimedia Multisensorial? - A Review of Mulsemedia Systems,” ACM Comput. Surv., vol. 51, no. 5, pp. 1–35, 2018.
Y. Sulema, “Mulsemedia vs. Multimedia: State of the art and future trends,” in 2016 International Conference on Systems, Signals and Image Processing (IWSSIP), 2016, pp. 1–5.
C. Jost, B. Le Pevedic, O. El Barraj, and G. Uzan, “MulseBox: Portable multisensory interactive device,” in Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, 2019, vol. 2019-Octob, pp. 3956–3961.
E. B. Saleme, C. A. S. Santos, and G. Ghinea, “A mulsemedia framework for delivering sensory effects to heterogeneous systems,” Multimed. Syst., vol. 25, no. 4, pp. 421–447, Aug. 2019.
E. B. Saleme, A. Covaci, G. Mesfin, C. A. S. Santos, and G. Ghinea, “Mulsemedia DIY: A survey of devices and a tutorial for building your own mulsemedia environment,” ACM Computing Surveys, vol. 52, no. 3. Association for Computing Machinery, 01-Jun-2019.
K. Brunnström et al., “Qualinet White Paper on Definitions of Quality of Experience,” 2013.
A. Perkis, C. Timmerer, and et al., “QUALINET White Paper on Definitions of Immersive Media Experience (IMEx),” in European Network on Quality of Experience in Multimedia Systems and Services, 14th QUALINET meeting (online), 2019.
N. Murray, O. A. Ademoye, G. Ghinea, and G. M. Muntean, “A tutorial for olfaction-based multisensorial media application design and evaluation,” ACM Comput. Surv., vol. 50, no. 5, Sep. 2017.
S. Baillon, E. van Diepen, and R. Prettyman, “Multi-sensory therapy in psychiatric care,” Adv. Psychiatr. Treat., vol. 8, no. 6, pp. 444– 450, Nov. 2002.
J. C. Chung and C. K. Lai, “Snoezelen for dementia,” Cochrane Database Syst. Rev., no. 4, Oct. 2002
M. Chetouani et al., “Cognitive services for elderly people: The ROBADOM project,” 2010.
C. Jost, B. Le Pévédic, and D. Duhaut, “ArCo: an architecture for children to control a set of robots.”
E. B. Saleme and C. A. S. Santos, “PlaySEM: a Platform for Rendering MulSeMedia Compatible with MPEG-V,” in Proceedings of the 21st Brazilian Symposium on Multimedia and the Web - WebMedia ’15, 2015, pp. 145–148.
S. T. Farias, E. Harrell, C. Neumann, and A. Houtz, “The relationship between neuropsychological performance and daily functioning in individuals with Alzheimer’s disease: ecological validity of neuropsychological tests,” Arch. Clin. Neuropsychol., vol. 18, no. 6, pp. 655– 672, Aug. 2003.
V. Wojtasik, F. Lekeu, A. Quittre, C. Olivier, S. Adam, and É. Salmon, “Réadaptation cognitive pour les activités de vie quotidiennedans la maladie d’Alzheimer,” Gérontologie et société, vol. 32 / n° 130, no. 3, p. 187, 2009.
B. Bouchard, F. Imbeault, A. Bouzouane, and B.-A. J. Menelas, “Developing Serious Games Specifically Adapted to People Suffering from Alzheimer,” Springer, Berlin, Heidelberg, 2012, pp. 243–254.
D. Dmitrenko, E. Maggioni, and M. Obrist, “Towards a framework for validating the matching between notifications and scents in olfactory in-car interaction,” in Conference on Human Factors in Computing Systems - Proceedings, 2019.
Published
2021-06-21
How to Cite
JOST, Céline; LE PÉVÉDIC, Brigitte; UZAN, Gérard.
Using Multisensory Technologies to Stimulate People: a Reflexive Paper on Scenagrams . In: WORKSHOP ON MULTISENSORY EXPERIENCES (SENSORYX), 1. , 2021, New York.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2021
.
DOI: https://doi.org/10.5753/sensoryx.2021.15686.
