A Review of Research on the Integrated Application and User Experience of Multimodal Human-Computer Interaction in Smart Home Systems for Older Adults_Vol. 4 No. 3 (JIKE 2026)_Journal of Intelligence and Knowledge Engineering (ISSN: 2959-0620)

Home > Journal of Intelligence and Knowledge Engineering (ISSN: 2959-0620) > Vol. 4 No. 3 (JIKE 2026) >

A Review of Research on the Integrated Application and User Experience of Multimodal Human-Computer Interaction in Smart Home Systems for Older Adults

Download PDF

DOI: https://doi.org/10.62517/jike.202604312

Author(s)

Zhen Zhou

Affiliation(s)

Electronic Information Engineering, Putian University, Putian, China

Abstract

As the global population continues to age, smart home systems are playing an increasingly important role in ensuring the independent living of older adults and improving their quality of life . However, the common decline in vision, hearing, touch, and movement abilities of older adults makes it difficult for traditional single-modal interaction methods to meet their actual use needs . This article uses a literature review method to systematically retrieve and analyze research results on single modalities such as voice interaction, touch interaction, and graphical interfaces in the field of smart homes for older adults, as well as research on the integration practice and user experience evaluation of multimodal interaction. In order to enhance the focus of the research, this article limits the scope of analysis to three typical scenarios: environmental control, health management and social entertainment. On this basis, three multi-modal integration modes are summarized: complementary, redundant and adaptive.

Keywords

Multimodal Human-Computer Interaction; Older Adults; Smart Home Systems; User Experience; Age-Friendly Design

References

[1] World Health Organization. (2015). World report on ageing and health. World Health Organization. https://www.who.int/publications/i/item/9789241565042 [2] United Nations Department of Economic and Social Affairs, Population Division. (2022). World population prospects 2022: Summary of results. United Nations. https://www.un.org/development/desa/pd/content/World-Population-Prospects-2022 [3] Charness, N., Best, R., & Evans, J. (2016). Supportive home health care technology for older adults: Attitudes and implementation. Gerontechnology, 15(4), 233-242. https://doi.org/10.4017/gt.2016.15.4.006.00 [4] Ghorayeb, A., Comber, R., & Gooberman-Hill, R. (2023). Development of a smart home interface with older adults: Multi-method co-design study. JMIR Aging, 6, e44439. https://doi.org/10.2196/44439 [5] Findlater, L., Froehlich, J. E., Fattal, K., Wobbrock, J. O., & Dastyar, T. (2013). Age-related differences in performance with touchscreens compared to traditional mouse input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 343-346). ACM. https://doi.org/10.1145/2470654.2470703 [6] Gao, Q., & Sun, Q. (2015). Examining the usability of touch screen gestures for older and younger adults. Human Factors, 57(5), 835-863. https://doi.org/10.1177/0018720815581293 [7] Hawthorn, D. (2000). Possible implications of aging for interface designers. Interacting with Computers, 12(5), 507-528. https://doi.org/10.1016/S0953-5438(99)00021-1 [8] Larson, J. A., & Oviatt, S. (2004). Guidelines for multimodal user interface design. Communications of the ACM, 47(1), 39-43. https://doi.org/10.1145/962081.962106 [9] Oviatt, S., & Cohen, P. (2000). Perceptual user interfaces: Multimodal interfaces that process what comes naturally. Communications of the ACM, 43(3), 45-53. https://doi.org/10.1145/330534.330538 [10] Carmeli, E., Patish, H., & Coleman, R. (2003). The aging hand. The Journals of Gerontology: Series A, 58(2), M146-M152. https://doi.org/10.1093/gerona/58.2.M146 [11] Fisk, A. D., Rogers, W. A., Charness, N., Czaja, S. J., & Sharit, J. (2009). Designing for older adults: Principles and creative human factors approaches (2nd ed.). CRC Press. [12] Arnold, A., Kolody, S., Comeau, A., & Cruz, A. M. (2024). What does the literature say about the use of personal voice assistants in older adults? A scoping review. Disability and Rehabilitation: Assistive Technology, 19(1), 100-111. https://doi.org/10.1080/17483107.2022.2041246 [13] Kim, S. (2021). Exploring how older adults use a smart speaker-based voice assistant in their first interactions: Qualitative study. JMIR mHealth and uHealth, 9(1), e20427. https://doi.org/10.2196/20427 [14] Warnock, D., McGee-Lennon, M., & Brewster, S. (2012). Older users, multimodal reminders and assisted living technology. Health Informatics Journal, 18(3), 181-190. https://doi.org/10.1177/1460458212440979