Integrated Quantitative Evaluation of Spatial Cognition and Motor Function with HoloLens Mixed Reality

Area of Science:

• Gerontology
• Rehabilitation Medicine
• Human-Computer Interaction

Background:

• Global aging population necessitates advanced rehabilitation and physical evaluation systems.
• Mixed Reality (MR) technology shows promise for rehabilitation but has been limited to static virtual environments.
• Existing MR rehabilitation applications lack dynamic interaction with the surrounding environment.

Purpose of the Study:

• To develop an interactive mixed reality application for dynamic rehabilitation and physical ability evaluation.
• To address the limitations of static virtual objects in current MR rehabilitation systems.
• To create a system capable of evaluating cognitive and motor functions within an interactive MR environment.

Main Methods:

• Development of a novel mixed reality application for rehabilitation.
• Implementation of dynamic virtual objects with environmental interaction.
• Evaluation of cognitive and motor functions using the developed MR application.

Main Results:

• The developed MR application effectively evaluated spatial cognitive ability, task skillfulness, motor function, and decision-making.
• Demonstrated feasibility of MR technology for quantifying motor function in dynamic rehabilitation tasks.
• Showcased MR's utility in assessing spatial cognition for both static and dynamic scenarios.

Conclusions:

• Mixed reality technology is a feasible and useful tool for dynamic rehabilitation.
• The developed application effectively quantifies key cognitive and motor functions.
• MR holds significant potential for future automated rehabilitation and physical ability evaluations.