Evaluating the real-world usability of BCI control systems with augmented reality: a user study protocol

Area of Science:

• Neuroscience and Human-Computer Interaction
• Augmented Reality Applications
• Biomedical Engineering

Background:

• Brain-computer interfaces (BCI) offer device control via neural activity.
• Motor imagery (MI) is a common BCI control paradigm.
• Existing research lacks comprehensive evaluation methodologies for real-world BCI use.

Purpose of the Study:

• Introduce a user-centric evaluation protocol for MI-based BCI systems.
• Assess the performance and user experience of an AR-enhanced MI-BCI.
• Address the gap in real-world BCI evaluation methodologies.

Main Methods:

• Developed a three-phase evaluation protocol: technical validation, performance assessment, and comparative user experience analysis.
• Utilized augmented reality (AR) to guide users and display environment-aware actions.
• Combined quantitative and qualitative assessments, including questionnaires and task-based comparisons.

Main Results:

• The protocol systematically validates technical robustness, assesses control system performance, and evaluates user experience.
• AR enhances user interaction within the MI-BCI system.
• The protocol is versatile and adaptable for various BCI applications.

Conclusions:

• The proposed user-centric protocol provides a comprehensive framework for evaluating MI-BCI systems.
• This methodology facilitates iterative improvements in BCI technology.
• The protocol ensures systematic, user-focused validation for enhanced BCI development.