TY - JOUR
T1 - Evaluating the real-world usability of BCI control systems with augmented reality: a user study protocol
AU - Dillen, Arnau
AU - Omidi, Mohsen
AU - Díaz, María Alejandra
AU - Ghaffari, Fakhreddine
AU - Roelands, Bart
AU - Vanderborght, Bram
AU - Romain, Olivier
AU - Pauw, Kevin De
N1 - Publisher Copyright:
Copyright © 2024 Dillen, Omidi, Díaz, Ghaffari, Roelands, Vanderborght, Romain and De Pauw.
PY - 2024/8/5
Y1 - 2024/8/5
N2 - Brain-computer interfaces (BCI) enable users to control devices through their brain activity. Motor imagery (MI), the neural activity resulting from an individual imagining performing a movement, is a common control paradigm. This study introduces a user-centric evaluation protocol for assessing the performance and user experience of an MI-based BCI control system utilizing augmented reality. Augmented reality is employed to enhance user interaction by displaying environment-aware actions, and guiding users on the necessary imagined movements for specific device commands. One of the major gaps in existing research is the lack of comprehensive evaluation methodologies, particularly in real-world conditions. To address this gap, our protocol combines quantitative and qualitative assessments across three phases. In the initial phase, the BCI prototype's technical robustness is validated. Subsequently, the second phase involves a performance assessment of the control system. The third phase introduces a comparative analysis between the prototype and an alternative approach, incorporating detailed user experience evaluations through questionnaires and comparisons with non-BCI control methods. Participants engage in various tasks, such as object sorting, picking and placing, and playing a board game using the BCI control system. The evaluation procedure is designed for versatility, intending applicability beyond the specific use case presented. Its adaptability enables easy customization to meet the specific user requirements of the investigated BCI control application. This user-centric evaluation protocol offers a comprehensive framework for iterative improvements to the BCI prototype, ensuring technical validation, performance assessment, and user experience evaluation in a systematic and user-focused manner.
AB - Brain-computer interfaces (BCI) enable users to control devices through their brain activity. Motor imagery (MI), the neural activity resulting from an individual imagining performing a movement, is a common control paradigm. This study introduces a user-centric evaluation protocol for assessing the performance and user experience of an MI-based BCI control system utilizing augmented reality. Augmented reality is employed to enhance user interaction by displaying environment-aware actions, and guiding users on the necessary imagined movements for specific device commands. One of the major gaps in existing research is the lack of comprehensive evaluation methodologies, particularly in real-world conditions. To address this gap, our protocol combines quantitative and qualitative assessments across three phases. In the initial phase, the BCI prototype's technical robustness is validated. Subsequently, the second phase involves a performance assessment of the control system. The third phase introduces a comparative analysis between the prototype and an alternative approach, incorporating detailed user experience evaluations through questionnaires and comparisons with non-BCI control methods. Participants engage in various tasks, such as object sorting, picking and placing, and playing a board game using the BCI control system. The evaluation procedure is designed for versatility, intending applicability beyond the specific use case presented. Its adaptability enables easy customization to meet the specific user requirements of the investigated BCI control application. This user-centric evaluation protocol offers a comprehensive framework for iterative improvements to the BCI prototype, ensuring technical validation, performance assessment, and user experience evaluation in a systematic and user-focused manner.
KW - brain-computer interface
KW - eye tracking
KW - augmented reality
KW - Robot control
KW - user evaluation
KW - user experience
KW - human-robot interaction
UR - http://dx.doi.org/10.3389/fnhum.2024.1448584
UR - http://www.scopus.com/inward/record.url?scp=85201400089&partnerID=8YFLogxK
U2 - 10.3389/fnhum.2024.1448584
DO - 10.3389/fnhum.2024.1448584
M3 - Article
VL - 18
JO - Frontiers in Human Neuroscience
JF - Frontiers in Human Neuroscience
SN - 1662-5161
M1 - 1448584
ER -