Assessing the Value of Multimodal Interfaces: A Study on Human-Machine Interaction in Weld Inspection Workstations

Area of Science:

• Human-Computer Interaction
• Industrial Engineering
• Usability Studies

Background:

• Multimodal user interfaces enhance natural human-machine interaction.
• The development effort for multisensor systems requires justification.
• Assessing user satisfaction with single versus multiple input modalities is crucial.

Purpose of the Study:

• To investigate the effectiveness and user preference of unimodal versus multimodal interfaces in an industrial setting.
• To determine if complex multisensor systems are justified over simpler, single-modality interfaces.
• To evaluate user interactions with spatial and speech-based input methods.

Main Methods:

• Comparison of three unimodal interfaces (spatial interaction with augmented buttons on workpiece/worktable, speech commands) tested individually.
• Evaluation of a multimodal combination of these input technologies.
• User testing within an industrial weld inspection workstation environment.

Main Results:

• Users preferred the augmented worktable interface in unimodal conditions.
• The multimodal combination, utilizing all input technologies, received the highest overall ranking for interindividual usage.
• Individual input modality usability for complex systems is challenging to predict.

Conclusions:

• Implementing multiple input modalities in user interfaces is beneficial for complex systems.
• Multimodal interfaces can lead to higher user satisfaction and efficiency.
• The value of multisensor systems is confirmed, despite development complexity.