Related Experiment Video
Updated: Jul 12, 2025

Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research
Published on: December 18, 2020
Identifying interaction types and functionality for automated vehicle virtual assistants: An exploratory study using
Jediah R Clark1, David R Large2, Emily Shaw2
1Agents, Interaction and Complexity (AIC) Research Group, Electronics & Computer Science, Building 32, Room 4001, University of Southampton, Southampton, SO17 1BJ, UK.
Abstract:
Onboard virtual assistants with the ability to converse with users are gaining favour in supporting effective human-machine interaction to meet safe standards of operation in automated vehicles (AVs). Previous studies have highlighted the need to communicate situation information to effectively support the transfer of control and responsibility of the driving task. This study explores 'interaction types' used for this complex human-machine transaction, by analysing how situation information is conveyed and reciprocated during a transfer of control scenario. Two human drivers alternated control in a bespoke, dual controlled driving simulator with the transfer of control being entirely reliant on verbal communication. Handover dialogues were coded based on speech-act classifications, and a cluster analysis was conducted. Four interaction types were identified for both virtual assistants (i.e., agent handing over control) - Supervisor, Information Desk, Interrogator and Converser, and drivers (i.e., agent taking control) - Coordinator, Perceiver, Inquirer and Silent Receiver. Each interaction type provides a framework of characteristics that can be used to define driver requirements and implemented in the design of future virtual assistants to support the driver in maintaining and rebuilding timely situation awareness, whilst ensuring a positive user experience. This study also provides additional insight into the role of dialogue turns and takeover time and provides recommendations for future virtual assistant designs in AVs.
Related Concept Videos
Components of Language
Language and Cognition
Fixed Action Patterns
Mass Analyzers: Common Types
Stereotype Content Model
Types of Reports III: Telephone and Verbal Reports
Here's an overview of each type:
Telephone Orders

