Related Experiment Videos
Team signal detection theory: objective team performance measurement using simulation telemetry
Ryan Thomas Villarreal1, Gregory Funke2, Denny Yu1
1Edwardson School of Industrial Engineering, Purdue University, West Lafayette, IN, USA.
Abstract:
Current methods for evaluating team performance rely primarily on simple outcome measures and subjective ratings, which offer limited insight into the decision processes driving performance. This study extends signal detection theory (SDT) to teams, deriving sensitivity (d') and response bias (c) from simulation telemetry. Twenty three-person teams completed five virtual reality tasks varying in interdependence and time pressure while self-reported workload, conventional and SDT metrics, and verbal communication were collected. Team-level sensitivity distinguished conditions that conventional metrics did not. High time pressure reduced sensitivity relative to baseline before task scores declined, suggesting sensitivity may indicate early performance degradation. Response bias became more conservative under combined high interdependence and time pressure, reflecting team strategy shifts. SDT metrics correlated with workload, particularly team-task balancing demands (rs=-0.68 for d'). Together, sensitivity and bias characterise team performance more completely than accuracy alone by separating discriminative ability from decision strategy.