Surg-STAMPS: Synchronized Temporal Analytics of Motion, Physiology, and Speech in Surgery

Real-time monitoring of team dynamics has great potential to enhance performance and safety in high-stakes collaborative environments such as surgical operating rooms. This work introduces the design of a novel multimodal data-collection system, Surg-STAMPS (synchronized temporal analytics of motion, physiology, and speech in surgery), that integrates cap-mounted motion trackers, sensor-embedded garments, and mask-mounted microphones to record movement, physiological signals, and vocal communication with minimal disruption. A detailed case study of an open right hepatectomy illustrates the platform's ability to capture physiological and behavioral proxies associated with stress, workload, and communication patterns across different clinical roles and procedure phases. Subjective assessments from 30 participants across 15 real surgical procedures highlight high acceptability and practicality, indicating feasibility for widespread adoption. By providing detailed, real-time data that are often difficult to capture in dynamic environments, such systems can inform targeted interventions and improve team efficiency in surgery and other domains such as trauma centers, search-and-rescue, and construction.