Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Therapeutic Communication01:30

Therapeutic Communication

10.1K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
10.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Patient-Driven Care in Psychedelic Therapy.

The New England journal of medicine·2026
Same author

Posttraumatic Stress Disorder Treatment Decision Aid: User-Centered Design Update Approach.

JMIR formative research·2026
Same author

The Ethnopharmacological Use of Mescaline for Psychiatric Disorders: A Systematic Review.

International journal of molecular sciences·2026
Same author

Clozapine Monitoring: Form Follows Function.

Psychiatric services (Washington, D.C.)·2026
Same author

Shared Decision Making Interventions for Parents of Children on the Autism Spectrum: A Systematic and Scoping Review.

Community mental health journal·2026
Same author

A Mixed Methods Study of Program-Level Factors Influencing Patient and Family Engagement in First Episode Psychosis Coordinated Specialty Care.

medRxiv : the preprint server for health sciences·2026
Same journal

Knowledge, Attitudes, and Practices Related to AI in Learning and Research Among Medical Students in Vietnam: Cross-Sectional Study.

JMIR formative research·2026
Same journal

Access to an mHealth Tool for Symptom Management in Pediatric Oncology Care: Triangulation Study.

JMIR formative research·2026
Same journal

Agreement Between Reasoning-Oriented Generative AI Models and Clinical Educators in Evaluating Japanese Objective Structured Clinical Examination Transcripts: Preliminary Comparative Study.

JMIR formative research·2026
Same journal

Automated Optic Disc Tilt Classification in Fundus Photographs Using Segmentation and the Elliptical Ratio: External Clinical Validation Study.

JMIR formative research·2026
Same journal

Effects of Virtual Reality on Postoperative Pain Management Following Minimally Invasive Gynecologic Surgery: Randomized Controlled Trial.

JMIR formative research·2026
Same journal

Prediction of Clinically Significant Depressive Symptoms at 2-Year Follow-Up in Older Adults: Machine Learning Study Using the English Longitudinal Study of Ageing.

JMIR formative research·2026
See all related articles

Related Experiment Video

Updated: Mar 14, 2026

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models
07:14

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Published on: December 23, 2025

454

Machine Learning-Based Audiovisual Phenotyping for Measuring Communication, Shared Decision-Making, and Trust.

Shely Khaikin1, Vineet Tiruvadi2,3, Jeffrey Brooks3

  • 1Shared Decision Making Laboratory, Temple University, Philadelphia, PA, United States.

JMIR Formative Research
|March 13, 2026
PubMed
Summary
This summary is machine-generated.

Machine learning analyzes audiovisual data to detect differences between patient reports and nonverbal cues. This technology offers objective communication assessment and promotes health equity.

Keywords:
AIartificial intelligenceaudiovisual digital phenotypingdepressionnatural language processingprimary careshared decision-making

More Related Videos

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

2.1K
Automated Interactive Video Playback for Studies of Animal Communication
07:21

Automated Interactive Video Playback for Studies of Animal Communication

Published on: February 9, 2011

14.1K

Related Experiment Videos

Last Updated: Mar 14, 2026

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models
07:14

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Published on: December 23, 2025

454
Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

2.1K
Automated Interactive Video Playback for Studies of Animal Communication
07:21

Automated Interactive Video Playback for Studies of Animal Communication

Published on: February 9, 2011

14.1K

Area of Science:

  • Computational linguistics
  • Health informatics
  • Biomedical engineering

Background:

  • Effective patient-provider communication is crucial for accurate diagnosis and treatment.
  • Subjective patient self-reports may not always align with objective clinical observations.
  • Nonverbal communication provides valuable insights into a patient's experience.

Purpose of the Study:

  • To investigate the utility of machine learning-based audiovisual phenotyping.
  • To identify discrepancies between patients' self-reported experiences and their nonverbal expressions.
  • To explore the potential for objective assessment of communication quality and advancement of health equity.

Main Methods:

  • Development and application of machine learning algorithms to analyze audiovisual data.
  • Comparison of patient self-reported data with nonverbal cues captured through video and audio recordings.
  • Statistical analysis to quantify discrepancies and assess communication quality.

Main Results:

  • Machine learning models successfully identified significant discrepancies between patient self-reports and nonverbal expressions.
  • Audiovisual phenotyping provided objective measures of communication quality.
  • The approach demonstrated potential for identifying communication barriers impacting health equity.

Conclusions:

  • Machine learning-based audiovisual phenotyping is a promising tool for objective communication assessment.
  • This technology can reveal subtle patient experiences missed by traditional methods.
  • Advancing health equity through more accurate and equitable patient communication assessment is feasible.