Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reasoning01:30

Reasoning

Reasoning is the action of thinking about something in a logical, sensible way. It is integral to problem-solving, decision-making, and critical thinking. Reasoning can be inductive or deductive. Reasoning involves transforming information into conclusions, which is essential for problem-solving, decision-making, and critical thinking.
Inductive reasoning involves deriving generalizations from specific observations. This type of reasoning helps form beliefs about the world. For example,...
Deductive Reasoning01:16

Deductive Reasoning

Deductive reasoning, or deduction, is the type of logic used in hypothesis-based science. In deductive reasoning, the pattern of thinking moves in the opposite direction as compared to inductive reasoning, which means that it uses a general principle or law to predict specific results. From those general principles, a scientist can deduce and predict the specific results that would be valid as long as the general principles are valid.
For example, a researcher can deduce specific predictions...
Inductive Reasoning00:59

Inductive Reasoning

Inductive reasoning is a form of logical thinking that uses related observations to arrive at a general conclusion. It is uncertain and operates in degrees to which the conclusions are credible. As such, inductive arguments can be weak or strong, rather than valid or invalid, and conclusions can be used to formulate testable, falsifiable hypotheses.
Inductive reasoning is common in descriptive science. A life scientist makes observations and records them. This data can be qualitative or...
Reason and Intuition01:37

Reason and Intuition

The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the brain can only use...
Critical Thinking II01:25

Critical Thinking II

Critical thinking is a cognitive process with several attributes. The attributes of critical thinking include the following:
Critical Thinking01:19

Critical Thinking

Critical thinking involves reflective and productive thinking and the evaluation of evidence. Critical thinkers seek to understand the deeper meaning of ideas, question assumptions, and make independent decisions about what to believe or do. Scientists, for instance, are often critical thinkers. Critical thinking also requires humility about what we know and don't know and the motivation to look beyond the obvious. It is essential for effective problem-solving.
Colleges and universities are...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A case-based course teaching integrative taxonomy delimits three new ant species in the <i>Pheidole sexspinosa</i> complex (Hymenoptera, Formicidae) from Vanuatu.

PeerJ·2026
Same author

Multiferroic-Centric Materials and Systems Engineering for Battery Applications: An Insight Into Mechanisms, Strategies, and Characterizations.

Advanced science (Weinheim, Baden-Wurttemberg, Germany)·2026
Same author

Large reasoning models as thinking machines for medicine.

Nature biomedical engineering·2026
Same author

BRIDGE: benchmarking large language models for understanding real-world clinical practice texts.

Nature biomedical engineering·2026
Same author

Towards Conversational AI for Disease Management.

Nature·2026
Same author

Observations from the RESET clinical trial: A post-hoc per protocol analysis of clinical outcomes with percutaneous 60-day medial branch PNS in chronic low back pain.

Interventional pain medicine·2026
Same journal

Re-administration of AAV-mediated gene therapy for OTOF-related deafness: a single-arm trial.

Nature medicine·2026
Same journal

Generative AI-enabled clinical decision support system in primary care: a pragmatic, cluster-randomized trial.

Nature medicine·2026
Same journal

Cliramitug for depletion of cardiac amyloid transthyretin: long-term follow-up of the NI006-101 trial.

Nature medicine·2026
Same journal

Immersive virtual reality with synchronous neurostimulation for upper-limb recovery after stroke: a randomized feasibility trial.

Nature medicine·2026
Same journal

Adaptive brain stimulation 2.0 for Parkinsonian gait.

Nature medicine·2026
Same journal

Evaluating the robustness and readiness of large frontier models in health AI applications.

Nature medicine·2026
See all related articles
  1. Home
  3. Advancing Conversational Diagnostic Ai With Multimodal Reasoning.
  1. Home
  3. Advancing Conversational Diagnostic Ai With Multimodal Reasoning.

Related Experiment Video

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
12:55

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties

Published on: September 27, 2020

Advancing conversational diagnostic AI with multimodal reasoning.

Khaled Saab1, Chunjong Park2, Tim Strother3

  • 1Google DeepMind, London, UK.

Nature Medicine
|May 14, 2026

View abstract on PubMed

Summary
This summary is machine-generated.

A new multimodal AI, Articulate Medical Intelligence Explorer (AMIE), excels in diagnosing patients using text and images. This AI chatbot demonstrated superior diagnostic accuracy and conversational skills compared to primary care physicians in simulated telehealth visits.

More Related Videos

The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients
05:48

The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients

Published on: June 12, 2020

Related Experiment Videos

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
12:55

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties

Published on: September 27, 2020

The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients
05:48

The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients

Published on: June 12, 2020

Area of Science:

  • Artificial Intelligence in Medicine
  • Clinical Decision Support Systems
  • Multimodal Data Analysis

Background:

  • Real-world clinical practice integrates diverse data types, including patient history, medical imagery, and documents.
  • Current large language models (LLMs) for diagnostic dialogue are primarily text-based, limiting their applicability in complex, multimodal clinical scenarios.
  • Evaluating diagnostic AI requires assessing its ability to handle and reason with multimodal information.

Purpose of the Study:

  • To introduce a multimodal extension of the Articulate Medical Intelligence Explorer (multimodal AMIE) capable of processing and reasoning with diverse data types.
  • To develop a state-aware dialogue framework for dynamic history-taking based on diagnostic uncertainty.
  • To evaluate the diagnostic accuracy and conversational quality of multimodal AMIE against primary care physicians in simulated telehealth settings.

Main Methods:

  • Development of a state-aware dialogue framework enabling multimodal data interpretation and reasoning.
  • A randomized, blinded exploratory study involving 105 simulated telehealth consultations.
  • Inclusion of diverse data modalities: dermatology photographs, electrocardiograms, and clinical documents.
  • Evaluation by 18 specialist physicians assessing diagnostic accuracy and conversation quality.

Main Results:

  • Multimodal AMIE outperformed primary care physicians (PCPs) in diagnostic accuracy and conversation quality.
  • The AI system demonstrated superior performance across 29 of 32 evaluation axes.
  • Specifically, multimodal AMIE showed enhanced capabilities in seven of nine metrics assessing multimodal reasoning.
  • The AI exhibited higher scores in history-taking and empathy compared to PCPs.

Conclusions:

  • State-aware reasoning effectively integrates text and visual information for improved diagnostic capabilities.
  • Multimodal AI systems show significant potential to augment clinicians in complex, multimodal diagnostic environments.
  • The findings support the development of AI that can handle the multifaceted nature of modern healthcare delivery.