Related Experiment Video
Updated: Jun 19, 2026
13:12
Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping
Published on: August 12, 2019
An intelligent listening framework for capturing encounter notes from a doctor-patient dialog
Jeffrey G Klann1, Peter Szolovits
1Medical Informatics, Regenstrief Institute, Indianapolis, IN 46202, USA. jklann@regenstrief.org
BMC Medical Informatics and Decision Making
|November 7, 2009
Summary
This study explores using automated speech recognition (ASR) and natural language processing to capture structured clinical data from doctor-patient conversations, aiming for an evolving, editable encounter note.
Area of Science:
- Medical Informatics
- Clinical Natural Language Processing
- Speech Recognition Technology
Background:
- Accurate, machine-interpretable clinical data capture is vital for medical integrity.
- Current methods face challenges in real-time data acquisition.
- Technology offers a potential solution for structured data extraction from clinical encounters.
Purpose of the Study:
- To investigate the use of automated speech recognition (ASR) and clinical text analysis for capturing structured data.
- To develop a system for real-time, evolving, and editable clinical encounter notes.
- To explore the feasibility of integrating speech technology into medical documentation.
Main Methods:
- Developed a proof-of-concept system combining ASR with clinical meaning extraction.
- Designed a more comprehensive system for speech capture, transcription, and storage in an XML-based format.
- Utilized a text-engineering framework for processing narrative medical text.
Main Results:
- The proof-of-concept system demonstrated accurate phrase categorization from uncorrected ASR output.
- The comprehensive system captures and transcribes speech, storing interpretations.
- Initial results were encouraging, despite preliminary stages and some false positives.
Conclusions:
- The goal of automated clinical data capture is deemed reachable.
- Future work includes corpus acquisition, microphone setup research, UI development, and multi-speaker tools.
- Further development is needed to fully integrate language processing into the comprehensive system.
Related Concept Videos
01:23Techniques of Therapeutic Communication II: Focusing, Paraphrasing, and Summarizing
Focusing involves centering a conversation on a message's critical elements or concepts. Focusing is valuable if the talk is vague or patients begin to repeat themselves. Sometimes, when patients are asked about their symptoms, they may go off-topic and try to tell their entire life story. Respectfully, the nurse should bring the conversation back into focus.
This therapeutic technique can also be used when a patient brings up pertinent information during a health-related conversation. The...
This therapeutic technique can also be used when a patient brings up pertinent information during a health-related conversation. The...
01:15Techniques of therapeutic communication I: Active Listening, Sharing Observations, Validation, and Using Touch
The history of therapeutic communication can be traced back to Florence Nightingale, who emphasized the importance of developing trusting relationships with patients. She taught that the presence of nurses with patients results in therapeutic healing.
Therapeutic communication is not the same as social interaction. Social interaction has no goal or purpose and consists of casual information sharing, whereas therapeutic communication has a plan or purpose for the conversation. Therapeutic...
Therapeutic communication is not the same as social interaction. Social interaction has no goal or purpose and consists of casual information sharing, whereas therapeutic communication has a plan or purpose for the conversation. Therapeutic...
01:26Methods of Documentation IV: Focus Charting
Focus Charting, also known as the focus charting system or "focus documentation," is a systematic documentation approach used in healthcare to organize patient information in medical records.
It typically involves three columns for recording information:
It typically involves three columns for recording information:
01:21Methods of Documentation III: PIE
Problem-intervention-evaluation (PIE) is a systematic approach to documentation used in healthcare settings for clinical decision-making and patient care planning. It is a structured approach to organizing patient data based on problems, interventions, and evaluations. Here's a breakdown of its key features and considerations:
01:28Formats for Nursing Documentation
Nursing documentation encompasses various formats designed to capture precise patient data, facilitate communication among healthcare team members, and ensure comprehensive and accurate patient records. Let's explore each of these formats in detail:
Nursing Assessment Form:
• A nursing assessment form is a foundational document that captures detailed patient data from physical assessments and nursing histories.
• It includes patient demographics, medical history, current medications, vital...
Nursing Assessment Form:
• A nursing assessment form is a foundational document that captures detailed patient data from physical assessments and nursing histories.
• It includes patient demographics, medical history, current medications, vital...
01:13Patient-centered Care
Patient-centered care involves delivering care beyond inpatient hospitalization. Reflective practice can enhance a patient-centered approach. Reflective practice is a process of reasoning that considers all aspects of the present situation, including practicalities, learning from personal practice, and consideration of patient needs. Patients appreciate care decisions made while considering their input. Involving the patient in their care provides the patient with a sense of contribution rather...