Development and validation of a novel AI framework using NLP with LLM integration for relevant clinical data extraction through automated chart review
View abstract on PubMed
Summary
This summary is machine-generated.A new Natural Language Processing (NLP) algorithm combined with a Large Language Model (LLM) automates spinal surgery data extraction from electronic health records (EHRs), significantly improving accuracy and efficiency.
Area Of Science
- Medical Informatics
- Artificial Intelligence in Healthcare
- Spinal Surgery Research
Background
- Manual chart review (MCR) of electronic health records (EHRs) for surgical data extraction is complex, time-consuming, and prone to human error.
- Accurate extraction of spinal surgery data is critical for research, quality improvement, and clinical decision-making.
- Existing methods for data extraction from operative notes are limited by manual effort and potential inaccuracies.
Purpose Of The Study
- To develop and validate a novel Natural Language Processing (NLP) algorithm integrated with a Large Language Model (LLM; GPT4-Turbo).
- To automate the extraction of specific spinal surgery data from EHRs, including surgical type, levels operated, disks removed, and durotomies.
- To assess the efficiency, accuracy, and cost-effectiveness of the automated NLP+LLM approach compared to manual methods.
Main Methods
- A two-stage algorithm was developed: an initial rule-based NLP framework for segment classification, followed by LLM (GPT4-Turbo) verification.
- The algorithm processed operative notes from electronic health records (EHRs).
- Performance was evaluated using accuracy, sensitivity, discrimination, F1-score, and precision on two validation databases, with 95% confidence intervals.
Main Results
- The NLP+LLM algorithm demonstrated superior performance across all key metrics compared to traditional methods.
- Significant improvements in time efficiency and cost reduction were observed.
- High accuracy in extracting detailed spinal surgery data was achieved.
Conclusions
- The integrated NLP+LLM algorithm offers a highly accurate and efficient solution for automated spinal surgery data extraction from EHRs.
- This technology has the potential to overcome limitations of manual chart review, reducing errors and resource burden.
- Widespread adoption of this automated approach could significantly advance spinal surgery research and clinical practice.
Related Concept Videos
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing Clinical Information System (NCIS)
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
Efficient Information Management: NCIS is designed to manage patient information efficiently, making it easily accessible to...
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...

