From Sour Grapes to Low-Hanging Fruit: A Case Study Demonstrating a Practical Strategy for Natural Language
Stephen B Johnson1, Prakash Adekkanattu2, Thomas R Campion1,2
1Healthcare Policy and Research, Weill Cornell Medicine, New York, New York.
Summary
This study shows that simple Natural Language Processing (NLP) applications, like extracting left ventricular ejection fraction (LVEF), are highly portable and accurate for clinical research. Focusing on practical methods for simpler NLP tasks can yield significant short-term benefits.
Area of Science:
- Clinical Informatics
- Natural Language Processing
- Medical Data Extraction
Background:
- Natural Language Processing (NLP) offers potential for patient care and clinical research.
- A significant gap persists between the promise of NLP and its practical application in healthcare.
- Challenges in NLP system portability across different clinical sites hinder widespread adoption.
Purpose of the Study:
- To investigate a practical strategy for enhancing NLP portability in clinical settings.
- To evaluate the effectiveness of a simple NLP approach for extracting specific clinical data.
- To demonstrate the utility of focusing on "low-hanging fruit" NLP problems.
Main Methods:
- Utilized a tool from the Department of Veterans Affairs (VA) for data extraction.
- Extracted left ventricular ejection fraction (LVEF) values from free-text echocardiograms.
- Applied the NLP tool to the MIMIC-III database for analysis.
Main Results:
- Achieved high performance metrics for LVEF extraction.
- Demonstrated an accuracy of 98.4%, sensitivity of 99.4%, positive predictive value of 98.7%, and F-score of 99.0%.
- The NLP solution proved highly portable and performed excellently.
Conclusions:
- Simple NLP applications can be easier to disseminate and adapt than complex ones.
- Practical, simpler NLP solutions may offer greater utility in the short term.
- This approach highlights the value of "low-hanging fruit" strategies for NLP implementation in healthcare.
Related Concept Videos
01:58Fruit Development, Structure, and Function
25.4K
Fruits form from a mature flower ovary. As seeds develop from the ovules contained within, the ovary wall undergoes a series of complex changes to form fruit. In some fruits, such as soybeans, the ovary wall dries; in other fruits, such as grapes, it remains fleshy. In some cases, organs other than the ovary contribute to fruit formation; such fruits are called accessory fruits.
25.4K
01:16Language
918
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
918
01:32What is Natural Selection?
129.6K
Natural selection is an evolutionary process in which individuals with survival-promoting traits reproduce at higher rates. These favorable traits become more common within a population or species. Naturally selected traits initially arise via random genetic mutations. In order for selection to occur, there must be variation within a population, the trait controlling the variation must be heritable, and there must be an evolutionary advantage for variation in the trait.
129.6K
01:24Components of Language
821
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
821
01:22Language Development
921
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
921
01:27Language and Cognition
804
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
804