Related Experiment Video
Updated: Mar 8, 2026

Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
Published on: June 6, 2020
Improving Evidence-Based Practice Through the Development and Validation of Key Words to Identify Intervention
Sonia Islam Nisha1, Qingyun Wang2, Charles Yu2
1Department of Communicative Disorders and Sciences, University at Buffalo, NY.
Purpose:
Although evidence-based practice (EBP) promotes better clinical practice, implementing it in speech-language pathology is challenging. A limited number of intervention studies and inconsistent use of key words in abstracts complicates the implementation of EBP. Given time constraints in clinical practice, identifying relevant research from study abstracts would provide an efficient method for identifying intervention studies. In this project, we compare the classification accuracy of an artificial intelligence (AI)-created set of key words and a set of evidence-based key words that were developed through an analysis of commonly used words in intervention abstracts from American Speech-Language-Hearing Association (ASHA) journals.
Method:
Abstracts from three major ASHA journals were crawled using Selenium and WebDriver Manager, creating a large database of abstracts for analysis. In Study 1, a random sample of 180 abstracts was annotated as reporting on intervention or nonintervention studies to develop a set of evidence-based key words. In Study 2, classification accuracy was calculated to validate these key words by comparing them with a set of AI-generated (ChatGPT-4.0) key words.
Results:
The results suggested that 12%-15% of studies report on an intervention study. Evidence-based key words had higher sensitivity (85%) and a higher positive predictive value (27%) but a lower specificity rate (67%). Also, the likelihood ratio suggested that evidence-based key words had a moderate capacity to identify nonintervention studies (true negatives) accurately.
Conclusions:
Evidence-based key words have the potential to accurately classify intervention studies, addressing a key barrier to EBP implementation in clinical practice. Future research should focus on refining key words by integrating AI and promoting standardized journal reporting by incorporating uniform key words in abstracts.
More Related Videos
Related Concept Videos
Nursing Interventions II: Selecting and Classifying the Nursing Interventions
Therapeutic Communication
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
Role of Communication in the Nursing Process I: Assessment and Diagnosis
The nursing process considers the patient's emotional and physical well-being. The process can be repeated or stopped at any point if judged essential. Assessment is the first step in the nursing...
Autism Spectrum Disorder
These core symptoms manifest differently among individuals, ranging from mild to severe. The disorder's complexity extends beyond its clinical presentation, encompassing a diverse range of biological, cognitive, and sociocultural influences.
Role of Communication in the Nursing Process III: Evaluation and Documentation
Operant Conditioning Intervention
In operant conditioning, behaviors that are...

