Related Experiment Video
Updated: Jan 7, 2026
A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts
Published on: September 20, 2018
Clinical Manifestations
Dylan Hruskar1, Daniel Z Press1
1Beth Israel Deaconess Medical Center, Boston, MA, USA.
Background:
Mild cognitive impairment (MCI), an early sign of Alzheimer's Disease (AD), involves disruptions in both memory and cognition. Early and accurate detection of MCI is critical, as recently FDA approved disease modifying treatments are most effective at this stage of AD. The most commonly used screening tests for MCI are the Montreal Cognitive Assessment (MoCA) and the Mini-Mental Status Examination (MMSE). However, these tests are time consuming, and item level analysis has not been conducted to see whether the components of these tests are sufficiently accurate in detecting MCI. This study aims to analyze the accuracy and actual contribution of individual items on the MoCA and the MMSE in MCI detection.
Methods:
Using the National Alzheimer's Coordinating Center's (NACC) data repository, our team conducted item level analysis of the MoCA and MMSE given to MCI as well as cognitively normal (CN) participants. We used area under the receiver operating characteristic curves (AUC-ROC) to analyze the accuracy of these tests. This method enabled us to determine the overall accuracy in terms of MCI detection of the tests as well as the individual contribution of each item on the test.
Results:
The overall MoCA AUC-ROC was 0.81 while the MMSE AUC-ROC was 0.76, which shows that both tests are moderately accurate. Item level analysis of the tests revealed that only a small subset of components effectively contributes to MCI detection. We found that a six-item combination of memory recall and orientation testing components contributes to over 98% of full test accuracy.
Conclusion:
In this study, we found that the MoCA and the MMSE have moderate efficacy in detecting MCI, and that only a subset of items from each test are the large contributors of MCI detection. Our analysis shows that the number of items on these tests could be substantially reduced which would lower time of test administration without loss of MCI detection effectiveness. There are opportunities for MCI screening test optimization, and further investigation is needed to determine the best possible combination of test items that would yield the highest detection accuracy in the lowest amount of time.
Insights
Detecting mild cognitive impairment (MCI) early is crucial for Alzheimer's Disease (AD) treatment. This study found that a few key memory and orientation items on the MoCA and MMSE tests significantly contribute to MCI detection, suggesting potential for shorter, more efficient screening.
Area of Science:
- Neurology
- Gerontology
- Cognitive Science
Background:
- Mild cognitive impairment (MCI) is an early indicator of Alzheimer's Disease (AD), impacting memory and cognition.
- Timely MCI detection is vital for the efficacy of newly approved disease-modifying treatments.
- Current screening tools like MoCA and MMSE are time-consuming, and their individual item accuracy for MCI detection is not well-established.
Purpose of the Study:
- To conduct an item-level analysis of the MoCA and MMSE to determine their accuracy in detecting MCI.
- To identify the specific test components that contribute most significantly to MCI detection.
- To explore opportunities for optimizing MCI screening tests for improved efficiency and effectiveness.
Main Methods:
- Utilized the National Alzheimer's Coordinating Center (NACC) data repository for analysis.
- Performed item-level analysis on MoCA and MMSE data from MCI and cognitively normal participants.
- Employed Area Under the Receiver Operating Characteristic Curves (AUC-ROC) to assess test and item accuracy.
Main Results:
- Overall MoCA AUC-ROC was 0.81 and MMSE AUC-ROC was 0.76, indicating moderate accuracy for both tests.
- Item-level analysis revealed that only a subset of test components are effective in MCI detection.
- A six-item combination focusing on memory recall and orientation accounted for over 98% of the full tests' accuracy.
Conclusions:
- The MoCA and MMSE demonstrate moderate efficacy in MCI detection, with specific items being the primary drivers of accuracy.
- Significant reduction in the number of test items is feasible without compromising MCI detection effectiveness, leading to reduced administration time.
- Further research is warranted to identify optimal item combinations for maximizing MCI detection accuracy and minimizing testing duration.
Related Concept Videos
01:24Chronic Kidney Disease II: Clinical Manifestations
01:30Coronary Artery Disease III: Clinical Manifestations
01:25Endocarditis II: Clinical Features of Infective Endocarditis
01:26Heart Failure III: Clinical Manifestations
01:29Gastroesophageal Reflux Disease II: Clinical Features and Management
Clinical Manifestations
GERD presents itself in a multitude of ways, with symptoms varying from person to person. The hallmark symptoms are...
01:30Hypertension III: Clinical Manifestations and Diagnostic Studies