Related Experiment Video
Updated: Aug 7, 2026

12:18
A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
Published on: January 11, 2020
The reliability of the McCarthy Screening Test from the criterion-referenced testing perspective
Journal of Clinical Psychology
|May 1, 1984
Summary
The McCarthy Screening Test
Area of Science:
- Child Psychology
- Educational Psychology
- Psychometrics
Background:
- The McCarthy Screening Test (MST) is utilized to identify children with learning difficulties.
- Each subtest of the MST provides a pass-fail decision.
- Assessing the reliability of these decisions is crucial for accurate identification.
Purpose of the Study:
- To evaluate the reliability of pass-fail decisions from the McCarthy Screening Test (MST).
- To explore the application of criterion-referenced testing methods for assessing MST reliability.
- To determine the suitability of dependability indices for clinical instruments.
Main Methods:
- Utilized criterion-referenced testing methods.
- Analyzed data from a sample of 1,323 children.
- Evaluated the reliability of pass-fail decisions for MST subtests.
Main Results:
- The study evaluated several results concerning the reliability of MST decisions.
- Findings provide insights into the dependability of the screening test.
- Specific results indicate areas for potential improvement in reliability assessment.
Conclusions:
- The reliability of McCarthy Screening Test (MST) decisions warrants careful consideration.
- Criterion-referenced methods offer valuable approaches to assessing clinical instrument dependability.
- Adoption of dependability indices is recommended for clinical instruments like the MST.
Related Concept Videos
Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Multiple Comparison Tests
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Receiver Operating Characteristic Plot
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
Self-Report Tests of Personality
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
Cochran's Q Test
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square distribution,...
McNemar's Test
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...

