Related Experiment Video
Updated: Aug 15, 2026
10:32
Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 24, 2014
The validity of subscores for a credentialing test
Thomas M Haladyna1, Gene A Kramer
1Arizona State University West, USA.
Evaluation & the Health Professions
|October 20, 2004
Summary
Subscores from health profession credentialing tests offer valuable performance insights for candidates and institutions. Systematic validation ensures the accurate interpretation and use of these subscores for improved training and remedial studies.
Area of Science:
- Health Professions Education
- Psychometrics
- Educational Measurement
Background:
- High-stakes tests in health professions yield subscores beneficial for candidate remediation and institutional training evaluation.
- The interpretation and use of these subscores rely on validation, a process combining reasoning and empirical analysis.
Purpose of the Study:
- To describe the reasoning process for validating subscore interpretations and uses.
- To demonstrate that the validity of subscore interpretation and use can be systematically studied for large credentialing tests.
- To propose principles and procedures for enhancing subscore validation by testing program personnel.
Main Methods:
- The study outlines a reasoning process for validation.
- It emphasizes the systematic study of validity evidence for subscore interpretation and use.
- Proposed procedures aid testing program personnel in validating subscore applications.
Main Results:
- The validity of any subscore interpretation or use can and should be studied systematically for large credentialing tests.
- Establishing validity evidence is crucial for reporting and utilizing subscores.
- Principles and procedures for subscore validation are presented.
Conclusions:
- Subscores from health profession credentialing tests are valuable for performance profiling.
- Systematic validation is essential to ensure the accurate interpretation and application of subscores.
- The study provides a framework and practical procedures for improving subscore validation practices.
Related Concept Videos
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
01:03Data Validation
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
01:16Critical Region, Critical Values and Significance Level
The critical region, critical value, and significance level are interdependent concepts crucial in hypothesis testing.
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the test...
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the test...
01:20Spearman's Rank Correlation Test
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates correlation by...
Spearman's test calculates correlation by...
01:29Measures of Intelligence
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
01:29Theory of Attribution II: Kelley's Covariation Theory
Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus: Comparing...