When raters disagree, then what: examining a third-rating discrepancy resolution procedure and its utility for

Carol M Myford1, Edward W Wolfe

  • 1Department of Educational Psychology, University of Illinois at Chicago, 1040 W. Harrison Street, M/C 147, Chicago, IL 60607, USA.

Journal of Applied Measurement
|July 31, 2002
PubMed

Related Concept Videos

Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures from...
Kendall's Coefficient of Concordance01:20

Kendall's Coefficient of Concordance

Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects or...
Causes of Similarity-Dissimilarity Effect01:26

Causes of Similarity-Dissimilarity Effect

The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...
Self-Discrepancy and Its Effects01:29

Self-Discrepancy and Its Effects

Self-discrepancy theory explains how people compare their actual self to their ideal and ought selves and how mismatches between these self-guides can lead to emotional distress. Developed by E. Tory Higgins, the theory distinguishes among three components of self-concept: the actual self, the ideal self, and the ought self. These refer respectively to how individuals perceive themselves, how they aspire to be, and how they believe they are obligated to be. Emotional well-being, self-esteem,...
Ratio Level of Measurement00:54

Ratio Level of Measurement

The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated. For...
Interpreting R Charts01:22

Interpreting R Charts

R chart, or range chart, is a fundamental tool in statistical process control used to monitor the variability within a process. It complements the X-bar (x̄) chart by focusing on the range of the data, rather than individual values, providing a clear picture of the process dispersion over time.
An R chart plots the range of subsets of measurements collected from a process. Each point on the chart represents the range—defined as the difference between the maximum and minimum values—of a sample...