Related Experiment Video
Updated: Feb 10, 2026
10:39
Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
1.2K
Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis
Stefanie A Wind1, George Engelhard2
1The University of Alabama, Tuscaloosa, AL, USA.
Educational and Psychological Measurement
|May 26, 2018
Summary
Mokken scale analysis offers new tools to evaluate rater-mediated assessments. This study introduces indices for rater monotonicity, scalability, and invariant ordering, enhancing measurement quality diagnostics.
Area of Science:
- Social Sciences
- Psychometrics
- Educational Measurement
Background:
- Mokken scale analysis is a probabilistic, nonparametric method for assessing measurement quality.
- It evaluates properties like invariance without rigid data structure assumptions.
- Rater-mediated assessments present complex interactions, making their scores suitable for Mokken scaling.
Purpose of the Study:
- To present indices for evaluating the psychometric quality of rater-mediated assessment data.
- To demonstrate the interpretation of Mokken scale statistics within this context.
- To focus on individual rater interpretation for measurement invariance.
Main Methods:
- Adapted polytomous Mokken scaling techniques for rater-mediated assessments.
- Developed indices for rater monotonicity, rater scalability, and invariant rater ordering.
- Focused on substantive interpretation of Mokken-based statistics and graphical displays.
Main Results:
- Mokken scaling indices provide diagnostic information at the individual rater level.
- Findings support the use of these indices for assessing requirements of invariant measurement.
- Indices indicate rater monotonicity, scalability, and consistent ordering.
Conclusions:
- Mokken-based indices offer valuable diagnostic tools for rater-mediated assessments.
- These tools supplement existing parametric models for rating quality assessment.
- The approach enhances understanding of measurement quality and rater performance.
Related Concept Videos
01:20Assessment of Ventilation I: Respiratory Rate
2.2K
Assessment of Ventilation
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
2.2K
02:41pH Scale
80.2K
Hydronium and hydroxide ions are present both in pure water and in all aqueous solutions, and their concentrations are inversely proportional as determined by the ion product of water (Kw). The concentrations of these ions in a solution are often critical determinants of the solution’s properties and the chemical behaviors of its other solutes. Two different solutions can differ in their hydronium or hydroxide ion concentrations by a million, billion, or even trillion times. A common means of...
80.2K
02:53Reaction Rate
64.6K
The rate of reaction is the change in the amount of a reactant or product per unit time. Reaction rates are therefore determined by measuring the time dependence of some property that can be related to reactant or product amounts. Rates of reactions that consume or produce gaseous substances, for example, are conveniently determined by measuring changes in volume or pressure.
The mathematical representation of the change in the concentration of reactants and products, over time, is the rate...
The mathematical representation of the change in the concentration of reactants and products, over time, is the rate...
64.6K
01:26Scaling
596
In designing and analyzing filters, resonant circuits, or circuit analysis at large, working with standard element values like 1 ohm, 1 henry, or 1 farad can be convenient before scaling these values to more realistic figures. This approach is widely utilized by not employing realistic element values in numerous examples and problems; it simplifies mastering circuit analysis through convenient component values. The complexity of calculations is thereby reduced, with the understanding that...
596
01:05Quality Control
2.8K
Quality control is one of the three cyclical quality assurance activities that help keep a system under statistical control. Typical quality control activities include creating quality control charts, conducting proficiency testing, and documenting and archiving results.
Quality control helps track data, visualize trends, and identify variations, making it easier to detect deviations that may affect the accuracy of an analysis. One way to do this is by generating a quality control chart, which...
Quality control helps track data, visualize trends, and identify variations, making it easier to detect deviations that may affect the accuracy of an analysis. One way to do this is by generating a quality control chart, which...
2.8K
01:19Quality Assurance
2.5K
Quality assurance is the overarching term used to describe the activities employed to ensure the proper performance of a system. These activities can be classified into three categories: quality control, quality assessment, and internal corrective measures. Typically, these activities work cyclically: quality control is performed before and during the analysis, while quality assessment occurs during and after the investigation. Internal corrective measures are implemented based on the findings...
2.5K