Related Experiment Video
Updated: Aug 9, 2026
08:13
Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects
Published on: May 10, 2019
Rasch analysis of rank-ordered data
1University of Sydney, Australia. john@winsteps.com
Journal of Applied Measurement
|December 31, 2005
Summary
This study compares methods for creating linear measures from ranked data, using professional golf tournament results. The partial-credit method proved more effective and easier to implement than paired comparison approaches for ranking golfers.
Area of Science:
- Sport Science
- Psychometrics
- Statistical Modeling
Background:
- Rank-ordered data is common in sports and performance evaluations.
- Existing methods for deriving linear measures from rankings have limitations.
- Professional golf tournaments provide complex, partial-ranked datasets.
Purpose of the Study:
- To present and compare methods for constructing linear measures from rank-ordered data.
- To evaluate the efficacy of different ranking construction techniques.
- To identify the most practical and valid method for analyzing tournament performance data.
Main Methods:
- Decomposition of rankings into paired comparisons (independent/dependent, with/without ties).
- Modeling tournaments as partial-credit items using rating scale analysis.
- Application of statistical software (FACETS, WINSTEPS) for implementation.
Main Results:
- The partial-credit method demonstrated greater face validity compared to paired comparison methods.
- The partial-credit approach was found to be easier to implement.
- Analysis of 356 professional golfers across 47 stroke-play tournaments.
Conclusions:
- The partial-credit method offers a more valid and practical approach for deriving linear measures from complex, partial-ranked sports data.
- This method enhances the interpretability of performance rankings.
- Statistical software facilitates the application of these psychometric techniques.
Related Concept Videos
00:55Ordinal Level of Measurement
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks in the...
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks in the...
01:20Spearman's Rank Correlation Test
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates correlation by...
Spearman's test calculates correlation by...
01:17Wald-Wolfowitz Runs Test I
The Wald-Wolfowitz test, also known as the runs test, is a nonparametric statistical test used to assess the randomness of a sequence of two different types of elements (e.g., positive/negative values, successes/failures). It examines whether the order of the elements in a sequence is random or if there is a pattern or trend present. This nonparametric test applies to any ordered data despite the population and sample data distribution, even if a higher sample size is available.
The test works...
The test works...
01:02Ranks
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
01:21Wilcoxon Rank-Sum Test
The Wilcoxon rank-sum test, also known as the Mann-Whitney U test, is a nonparametric test used to determine if there is a significant difference between the distributions of two independent samples. This test is designed specifically for two independent populations and has the following key requirements:
01:21Friedman Two-way Analysis of Variance by Ranks
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures from...