Related Experiment Video
Updated: Jul 15, 2025
10:26
Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
4.0K
Contributions to Constructing Forced-Choice Questionnaires Using the Thurstonian IRT Model.
Luning Sun1, Zijie Qin2, Shan Wang2
1The Psychometrics Centre, University of Cambridge.
Multivariate Behavioral Research
|September 30, 2023
Summary
Constructing forced-choice questionnaires requires careful item selection. Matching item desirability and considering factor loadings improves score reliability, especially with unequally keyed items.
Area of Science:
- Psychological Measurement
- Quantitative Psychology
Background:
- Forced-choice questionnaires present items in blocks for ranking to minimize response distortions.
- Block construction requires balancing item desirability and considering item-trait relationships (factor loadings).
Purpose of the Study:
- To provide evidence-based recommendations for constructing optimal forced-choice item blocks.
- To investigate the impact of item desirability and factor loadings on score reliability.
Main Methods:
- Simulations and empirical studies using item pairs were conducted.
- Analysis focused on item desirability, keying direction, and factor loading differences within blocks.
Main Results:
- Maximizing within-block loading differences improves score reliability when items are keyed in the same direction.
- Including a small number of unequally keyed item pairs further enhances reliability.
Conclusions:
- Optimal forced-choice block construction involves matching item desirability and carefully considering factor loadings.
- Strategic inclusion of unequally keyed items can significantly boost the reliability of forced-choice measures.
Related Concept Videos
02:16Surveys
14.8K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.8K
01:27Types of Surveys
63
Surveys are essential for marking property boundaries near water bodies. Different types of surveys are defined, each with its own function. Land surveys mark the property boundaries, while route surveys determine the position of properties on nearby highways. Topographic surveys create maps by capturing the three-dimensional features of the land. Hydrographic surveys focus on the shapes of underwater areas and the movement of streams through the properties. Mine surveys determine the relative...
63
01:16Response Surface Methodology
171
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
The process of RSM involves several key steps:
171
02:01Factorial Design
13.1K
Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
13.1K
02:01Group Design
9.0K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
9.0K
01:14Decision Making: Traditional Method
4.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.0K