Related Experiment Videos
Judging Relative Importance: Direct Rating and Point Allocation Are Not Equivalent
Organizational Behavior and Human Decision Processes
|April 1, 1997
Summary
Directly rating attributes versus allocating points yields different decision weights. Both methods show bias, as predicted by an idealized weighting model.
Area of Science:
- Decision Science
- Cognitive Psychology
- Behavioral Economics
Background:
- Understanding how individuals perceive attribute importance is crucial for decision-making.
- Common methods include direct rating and point allocation for assigning decision weights.
Purpose of the Study:
- To compare decision weights derived from direct rating versus point allocation methods.
- To investigate elicitation-dependent biases in these weighting procedures.
Main Methods:
- Participants directly rated the importance of attributes.
- Participants allocated a fixed budget of points to attributes (Point Allocation - PA).
- Comparison of decision weight profiles generated by both methods.
Main Results:
- Direct rating and point allocation produced significantly different decision weight profiles.
- Both methods exhibited consistent, elicitation-dependent biases.
- Observed differences align with predictions from an idealized weighting model.
Conclusions:
- The method used to elicit decision weights significantly impacts perceived attribute importance.
- Awareness of elicitation-dependent bias is critical for accurate decision analysis.
- An idealized model effectively predicts biases in weighting procedures.