Do Evaluations Rise With Experience?

Area of Science:

• Decision Science
• Social Psychology
• Behavioral Economics

Background:

• Sequential evaluation, where the same raters assess multiple items, is common in various fields.
• Fairness in evaluation relies on consistent application of criteria.
• Potential biases in sequential evaluation are not fully understood.

Purpose of the Study:

• To investigate whether evaluations become more positive when conducted later in a sequence.
• To identify the psychological mechanisms underlying this sequential evaluation bias.
• To assess the broad implications of this bias in real-world decision-making.

Main Methods:

• Analysis of real-world evaluation data (dance competitions, academic grading).
• Experimental manipulation of evaluation order for short stories.
• Mediation analysis to explore the role of decision-making fluency.

Main Results:

• Ratings consistently increased across sequences in real-world examples.
• Experimental evaluations of short stories became more positive over time.
• Increased decision-making fluency mediated the effect, leading to more positive judgments.

Conclusions:

• A sequential evaluation bias exists, where later evaluations are more positive.
• This bias is linked to increased processing fluency from repeated evaluation.
• The findings have significant implications for fairness in various evaluative contexts.