Team assessment utilizing a many-facet Rasch model

Area of Science:

• Organizational Psychology
• Psychometrics

Background:

• Organizations are increasingly adopting team-based work structures.
• Traditional individual performance assessments are transitioning to team-based strategies.
• Team assessment necessitates multiple raters and criteria, introducing potential rater bias.

Purpose of the Study:

• To analyze statistical differences in team performance ratings.
• To investigate rater leniency and severity in team assessments.
• To evaluate the application of the many-facet Rasch model in team performance evaluation.

Main Methods:

• Analysis of ratings for individual members across 31 teams.
• Evaluation of performance based on 12 distinct criteria.
• Application of the many-facet Rasch model for statistical analysis.

Main Results:

• Identified statistically significant differences between teams in performance ratings.
• Quantified variations in ratings attributed to individual rater leniency or severity.
• Demonstrated the utility of the many-facet Rasch model in dissecting rater effects.

Conclusions:

• Team performance assessment requires robust methods to account for rater variability.
• The many-facet Rasch model provides a valuable framework for analyzing complex team rating data.
• Findings inform the development of fairer and more accurate team compensation strategies.