Related Experiment Videos
Can minimally trained observers provide valid global ratings?
1Department of Psychology, State University of New York at Stony Brook, NY, USA. lorber@umn.edu
Summary
Minimally trained (MT) coders' ratings of maternal overreactive discipline are valid and comparable to "gold standard" (GS) trained coders. MT coder ratings show strong validity, supporting their use in research and practice.
Area of Science:
- Psychology
- Child Development
- Parenting Research
Background:
- Assessing maternal overreactive discipline is crucial for understanding child behavior.
- Gold standard (GS) training for coders is resource-intensive.
- Exploring minimally trained (MT) coders offers a cost-effective alternative.
Purpose of the Study:
- To evaluate the validity of minimally trained (MT) coders' ratings of maternal overreactive discipline.
- To compare MT coders' ratings with GS coders' ratings.
- To determine if MT coders' ratings align with other relevant maternal and child factors.
Main Methods:
- Compared ratings from MT coders and GS coders on maternal overreactive discipline.
- Correlated MT coders' ratings with maternal self-reports (discipline, laxness, depressive symptoms) and observed child misbehavior.
- Analyzed convergent, concurrent, and discriminant validity of MT ratings.
Main Results:
- MT and GS coders' ratings were strongly associated (r = .72).
- MT ratings correlated significantly with maternal self-reports and observed child misbehavior (rs ranging from .32 to .46).
- MT ratings showed similar validity magnitudes to GS ratings, with stronger association to GS ratings than child misbehavior.
Conclusions:
- Minimally trained coders demonstrate reliable and valid ratings for maternal overreactive discipline.
- MT coders provide a cost-effective and valid alternative to GS coders.
- Findings support the use of MT coders in research contexts, enhancing efficiency without compromising data quality.