Direct observation of family management: validity and reliability as a function of coder ethnicity and training

This study examines the influence of coder ethnicity on the validity and reliability of direct observations of family management. Eight coders, 4 European American (EA) and 4 African American (AA), were randomly assigned to conduct behavior ratings of videotaped family interactions of European American and African American families, under two conditions: untrained and trained. Results indicated statistical differences between EA and AA coder ratings of family management practices across both untrained and trained conditions, suggesting the presence of ethnocentric perceptions of coders. Specifically, EA coders tended to rate AA families as exhibiting poorer family management skills compared with those of EA families. AA coder ratings for EA and for AA families showed no statistical differences. Although not statistically significant, posttraining coding results indicated a trend toward decreased differences among coder perceptions, especially in improving the validity and reliability of EA coder ratings of AA families. These findings are discussed with respect to recommendations for cross-cultural research as well as general theories of ethnic socialization.