Related Experiment Videos
Proxies and other external raters: methodological considerations
A Lynn Snow1, Karon F Cook, Pay-Shin Lin
1Houston Center for Quality Care and Utilization Studies, Michael E. DeBakey Veterans Affairs Medical Center, Houston, TX 77030, USA.
Objective:
The purpose of this paper is to introduce researchers to the measurement and subsequent analysis considerations involved when using externally rated data. We will define and describe two categories of externally rated data, recommend methodological approaches for analyzing and interpreting data in these two categories, and explore factors affecting agreement between self-rated and externally rated reports. We conclude with a discussion of needs for future research.
Data Sources/Study Setting:
Data sources for this paper are previous published studies and reviews comparing self-rated with externally rated data.
Study Design/Data Collection/Extraction Methods:
This is a psychometric conceptual paper.
Principal Findings:
We define two types of externally rated data: proxy data and other-rated data. Proxy data refer to those collected from someone who speaks for a patient who cannot, will not, or is unavailable to speak for him or herself, whereas we use the term other-rater data to refer to situations in which the researcher collects ratings from a person other than the patient to gain multiple perspectives on the assessed construct. These two types of data differ in the way the measurement model is defined, the definition of the gold standard against which the measurements are validated, the analysis strategies appropriately used, and how the analyses are interpreted. There are many factors affecting the discrepancies between self- and external ratings, including characteristics of the patient, the proxy, and of the rated construct. Several psychological theories can be helpful in predicting such discrepancies.
Conclusions:
Externally rated data have an important place in health services research, but use of such data requires careful consideration of the nature of the data and how it will be analyzed and interpreted.
Related Concept Videos
Naturalistic Observations
Surveys
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Theory of Attribution II: Kelley's Covariation Theory
Fundamental Attribution Error
Stereotype Content Model