Related Experiment Video
Updated: Aug 11, 2026

Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 23, 2014
Reliability and validity of observer ratings of neighborhoods
Elena M Andresen1, Theodore K Malmstrom, Douglas K Miller
1Rehabilitation Outcomes Research Center (RORC), North Florida/South Georgia VHS, Gainesville, FL, College of Public Health and Health Professions, University of Florida, P.O. Box 10082, Gainesville, Florida 32610-0182, USA. eandresen@phhp.ufl.edu
Objectives:
The objectives were to examine the validity and reliability of a five-item neighborhood measurement scale.
Methods:
Respondents were enrolled from two catchment areas: a poor inner city and a heterogeneous suburban area. Items combine for a total score of 5 (best) to 20 (worst). The authors compared scales across catchment areas and respondent ratings and assessed interviewer effects and retest reliability.
Results:
Suburban neighborhood scale scores were 3 points lower (higher socioeconomic status, SES) than the inner-city scores. There was a strong relationship between scores and participants' neighborhood ratings. The retest correlation was substantial (.81), but only two of five items achieved kappas above .75. In regression models, interviewer experience and residence and individual interviewers contributed to different ratings, although there was still a marked difference between catchment areas.
Discussion:
Observer ratings of neighborhoods show promise as a measure of neighborhood SES, despite problems with interviewer effects. Future work should improve objective criteria for ratings.
Related Concept Videos
Reliability and Validity
Naturalistic Observations
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...
Surveys
Actor-Observer Effect
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...