Observing home-visiting quality at scale with the home visit rating scales and a supervisor checklist in Peru

As home-visiting programs expand, there is a need to develop cost-effective tools to monitor their quality at scale. We compare the Home Visit Rating Scales (HOVRS), an instrument to measure home-visit process quality widely used in the United States, to a checklist designed for the Peruvian national home-visiting program, Cuna Mas. Both instruments were administered to a sample of 554 home visits and an equal number of mother-child dyads by their 176 home visitors. While the HOVRS was scored on video recordings of the visits by trained coders, the checklist was scored live by Cuna Mas supervisors. We assessed the validity of both measures in their first application in rural Peru, compared their performance, and selected a subset of items in the checklist to propose a simplified, shorter, and more cost-efficient instrument. To this end, we reorganized checklist items into constructs that best mapped those covered by the HOVRS and selected the highest performing according to predefined criteria. We found that both the HOVRS and the checklist had high reliability and acceptable levels of validity. We argue that the simplified checklist could prove useful for quality monitoring of service delivery of at-scale home-visiting programs and as a tool to support in-service training.