Assessing the reliability and feasibility of quality indicators used to evaluate long-term care for older adults

Standardized quality indicators for long-term care (QIs-LTC) were previously developed to ensure high-quality holistic nursing care for older adults. This research aimed to assess the feasibility and reliability of unfavorable health outcomes measured by the QIs-LTC and proposed strategies for improvement.

Thirty-nine pairs of home care nurses assessed 53 clients. We evaluated 20 of the 21 items of feasibility to calculate scores for the "I do not know" answer and test the interrater reliability using bias-adjusted and prevalence-adjusted kappa (PABAK). We then conducted interviews with 16 home care nurses to collect feedback on the implementation of QIs-LTC. Based on this feedback, we developed the QIs-LTC assessment manual and reassessed the QIs-LTC when used with the manual.

The mean for the "I do not know" answer was 13.8%, and the mean PABAK was 0.75 (±0.28). Overall, the reliability was good for physical assessment but inadequate for social aspects. Using the assessment manual, the mean for the "I do not know" answers decreased to 10.4%. The mean PABAK was 0.77 (±0.32) and increased for 12 unfavorable health outcomes.

The feasibility and reliability of most unfavorable health outcomes were ensured by using the newly developed assessment manual. Challenges in education and practice of social aspects were identified. QIs-LTC support individual and agency evaluations, nursing interventions and quality evaluations, which are a priority for long-term care in Japan. Geriatr Gerontol Int 2025; 25: 442-448.