Assessment of Trained Hand Hygiene Observers Using Parallel Observations

Area of Science:

• Healthcare Quality Improvement
• Infection Prevention and Control
• Clinical Observation Training

Background:

• Effective hand hygiene (HH) monitoring is crucial for preventing healthcare-associated infections.
• Standardized training and validation of HH observers are recommended to ensure reliable data collection.
• Assessing the concordance among trained observers is essential for the quality of HH surveillance programs.

Purpose of the Study:

• To validate hand hygiene (HH) observers after a comprehensive training program.
• To determine the level of agreement and concordance between trained HH observers using the Kappa index.
• To support the recommendation for improving HH monitoring through validated observers.

Main Methods:

• A cohort of HH observers from 15 hospital units underwent an eight-hour training program, including a two-hour workshop.
• Parallel observations were conducted by trained nurses on their respective units following the training.
• Data from 789 parallel observations were analyzed to calculate agreement percentages and Kappa indices.

Main Results:

• Overall agreement between trained and experienced observers for HH actions was 75.4% (Kappa index = 0.61).
• Agreement among observers for HH moments reached 83.8% (Kappa index = 0.71).
• The Kappa indices indicated moderate to substantial agreement, suggesting successful observer validation.

Conclusions:

• Dedicated training effectively validated hand hygiene observers, aligning with recommendations for enhanced HH monitoring.
• The study supports the use of trained observers for improving the reliability of hand hygiene surveillance.
• Future research should explore the sustainability of observer agreement, retraining needs, and alternative validation strategies.