Assessment of OASIS reliability and validity using several methodological approaches

Area of Science:

• Healthcare quality assessment
• Clinical informatics
• Patient outcome measurement

Background:

• The Outcome Assessment and Information Set (OASIS) is crucial for home healthcare quality assessment.
• Limited research exists on the psychometric properties of OASIS within routine clinical practice.
• Understanding OASIS reliability and validity in real-world settings is essential for accurate patient care evaluation.

Purpose of the Study:

• To evaluate the reliability and validity of the OASIS instrument during actual clinical practice in home healthcare.
• To compare OASIS data with Centers for Medicare and Medicaid Services (CMS) 485 data to assess consistency.
• To identify potential limitations of OASIS in reflecting patient conditions under the stresses of home healthcare.

Main Methods:

• Utilized a delayed assessment approach (n=259) to estimate OASIS reliability.
• Employed a simultaneous assessment approach (n=105) to examine OASIS validity.
• Assessed consistency between OASIS and CMS 485 (n=141) for inter-tool agreement.

Main Results:

• Reliability for numerous OASIS items was significantly lower than reported in previous studies.
• Notable inconsistencies were identified between several OASIS domains and the CMS 485.
• Findings indicate potential challenges in generalizing prior OASIS psychometric research to unpredictable home healthcare environments.

Conclusions:

• The psychometric properties of OASIS in routine home healthcare practice may be weaker than previously understood.
• Inconsistencies between OASIS and CMS 485 suggest potential issues with OASIS accurately reflecting patient status.
• Implications for improving OASIS implementation and interpretation in clinical practice settings are discussed.