Related Experiment Video
Updated: Dec 6, 2025

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Development and validation of an organizational readiness to change instrument focused on cultural competency
Ann Scheck McAlearney1,2,3,4, Megan Gregory2,3, Daniel M Walker1,2,3
1Department of Family and Community Medicine, College of Medicine, The Ohio State University, Columbus, Ohio, USA.
Objective:
To validate a brief survey developed to be used in hospitals nationwide to assess organizational readiness to change to increase cultural competency.
Data Sources/Study Setting:
Analysis of primary data collected as part of a 125-item Organizational Assessment Survey conducted in the ten US hospitals participating in the Robert Wood Johnson Foundation Expecting Success program in 2005-2006.
Study Design:
The study utilized a cross-sectional survey.
Data Collection:
Surveys were distributed to participants in the ten hospitals based on job title and role within the organization (including clinicians, clinical administrators, other clinical professionals, and those in relevant nonclinical roles; respondents = 513; response rate = 31%). Missing data were deleted listwise. We computed internal consistency reliability via Cronbach's alpha and interrater agreement using the rwg(j) index, and conducted exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) to examine validity of the survey. We subsequently conducted ANOVAs to examine whether the instrument adequately distinguished between hospitals.
Principal Findings:
Across 408 complete responses, a scree plot generated by the EFA and a follow-up CFA indicated a 2-factor solution (RMSEA = 0.06; CFI = 0.96; GFI = 0.96; RMSR = 0.08). We identified these primary factors as two scales, a 12-item Readiness to Address Quality scale (α = 0.85; rwg(j) = 0.93) and an 11-item Readiness to Address Disparities scale (α = 0.65; rwg(j) = 0.89). ANOVAs suggested that these scales distinguished between hospitals (RTAQ: F[9, 428] = 3.70, P < .001; RTAD: F[9, 435] = 3.02, P = .002).
Conclusions:
This survey can help identify an organization's readiness to change to increase cultural competency.
Related Concept Videos
Self-Evaluation Maintenance Model
Reliability and Validity
Data Validation
Nursing assessment guides are generally based on holistic models rather than medical...
Close Relationships and Culture
Self-Esteem and Culture
Community Based Intervention
Foundations of Community Mental Health Programs
Central to the success of community-based interventions is the...

