Related Experiment Video
Updated: Jan 7, 2026
Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Multi-methods development and validation of a tool for use in measuring serious illness communication competence:
Anish K Arora1, Hsien Seow2, Daryl Bainbridge3
1Department of Family and Community Medicine, University of Toronto, Toronto, Canada.
Objectives:
The assessment of serious illness communication (SIC) competence has, to date, primarily utilized tools that are profession-specific and not explicitly designed using competency-based or person-centered frameworks. To address these gaps, we developed and validated a new tool, the Assessment of Clinical Encounters - Communication Tool (ACE-CT).
Methods:
We convened a national panel of interprofessional SIC experts to develop and validate the ACE-CT using a three-phase multi-method approach. Phase 1 focused on item development through review of existing validated tools, and a Bayesian process in which panel members assessed item quality and item-domain correlation. Phase 2 involved item refinement and preliminary validation through stimulated recall interviews using a think-aloud technique. Phase 3 consisted of psychometric analyses for which panel members used the tool to assess video-recorded standardized patient encounters from interprofessional clinicians completing a SIC professional development intervention.
Results:
In Phase 1, 37 relevant items from previously validated tools were identified, of which 11 items were removed due to redundance. Through the Bayesian process, 14 items were removed and 1 item was generated. Through Phase 2, 2 items were generated, 2 items were combined into 1, and remaining items were refined to optimize measurability and understandability. In Phase 3, reliability was demonstrated through evidence of high internal consistency and moderate reproducibility, both over time and across raters. The tool was found to be responsive and have sound construct validity through evidence of congruence, convergence and credibility. Raters found the tool to be intuitive, easy to complete, and that it accurately captured their perception of the quality of communication observed.
Conclusions:
The ACE-CT provides a reliable and valid approach to assessing SIC competence among interprofessional clinicians.
Practical Implications:
Through its person-centered orientation, the ACE-CT provides an opportunity to objectively assess elements of SIC that patients and families value.
Related Concept Videos
01:25Role of Communication in the Nursing Process I: Assessment and Diagnosis
The nursing process considers the patient's emotional and physical well-being. The process can be repeated or stopped at any point if judged essential. Assessment is the first step in the nursing...
01:25Formulating and Validating Nursing Diagnosis II
Risk nursing diagnoses represent clinical judgments of an individual, family, or community more vulnerable to developing the health problem than others...
01:15Methods of Documentation VI: Case Management Model
For example, a patient with a chronic...
01:21Barriers to Effective Communication II
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
01:26Formulating and Validating Nursing Diagnosis I
There are thirteen domains...
01:15Techniques of therapeutic communication I: Active Listening, Sharing Observations, Validation, and Using Touch
Therapeutic communication is not the same as social interaction. Social interaction has no goal or purpose and consists of casual information sharing, whereas therapeutic communication has a plan or purpose for the conversation. Therapeutic...