横向评估的可靠性用于评分物理治疗入学面试和优化评分分配的可靠性
Gregory F Spadoni1,2, Paul W Stratford1,2
1Gregory F. Spadoni is the associate professor at the Institute for Applied Health Sciences, McMaster University, Rm 432, 1400 Main Street West, Hamilton, Ontario L8S 1C7 (spadongf@mcmaster.ca). Please address all correspondence to Gregory F. Spadoni.
Journal, physical therapy education
|February 10, 2026
概括
与垂直 (0.63) 和部分水平 (0.75) 格式相比,对物理治疗候选人的完全水平入学审查显著提高了interrater可靠性 (0.82). 优化评级者资源包括增加面试问题,每个问题都有单独的评级者,以提高可靠性.
科学领域:
- 医学教育 医学教育
- 健康 专业 教育 卫生 专业 教育
- 招生程序 招生程序 招生程序
背景情况:
- 评估物理治疗候选人需要可靠的入学审查.
- 之前的研究表明,部分水平审查比垂直审查提高了可靠性.
- 本研究研究了一种完全横向的审查格式,以提高可靠性.
研究的目的:
- 为了估计物理治疗候选人的完全水平录取审查的interrater可靠性.
- 为了比较完全水平审查的可靠性与以前的部分水平和垂直审查格式.
- 介绍一种优化招生评分员资源配置以提高可靠性的方法.
主要方法:
- 分析了加拿大物理治疗计划录取审查员 (2021-2023) 的回顾性数据.
- 异步虚拟多次迷你采访 (AVMMI) 数据被用于计算类内相关系数 (ICC) 和标准测量误差 (SEM).
- 创建了可通用性模型,以识别与候选和评级变量相关的方差组件,包括评级者数量和问题.
主要成果:
- 2023年的全水平审查实现了0.82的评级者间可靠性,而2020年的垂直审查为0.63和2021年的部分水平审查为0.75.
- 观察到最高的泛化系数 (G) 和最小的SEM是以每题2个评分符和7个问题的格式.
- 差异组件分析确定了最佳的评级者分配策略.
结论:
- 完全横向的录取审查格式明显提高了评级者的可靠性,并减少了错误差异.
- 当评级者资源有限时,增加面试问题并为每个问题分配单独的评级者比减少多个评级者的问题更有效.
- 这种方法提高了物理治疗课程招生审查的效率和准确性.
相关概念视频
Reliability and Validity
14.1K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.1K
Chest Physiotherapy
1.9K
Chest Physiotherapy (CPT) is a therapeutic technique used in respiratory care to improve ventilation, clear bronchial secretions, and enhance the efficiency of respiratory muscles. This therapy includes three primary procedures: postural drainage, percussion, and vibration. It can be performed on spontaneously breathing patients and those who are intubated and mechanically ventilated.
Purpose
CPT is primarily used for patients with excessive bronchial secretions who have difficulty clearing...
Purpose
CPT is primarily used for patients with excessive bronchial secretions who have difficulty clearing...
1.9K
Introduction to z Scores
11.3K
A z score (or standardized value) is measured in units of the standard deviation. It tells you how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a zero z score. It is important to note that the mean of the z scores is zero, and the standard deviation is one.
z scores...
z scores...
11.3K
Introduction to z Scores
1.4K
A z score (or standardized value) is measured in units of the standard deviation. It indicates how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a zero z score. It is important to note that the mean of the z scores is zero, and the standard deviation is one.
z scores...
z scores...
1.4K
z Scores and Area Under the Curve
19.6K
z scores are the standardized values obtained after converting a normal distribution into a standard normal distribution. A z score is measured in units of the standard deviation. The z score tells you how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a z score of...
19.6K
Horizontal Gene Transfer
2.3K
Horizontal gene transfer (HGT) is a process where genetic material moves between organisms within the same generation, unlike vertical gene transfer, which occurs from parent to offspring. HGT plays a crucial role in microbial evolution, adaptation, and survival, particularly in shared environments like the human gut.Mobile genetic elements such as plasmids, prophages, integrons, insertion sequences, and transposons facilitate this process. HGT occurs through three primary mechanisms:...
2.3K


