打开黑盒子:跨多个机构的情境判断测试的协议和可靠性
Kathryn J Smith1, Brent N Reed2, Stephen Neely1
1University of Oklahoma, College of Pharmacy, Oklahoma City, OK, USA.
American journal of pharmaceutical education
|November 1, 2023
概括
这项研究发现了一种可靠的情境判断测试 (SJT),用于评估药学教师的同情心,诚信和团队合作. 该测试证明了良好的有效性和公平性,支持其在未来的学生评估中使用.
科学领域:
- 教育评估的教育评估
- 药房教育 教育 药房教育
- 心理测量 心理测量 心理测量
背景情况:
- 在药房教育中,评估诸如同情心,诚信和团队合作等非认知技能至关重要.
- 情境判断测试 (SJT) 是评估这些基本专业能力的宝贵工具.
- 建立可靠性和有效性对于在学术环境中有效实施SJT至关重要.
研究的目的:
- 为药房实践教师开发的情境判断测试 (SJT) 的协议和可靠性进行评估.
- 收集证据支持SJT的有效性和公平性,以评估关键的专业属性.
- 确定SJT是否适合在药房教育中更广泛应用.
主要方法:
- 一个SJT与18个场景和118个响应被管理到5个美国机构的39个药房实践教师.
- 使用内部一致性,评价者间可靠性 (目标>0.7) 和分半可靠性来评估可靠性.
- 采用了近乎失误的评分系统,并使用描述性统计数据评估了公平性.
主要成果:
- 最终的SJT包括105个响应,达到0.98的高级别之间的可靠性 (协议>0.7).
- 发现分半可靠性为0.72,表明良好的内部一致性.
- 平均SJT得分为85.7%,人口群体之间没有显著的绩效差异.
结论:
- 开发的SJT证明了可接受的可靠性,并为其在药学学院的有效性和公平性提供了初步支持.
- 这些发现支持在药学学生中试行SJT,以评估其在评估基本专业技能方面的有用性.
- 在药房教育中,SJT可以作为衡量同情心,诚信和团队合作的宝贵工具.
相关概念视频
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Measures of Intelligence
7.3K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.3K
Stereotypes, Prejudice, and Discrimination
90.2K
Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who...
90.2K
Self-Report Tests of Personality
359
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
359
Surveys
14.8K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.8K
Confirmation Biases
5.5K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.5K


