评价评审员:研究评分论文的过程
1Centre for Dental Education, Faculty of Dentistry, Oral and Craniofacial Sciences, King's College London, London, United Kingdom.
Frontiers in oral health
|May 6, 2024
概括
文章评分缺乏可靠性,因为审查员的解释和做法各不相同. 改进评估需要对标记标准和一致评估标准有共同的理解.
科学领域:
- 医学教育 医学教育
- 评估和评价的评估和评估.
背景情况:
- 论文评估对于复杂的认知技能是常见的,但受到不可靠性的困扰.
- 对于教育评估过程中的问责制,透明度和一致性,存在着越来越大的压力.
研究的目的:
- 为了探索英国一所牙科学校的考官之间的作文标记实践.
- 识别导致论文评分不可靠性的因素.
主要方法:
- 定性方法利用与考官进行大声思考的采访.
- 学生作文的标记和重新标记的分析.
主要成果:
- 审查员对评估标准的解释有所不同,并采用了个性化的标记实践.
- 检查人员观察到一个共同的倾向,即对论文进行排名,而不是使用标准引用.
- 在评分方面发现了显著的变化,只有一个考官在重新标记时获得了相同的等级类别;差异与考官的经验无关.
结论:
- 不一致的作文评分做法破坏了评估的可靠性.
- 建立对评估标准和标准的共同理解对于提高员工和学生的公平性和一致性至关重要.
更多相关视频
07:32Use of Galvanic Skin Responses, Salivary Biomarkers, and Self-reports to Assess Undergraduate Student Performance During a Laboratory Exam Activity
Published on: February 10, 2016
9.4K
15:00A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
Published on: February 7, 2025
553
相关概念视频
Surveys
14.8K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.8K
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Ethics in Research
23.0K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
23.0K
Quality Assurance
123
Quality assurance is the overarching term used to describe the activities employed to ensure the proper performance of a system. These activities can be classified into three categories: quality control, quality assessment, and internal corrective measures. Typically, these activities work cyclically: quality control is performed before and during the analysis, while quality assessment occurs during and after the investigation. Internal corrective measures are implemented based on the findings...
123
Confirmation Biases
5.5K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.5K
The Stanford Prison Experiment
23.2K
The famous and controversial Stanford Prison Experiment, conducted by social psychologist Philip Zimbardo and his colleagues at Stanford University, demonstrated the power of social roles, social norms, and scripts.
23.2K
