在西班牙大学入学考试中评估委员会的一致性分析
Alejandro Veas1, José-Antonio López-Pina2
1Department of Developmental and Educational Psychology, University of Murcia, 30100 Murcia, Spain.
概括
西班牙的大学入学考试显示,各科目和各大学的评分存在显著的不一致. 这项研究强调了需要改进的标准,以确保所有学生的公平和可比的考试标准.
科学领域:
- 教育测量教育的测量
- 心理测量 心理测量 心理测量
- 高等教育 访问 高等教育 访问
背景情况:
- 大学入学考试 (EBAU) 对于学生进入西班牙高等教育至关重要.
- 评估评级人员的表现对于保持这些高风险考试的完整性至关重要.
- 之前的分析还没有完全解决EBAU评分中的评审者间和主体间的变化.
研究的目的:
- 分析2018年6月在西班牙瓦伦西亚社区的EBAU的评级数据.
- 评估不同评估委员会,科目和大学的考试标准的一致性和可比性.
- 为了确定评级过程中变化的来源.
主要方法:
- 利用多面拉什模型 (MFRM) 来分析来自54个评估委员会和3000名学生的评级数据.
- 模拟的考试委员会严重程度,科目难度和小组表现在一个共同的线性尺度上.
- 应用心理测量技术来量化评级不一致性.
主要成果:
- 在大学入学考试的评分过程中显示出显著的不一致性.
- 确定了大学内部和大学之间评估严重性的实质差异.
- 在受试者难度和评价者宽容度方面显示出相当大的变化.
结论:
- 这些发现强调了需要加强标准,以确保西班牙考试标准的可比性.
- 结果表明,需要对当前的评估实践进行批判性审查.
- 这项研究为提高国家大学入学考试的公平性和可靠性提供了基础.
相关概念视频
Reliability and Validity
13.2K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.2K
Correlations
34.0K
Correlation means that there is a relationship between two or more variables (such as ice cream consumption and crime), but this relationship does not necessarily imply cause and effect. When two variables are correlated, it simply means that as one variable changes, so does the other. We can measure correlation by calculating a statistic known as a correlation coefficient. A correlation coefficient is a number from -1 to +1 that indicates the strength and direction of the relationship between...
34.0K
Surveys
15.4K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
15.4K
One-Way ANOVA: Equal Sample Sizes
3.5K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.5K
Comparing Experimental Results: Student's t-Test
2.1K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
2.1K
Bonferroni Test
2.9K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.9K


