大规模测试成绩可与在家对抗测试中心测试相比吗?
Katherine E Castellano1, Matthew S Johnson1, Rene Lawless1
1ETS, NJ, USA.
Applied psychological measurement
|August 21, 2024
概括
与传统的考试中心考试相比,远程监督评估或家庭测试没有显著的分数差异. 这一发现对于了解远程测试在招生中的有效性至关重要.
科学领域:
- 教育测量教育的测量
- 心理测量 心理测量 心理测量
- 远程评估技术 远程评估技术
背景情况:
- 随着COVID-19的流行,远程监督 (在家) 评估的采用加速了.
- 与测试中心相比,家庭测试环境在设置,设备和监督方面缺乏标准化.
- 了解远程和传统测试之间的得分可比性对于评估有效性至关重要.
研究的目的:
- 调查大规模招生考试的远程监控和测试中心管理之间的得分可比性.
- 确定环境和程序差异是否会影响远程评估环境中的测试成绩.
主要方法:
- 采用了随机对照试验和观察性研究设计.
- 在家中评估的测试成绩与传统测试中心的测试成绩进行了比较.
- 采用了统计学调整,以取决于样本组成的基线特征差异.
主要成果:
- 在家庭和测试中心得分之间没有发现统计学上显著的差异.
- 对样本组成的调整证实了测试方式之间的得分可比性.
- 研究结果表明,远程监控本身并不会改变招生考试结果.
结论:
- 远程监控的评估证明了与传统测试中心管理的分数等价性.
- 这项研究支持家庭测试对大规模入院的有效性和可靠性.
- 这些发现对标准化测试和教育可访问性的未来有影响.
相关概念视频
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Comparing Experimental Results: Student's t-Test
1.5K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
1.5K
Multiple Comparison Tests
3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
Measures of Intelligence
7.1K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.1K
One-Way ANOVA: Equal Sample Sizes
3.2K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.2K
Ratio Level of Measurement
17.5K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
17.5K


