在计算机化适应性测试中对项目校准错误的计算.
Aron Fink1, Christoph König2, Andreas Frey2
1Goethe University Frankfurt, Theodor-W.-Adorno-Platz 6, 60323, Frankfurt, Germany. a.fink@psych.uni-frankfurt.de.
Behavior research methods
|March 27, 2025
概括
计算机自适应测试 (CAT) 经常会因为项目参数错误而高估能力. 贝叶斯式方法有效地解决了这种不确定性,改善了能力估计,特别是当大规模校准样本不可行时.
科学领域:
- 心理测量 心理测量 心理测量
- 教育测量教育的测量
- 统计建模 统计建模
背景情况:
- 在计算机自适应测试 (CAT) 中,项目参数估计通常被视为固定的,忽视固有的校准错误.
- 项目参数的不确定性可能导致低估标准错误和偏差的能力估计,特别是在极端的能力水平.
研究的目的:
- 调查在CAT中计算项目参数不确定性的方法.
- 为了比较测量误差建模和贝叶斯方法与标准CAT程序的性能.
主要方法:
- 进行了一项蒙特卡洛模拟研究.
- 研究了三种方法:两种测量误差建模技术和一种完全贝叶斯方法.
- 这些方法基于能力估计的准确性和偏差性进行了比较.
主要成果:
- 所有三种研究方法都减少了能力估计中的偏差和平均平方误差 (MSE),特别是在高项目校准误差条件下.
- 与测量错误建模方法相比,贝叶斯式方法显示出更高的性能.
- 对于具有极端能力水平的人来说,好处最为明显.
结论:
- 考虑项目参数不确定性对于准确估计CAT能力至关重要.
- 建议使用贝叶斯方法,因为它有效地减轻了偏差并提高了准确性.
- 这种方法在大型校准样本不切实际的情况下特别有价值.
相关概念视频
Random and Systematic Errors
10.7K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
10.7K
Uncertainty in Measurement: Accuracy and Precision
73.1K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.
73.1K
Systematic Error: Methodological and Sampling Errors
1.4K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
1.4K
Distance Corrections
24
To achieve precise distance measurements, especially in surveying and construction, certain corrections must be applied to account for potential sources of error like the standardization errors, temperature variations, and slope adjustments.Standardization error emerges when measurement equipment undergoes changes, such as wear, repairs, or weather impacts. To address this, surveyors compare the equipment’s readings to a standard. This process identifies any deviation that might lead to...
24
Accuracy and Errors in Hypothesis Testing
166
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
166
Reliability and Validity
12.6K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.6K


