众包平台的设计和评估基于用户的信任判断
Samin Nili Ahmadabadi1, Maryam Haghifam2, Vahid Shah-Mansouri3
1School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran.
Scientific reports
|August 7, 2024
概括
了解元认知,或者一个人对自己思维过程的意识,可以提高众包的准确性. 通过将用户的信心水平与他们的答案相结合,可以提高众包系统的整体性能.
科学领域:
- 计算机科学 计算机科学
- 认知科学 认知科学
- 社会科学 社会科学 社会科学
背景情况:
- 众包利用非专家的集体智能来解决问题,通过社区投票汇总答案.
- 当前众包方法通常依赖于预测来选择参与者,但设计有效的预测是具有挑战性的.
- 现有的系统在选择合适的个人和收集可靠的答案方面遇到了困难.
研究的目的:
- 调查将元认知和用户信心水平纳入是否可以提高众包系统的性能.
- 探索认知特征和决策模型对人群形成的影响,并评估答案准确性.
主要方法:
- 数学分析以建模元认知和众包准确性之间的关系.
- 实验分析以评估用户对众包任务信心的实际应用.
- 通过考虑认知特征来调查选择参与者和收集答案的方法.
主要成果:
- 证明元认知能力,或对自己答案的信心,是个体答案准确性的关键因素.
- 展示了利用用户的信任水平与他们的答案一起可以显著提高众包结果的整体准确性.
- 提供证据表明,理解和整合认知特征可以提高众包平台中答案正确性的估计.
结论:
- 通过理解和利用个人的元认知和对他们的答案的信心,可以提高众包系统的性能.
- 整合超认知能力为更准确,更可靠的众包成果提供了一个有希望的途径.
- 未来的众包系统应该将用户的信心视为增强集体智能的关键指标.
相关概念视频
Confidence Coefficient
7.6K
The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under...
7.6K
Confidence Intervals
6.2K
An unbiased point estimate is often insufficient to predict a population estimate, such as population mean or population proportion. In this scenario, a confidence interval is used. A confidence interval is an estimate similar to a sample proportion. However, unlike the point estimate which is a single value, the confidence interval contains a range of values. These values have lower and upper limits, known as confidence limits, and can be designated as L1 and L2, respectively.
A...
A...
6.2K
Confidence Interval for Estimating Population Mean
7.2K
A point estimate of the population mean is obtained from a single sample. Such a point estimate does not represent a population well because it needs to account for variability in the population. Single point estimate can also be biased despite the sample being selected randomly. Thus, a point estimate is often unreliable. A confidence interval is needed to reduce this unreliability.
A confidence interval for the mean is a range of values that provides an estimate of the population mean. As the...
A confidence interval for the mean is a range of values that provides an estimate of the population mean. As the...
7.2K
Confirmation Biases
5.5K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.5K
Interpretation of Confidence Intervals
5.7K
A confidence interval is a better estimate of the population than a point estimate, as it uses a range of values from a sample instead of a single value.
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...
5.7K
Uncertainty: Confidence Intervals
3.1K
The confidence interval is the range of values around the mean that contains the true mean. It is expressed as a probability percentage. The interpretation of a 95% confidence interval, for instance, is that the statistician is 95% confident that the true mean falls within the interval. The upper and lower limits of this range are known as confidence limits. The confidence limits for the true mean are estimated from the sample's mean, the standard deviation, and the statistical factor...
3.1K


