多代理系统和基于信誉的高级评分机制在事实核查中
1Graduate School of Informatics, Kyoto University, Kyoto, 606-8501, Japan. dong.yihan.77v@st.kyoto-u.ac.jp.
Scientific reports
|March 3, 2026
概括
本研究引入了一个多代理事实核查 (MAFC) 框架,以打击社交网络服务 (SNS) 上的错误信息. 通过使用多种代理和一种新的评分机制,MAFC提高了可信度评估的性能,超过了现有的方法.
科学领域:
- 人工智能的人工智能
- 信息科学 信息科学 信息科学
- 计算社会科学 计算社会科学
背景情况:
- 关于社交网络服务 (SNS) 的错误信息和谣言对在线话语构成了重大挑战.
- 大型语言模型 (LLM) 对事实检查有希望,但在处理复杂文本方面存在过度自信和局限性.
- 现有的多源事实核查方法缺乏可靠的评分机制来评估可信度.
研究的目的:
- 提出和评估一个新的多代理事实核查 (MAFC) 框架.
- 解决基于LLM的事实核查的局限性,包括过度信任和二进制分类约束.
- 开发一个有效的评分机制,以整合来自多个信息来源的判断.
主要方法:
- 开发了一个多代理事实核查 (MAFC) 框架,利用多个代理与不同的信息来源.
- 实施了一种新的评分机制,以根据代理人的判断和信任水平计算文本的可信度.
- 在事实检查任务中进行了比较实验,以评估MAFC与基线方法相比.
主要成果:
- 与基线方法相比,拟议的MAFC框架显示出优异的性能.
- 在二进制和多标签事实检查任务中,MAFC取得了更好的结果.
- 实验验证证了新型评分机制的有效性.
结论:
- MAFC框架提供了一种有效的解决方案,可以提高事实核查的准确性和可靠性.
- 开发的评分机制增强了对可信度评估的各种信息来源的整合.
- 需要进一步的研究来解决事实核查方面的挑战,例如标准化定义和创建全面的数据集.
相关概念视频
01:31Confirmation Biases
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
00:52Social Proof
Social proof is a form of persuasion based on comparison and conformity. People compare their behavior and actions to what others are doing and will change to conform to do what their peers do.
01:17Strategies of Self-Presentation II: Self-Verification
Self-verification is a fundamental psychological drive wherein individuals seek affirmation of their self-concept from others, striving for consistency between their internal self-view and external perceptions. This drive operates even when the self-concept is negative, influencing interpersonal behavior and feedback preferences in complex and often counterintuitive ways. Unlike the self-enhancement motive, which seeks positive evaluations, self-verification prioritizes coherence and...
01:14Understanding Deception
Deception is a pervasive aspect of human communication. Empirical studies have shown that most individuals engage in some form of deceit on a daily basis, with approximately 20% of social exchanges involving deceptive elements. Lying follows a developmental trajectory, peaking during adolescence and declining with age, possibly due to the maturation of cognitive control and social accountability.Cognitive and Social Factors in Deception DetectionDespite its prevalence, accurately detecting...
01:15Theory of Attribution I: Correspondent Inference Theory
Correspondent inference theory, proposed by Jones and Davis in 1965, seeks to explain how individuals infer stable personality traits from observed behaviors. It suggests that people attribute actions to underlying dispositions rather than external circumstances, particularly when the behavior appears intentional and socially significant.Voluntary Behavior and Dispositional AttributionAccording to this theory, individuals are more likely to attribute behavior to personal traits when it appears...
01:29Theory of Attribution II: Kelley's Covariation Theory
Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus: Comparing...