评估角色扮演提示对ChatGPT错误信息检测准确度的影响:定量研究
Michael Robert Haupt1,2,3, Luning Yang3, Tina Purnat4
1Department of Cognitive Science, University of California, San Diego, La Jolla, CA, United States.
JMIR infodemiology
|September 26, 2024
概括
在提示中扮演社会身份的角色显著降低了大型语言模型 (LLM) 在检测COVID-19错误信息方面的准确性. 人类监督对于在公共卫生传播中可靠使用LLM至关重要.
科学领域:
- 人工智能的人工智能
- 公共卫生传播 公共卫生传播
- 计算社会科学 计算社会科学
背景情况:
- 随着COVID-19的爆发,人们在打击在线虚假信息方面面临的挑战越来越明显.
- 大型语言模型 (LLM) 对错误信息检测有希望,但对提示工程敏感.
- 角色扮演提示,LLM采用特定身份,可能会影响他们的表现.
研究的目的:
- 评估通过角色扮演提示向ChatGPT分配社交身份如何影响其检测COVID-19错误信息的准确性.
- 为了比较ChatGPT在明确与上下文依赖的错误信息方面的表现.
- 分析ChatGPT为其分类决定提供的理由.
主要方法:
- 36条与COVID-19相关的推特被归类为 (错误信息,情绪,纠正,中立).
- 聊天GPT测试了提示,包括各种社会身份 (政治,教育,地方,宗教,个性) 的组合.
- 控制条件包括没有身份,只有政治身份的提示,共计51,840次运行.
主要成果:
- 包括社交身份在提示符中,平均错误信息检测准确度从68.1%降至29.3%.
- 仅涉及政治身份的提示结果的准确性最低 (19.2%).
- 聊天GPT区分非联盟情绪和错误信息,但推理不一致,解释矛盾.
结论:
- 扮演角色的社会身份会对ChatGPT的错误信息检测能力产生负面影响.
- 人类偏见融入LLM是复杂的,需要人类监督.
- 需要进一步的研究,以了解社会身份和跨文化应用的LLM处理.
相关概念视频
Stereotype Threat and Self-fulfilling Prophecies
37.5K
When we hold a stereotype about a person, we have expectations that he or she will fulfill that stereotype. A self-fulfilling prophecy is an expectation held by a person that alters his or her behavior in a way that tends to make it true. When we hold stereotypes about a person, we tend to treat the person according to our expectations. This treatment can influence the person to act according to our stereotypic expectations, thus confirming our stereotypic beliefs. Research by Rosenthal and...
37.5K
Stereotype Content Model
14.0K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.0K
Nonconscious Mimicry
4.5K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.5K
Social Proof
27.6K
Social proof is a form of persuasion based on comparison and conformity. People compare their behavior and actions to what others are doing and will change to conform to do what their peers do.
27.6K
The Representativeness Heuristic
15.8K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
15.8K
False Memories
79
False memories represent a cognitive distortion in which individuals recall events that did not happen, or remember them in an altered form. This phenomenon highlights the brain's constructive nature in processing and recalling memories, emphasizing that memory is not a perfect representation of past events but rather a dynamic reconstruction influenced by various factors.
One primary source of false memories is misattribution, where individuals incorrectly associate external information...
One primary source of false memories is misattribution, where individuals incorrectly associate external information...
79


