通过多模式文本和图像机器学习模型解码数字话语,以对种族和女同性恋,同性恋,双性恋,跨性别者,酷儿,跨性别者和无性社区相关的社交媒体帖子进行分类和检测仇恨言论:定量研究
Thu T Nguyen1, Xiaohe Yue1, Heran Mane1
1Department of Epidemiology and Biostatistics, University of Maryland, College Park, College Park, MD, United States.
Journal of medical Internet research
|May 12, 2025
概括
多模式机器学习模型有效地分析社交媒体情绪和仇恨言论,优于纯文本或仅图像的方法. 先进的技术提高了对细微的在线内容的检测.
科学领域:
- 多模式机器学习是多模式机器学习.
- 计算社会科学 计算社会科学
- 人工智能在社交媒体分析中的作用
背景情况:
- 社交媒体情绪分析面临着图像繁重内容的挑战.
- 传统的基于文本的方法往往错过了视觉和上下文的细微差别.
- 多模式方法对于理解复杂的社交媒体信息至关重要.
研究的目的:
- 提供关于收集,处理和分析多式联络社交媒体数据的指导.
- 训练和微调机器学习模型,用于情绪分类和仇恨言论检测.
- 在各种社交媒体数据集上评估单模式和多模式模型的性能.
主要方法:
- 从Facebook,Instagram和X (以前的Twitter) 收集的数据.
- 过种族和LGBTQIA+社区相关的帖子和图片.
- 人类对13,000个帖子进行了注释;评估了单模 (BERT,VGG16) 和多模 (CLIP,VisualBERT,融合) 模型.
- 应用合成少数超标采样技术和潜在的迪里克莱特分配,用于数据增强和语义改进.
主要成果:
- 多模式模型在情绪和仇恨言论检测方面明显优于单模式模型.
- CLIP和VisualBERT在情绪分类方面显示出高准确度.
- 中间融合模型在仇恨言论检测方面取得了最高的准确性.
- 数据增强技术改善了少数群体类别的检测,特别是针对反仇恨内容.
结论:
- 多模式机器学习模型为社交媒体内容分析提供了卓越的性能.
- 先进的模型和数据增强技术增强了对复杂在线信息的理解.
- 调查结果支持AI在社交媒体监控中的应用,用于研究人员和政策制定者.
相关概念视频
Stereotypes, Prejudice, and Discrimination
89.7K
Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who...
89.7K
Stereotype Content Model
13.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
13.9K
Classification of Signals
342
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
342
Force Classification
1.0K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.0K
Language and Cognition
294
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
294
Classification of Systems-II
125
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
125


