使用语音暂停模式深度假声检测的调查:算法开发和验证
Nikhil Valsan Kulangareth1, Jaycee Kaufman1, Jessica Oreskovic1
1Klick Labs, Toronto, ON, Canada.
JMIR biomedical engineering
|June 14, 2024
概括
这项研究表明,分析语音暂停可以有效地区分真人声音和人工智能生成的深度虚假音频. 机器学习模型在识别基于这些生物语音模式的克隆声音方面取得了很高的准确性.
科学领域:
- 数字法医学数字法医学
- 语音处理 语音处理
- 人工智能的人工智能
背景情况:
- 数字媒体和深度假冒技术的兴起对信息真实性构成重大威胁.
- 深度假冒可以被滥用来冒充和传播错误信息,破坏对数字内容的信任.
研究的目的:
- 探索使用先天的生物语音特征来区分真实的人类声音和克隆的人.
- 调查语音暂停作为声音真实性检测的关键感知特征.
主要方法:
- 收集了49名不同参与者的语音样本,用于训练语音克隆模型.
- 分析了与生物和认知过程 (呼吸,吞,思考) 相关的语音暂停.
- 利用语音暂停配置文件的五个音频功能和五个机器学习算法来构建一个检测模型.
主要成果:
- 与真实音频相比,克隆音频显示了暂停时间,语音段长度变化和暂停频率的显著差异.
- 在交叉验证中,AdaBoost机器学习模型以0.81的平衡精度实现了最高的性能.
- 最佳模型在未见的数据上显示了0.79的测试准确性,验证了其概括能力.
结论:
- 将感知,生物语音特征集成到机器学习模型中显示出检测克隆音频的巨大潜力.
- 这种方法提供了一种有希望的方法来打击深度假冒音频的传播,并验证语音真实性.
关键词:
人工智能的人工智能是人工智能.音频 音频 音频 音频 音频 音频克隆,克隆的人.克隆,就是克隆人类.深度学习是一种深度学习.这是一个深度假的Deepfake.深度假冒是深度假冒的机器学习是机器学习.模型-天真的模型听起来很有声音,听起来很好.声音 声音 声音 是一种声音.演讲 演讲 演讲 演讲从文本转化为演讲一个声音的声音的声音的声音.声乐生物标志物 声乐生物标志物一个声音,一个声音,一个声音.更多相关视频
相关概念视频
Difference from Background: Limit of Detection
6.3K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.3K
Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
Perceiving Loudness, Pitch, and Location
205
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
205
Extraction: Advanced Methods
446
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
446


