MNET++:以音乐为驱动的多元舞蹈,朝着多种舞蹈类型的综合舞蹈
IEEE transactions on pattern analysis and machine intelligence
|September 5, 2023
概括
这项研究介绍了MNET ++,这是一个先进的AI模型,用于实现现实的舞蹈生成. 它通过与音乐节奏同步克服重复的模式,并提供多样化,类型特定的舞蹈序列.
科学领域:
- 人工智能的人工智能
- 计算机图形 计算机图形
- 计算创造力的创造力
背景情况:
- 现有的自回归网络用于舞蹈生成通常会产生重复和劣质的舞蹈序列.
- 一个关键的局限性是当前算法无法从给定的初始姿势生成多样化和非重复的舞蹈动作.
研究的目的:
- 解决现有的舞蹈生成模型的局限性,特别是重复的模式和缺乏多样性的局限性.
- 提出一种新的模型架构 (MNET++) 和用于增强舞蹈合成的培训方法.
主要方法:
- 开发了MNET++,结合了一种节拍同步器用于音乐节奏坚持和一个舞蹈合成器用于基于补丁的运动推理.
- 利用对抗式学习与变压器架构来生成多样化的舞蹈序列.
- 实现了一种舞蹈类型的潜在表示,用于在多个领域进行细粒度的用户控制.
主要成果:
- MNET++成功地生成了与音乐节奏同步的本地和全球一致的舞蹈序列.
- 该模型绕过重复的模式,产生现实和多样化的舞蹈动作.
- 定性和定量评估显示,与最先进的方法相比,在生成跨多个类型的可信的舞蹈序列方面表现优越.
结论:
- MNET++代表了人工智能驱动的舞蹈生成的重大进步,提供现实的,多样化的和可控的舞蹈序列.
- 拟议的节拍同步器和舞蹈合成器模块有效地解决了先前模型中的关键挑战.
- 流派意识的潜伏表示增强了对各种舞蹈领域的用户控制和可扩展性.
更多相关视频
09:19Community-based Adapted Tango Dancing for Individuals with Parkinson's Disease and Older Adults
Published on: December 9, 2014
25.7K
09:46MPI CyberMotion Simulator: Implementation of a Novel Motion Simulator to Investigate Multisensory Path Integration in Three Dimensions
Published on: May 10, 2012
12.7K
相关概念视频
Ethnic Identity within a Larger Culture
59
Adolescents from ethnic minority backgrounds face a multifaceted journey in forming their identities, shaped by the intersections of cultural expectations and personal exploration. For these adolescents, identity formation involves not only typical developmental challenges but also navigating the perceptions and attitudes of the majority culture. As they grow, adolescents in ethnic minority groups often become increasingly aware of stereotypes, social biases, and discrimination, all of which...
59
Radical Formation: Abstraction
3.5K
The electron of an atom can be abstracted from a compound by a relatively unstable radical to generate a new radical of relatively greater stability. For example, an initiator which forms radicals by homolysis can abstract a suitable species like a hydrogen atom or a halogen atom from a compound to generate a new radical. This ability of radicals to propagate by abstraction is a crucial feature of radical chain reactions.
Even though homolysis produces radicals, it is different from radical...
Even though homolysis produces radicals, it is different from radical...
3.5K
Resonance and Hybrid Structures
17.0K
According to the theory of resonance, if two or more Lewis structures with the same arrangement of atoms can be written for a molecule, ion, or radical, the actual distribution of electrons is an average of that shown by the various Lewis structures.
Resonance Structures and Resonance Hybrids
The Lewis structure of a nitrite anion (NO2−) may actually be drawn in two different ways, distinguished by the locations of the N–O and N=O bonds.
Resonance Structures and Resonance Hybrids
The Lewis structure of a nitrite anion (NO2−) may actually be drawn in two different ways, distinguished by the locations of the N–O and N=O bonds.
17.0K
Radical Formation: Homolysis
3.6K
A bond is formed between two atoms by sharing two electrons. When this bond is broken by supplying sufficient energy, either two electrons can be taken up by one atom forming ions by the cleavage called heterolysis, or the two electrons are shared by two atoms, with one each creating radicals by the cleavage called homolysis.
3.6K
Synesthesia
156
Synesthesia is a remarkable condition where stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. People with synesthesia experience a blending or crossing of their senses, such as sight and sound, leading to cross-modal sensations. In this condition, the stimulation of one sense, such as hearing a number or musical note, triggers an experience of another sense, like sensing a specific color, taste, or smell. People...
156
Radical Formation: Addition
1.7K
Radicals can be formed by adding a radical to a spin-paired molecule. This is typically observed with unsaturated species, where the addition of a radical across the π bond leads to the production of a new radical by dissolving the π bond. For example, the addition of a Br radical to an alkene yields a carbon-centered radical.
Similar to charge conservation in chemical reactions, spin conservation is implicit for radical reactions. Accordingly, the product formed must possess an...
Similar to charge conservation in chemical reactions, spin conservation is implicit for radical reactions. Accordingly, the product formed must possess an...
1.7K
