人形智能显示平台用于视听互动和声音识别
Yang Wang1, Wenli Gao1, Shuo Yang1
1School of Physical Science and Technology, ShanghaiTech University, 393 Middle Huaxia Road, Shanghai, 201210, People's Republic of China.
Nano-micro letters
|October 9, 2023
概括
这项研究介绍了一个可伸缩的,类似皮肤的智能显示平台,用于人机界面. 它使用人工智能从声音中高准确地识别动物物种,从而实现视听互动.
科学领域:
- 材料科学 材料科学 材料科学
- 人与机器接口 人与机器接口
- 人工智能的人工智能
背景情况:
- 开发先进的人机接口需要具有人性化的机械性能和智能功能的材料.
- 现有的接口往往缺乏必要的灵活性和响应能力,以在不同的环境中实现无互动.
研究的目的:
- 设计,制造和整合具有皮肤类机械特性的人形智能显示平台 (HIDP).
- 通过机器学习和物联网,实现视听互动和准确的动物物种识别.
- 探索软机器人,可穿戴系统和辅助设备中的应用.
主要方法:
- 使用可伸缩的弹性体和丝纤维蛋白离子弹性体制造三明治结构.
- 集成发光层和表面电极以实现显示功能.
- 实现基于声音振幅和频率的机器学习算法和物联网 (IoT) 的视听互动和物种识别.
主要成果:
- HIDP具有高度伸展性和弹性,具有与皮肤类似的机械特性,适用于极端环境.
- 从声音中准确识别动物物种,在200多次测试中达到约100%的准确性.
- 实时识别动物物种及其频率的准确性分别达到99%和93%左右.
结论:
- 该研究提出了一个可行的策略,用于创建具有视听互动能力的智能显示设备.
- 开发的HIDP展示了推进人机交互,软机器人和医疗设备的潜力.
- 这项工作为更加集成和响应的智能显示技术铺平了道路.
相关概念视频
Perceiving Loudness, Pitch, and Location
226
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
226
Perception of Sound Waves
4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Auditory Perception
351
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
351
Visual System
607
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
607
Design Example
334
The innovation of touch-tone telephony revolutionized the telecommunications industry by replacing the traditional rotary dial with a dual-tone multi-frequency (DTMF) signaling system. This system uses a matrix-style keypad with buttons arranged in four rows and three columns, creating 12 distinct signals each assigned to a pair of frequencies. Each button press results in a simultaneous generation of two sinusoidal tones – one from a low-frequency group (697 to 941 Hz) and one from a...
334
Hearing
52.4K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.4K


