具有传感器内感知和预处理的生物视觉音频光探测器
Jintao Fu1,2, Changbin Nie1,2, Feiying Sun1
1Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China.
Science advances
|February 16, 2024
概括
一个新的视觉音频光探测器模仿了物联网的人类感官. 该设备集成光和声音检测,使高效,紧,和智能硬件系统.
科学领域:
- 神经形态工程的神经形态工程
- 集成的光子学和声学.
- 传感器技术 传感器技术
背景情况:
- 目前的物联网 (IoT) 硬件依赖于离散传感器,导致复杂和低效的架构.
- 人类感官通路提供了一个更完整,更有效的感知模型.
- 现有的传感器系统缺乏同时处理视觉和声学数据的能力.
研究的目的:
- 提出一种新的视觉音频光探测器,灵感来源于人类感官系统.
- 开发一款全集设备,用于同时检测视觉和声学信号,并集成计算能力.
- 展示创建智能和紧硬件系统的潜力.
主要方法:
- 开发一个能够捕捉光和声波的门调节式光探测器.
- 实现可编程的光响应 (正,负和零) 以实现可调节的响应.
- 在单个硬件单元中整合视觉和声学传感.
主要成果:
- 该设备成功地同时执行视觉和声学信号检测,同时作为"摄像头"和"麦克风".
- 网关调节性允许高度可编程的响应性,使各种计算功能成为可能.
- 展示的能力包括视觉特征提取,物体分类和声波操纵.
结论:
- 拟议的视觉音频光探测器在传统的离散传感器系统上提供了显著的进步.
- 这项技术为更高效,更紧,更智能的神经形态设备铺平了道路.
- 综合传感和计算方法为物联网硬件开发开辟了新的途径.
更多相关视频
06:34A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare
Published on: July 7, 2023
2.4K
10:00Techniques for Processing Eyes Implanted with a Retinal Prosthesis for Localized Histopathological Analysis: Part 2 Epiretinal Implants with Retinal Tacks
Published on: February 14, 2015
11.6K
相关概念视频
Parallel Processing
151
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
151
Visual System
582
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
582
Vision
53.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.3K
Perception
458
Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
458
Anatomy of the Eyeball
7.1K
The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle...
7.1K
The Retina
69.1K
The retina is a layer of nervous tissue at the back of the eye that transduces light into neural signals. This process, called phototransduction, is carried out by rod and cone photoreceptor cells in the back of the retina.
69.1K
