An artificial sensory neuron with visual-haptic fusion.

Changjin Wan1, Pingqiang Cai1, Xintong Guo1

  • 1Innovative Center for Flexible Devices (iFLEX), Max Planck - NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 639798, Singapore, Singapore.

Nature Communications
|September 15, 2020
PubMed
Summary

Researchers have created an artificial sensory neuron that combines visual and touch information, similar to how human nervous systems process multiple senses to understand the world. This device uses light and pressure sensors to collect data, which is then processed by a specialized transistor to control robotic movements. This technology could improve future cyborg and robotic systems by giving them more human-like perception.

Frequently Asked Questions

Related Concept Videos

Tactile and Chemical Senses01:27

Tactile and Chemical Senses

Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex.
547
Somatosensation01:33

Somatosensation

The somatosensory system relays sensory information from the skin, mucous membranes, limbs, and joints. Somatosensation is more familiarly known as the sense of touch. A typical somatosensory pathway includes three types of long neurons: primary, secondary, and tertiary. Primary neurons have cell bodies located near the spinal cord in groups of neurons called dorsal root ganglia. The sensory neurons of ganglia innervate designated areas of skin called dermatomes.
42.5K
Vision01:24

Vision

Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
58.9K
Visual System01:26

Visual System

Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
1.5K
Sensory Modalities01:15

Sensory Modalities

Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
3.5K
Sensory Perception: Organization of the Somatosensory System01:11

Sensory Perception: Organization of the Somatosensory System

The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the...
10.7K