Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Parallel Processing01:20

Parallel Processing

151
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
151
Visual System01:26

Visual System

582
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
582
Vision01:24

Vision

53.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.3K
Perception01:28

Perception

458
Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
458
Anatomy of the Eyeball01:20

Anatomy of the Eyeball

7.1K
The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle...
7.1K
The Retina01:32

The Retina

69.1K
The retina is a layer of nervous tissue at the back of the eye that transduces light into neural signals. This process, called phototransduction, is carried out by rod and cone photoreceptor cells in the back of the retina.
69.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Ultrabroadband Silicon-Based Infrared Detectors by Integrating with Multilayer Graphene.

ACS applied materials & interfaces·2026
Same author

High-throughput chiral copper foils by curved-surface confinement recrystallization.

Nature communications·2026
Same author

Highly Efficient Conductivity Modulation via Stacked Multi-Gate Graphene Ambipolar Transistors.

Nanomaterials (Basel, Switzerland)·2026
Same author

Twist-stacked black phosphorus for wide-spectral chiral photodetection.

Nature communications·2026
Same author

Pushing Photodetection Beyond the Limit of Silicon PIN Junctions Through In Situ Integration of Randomly Interlinked Gold Nanoparticles and Black Silicon.

ACS applied materials & interfaces·2025
Same author

Emerging Thermal Detectors Based on Low-Dimensional Materials: Strategies and Progress.

Nanomaterials (Basel, Switzerland)·2025
Same journal

Erratum for the Research Article "Assessing the health risks of rice cadmium content standards in China" by H. Chu <i>et al</i>.

Science advances·2026
Same journal

Erratum for the Research Article "Developmental regulation of Erk signaling by mitotic kinases" by F. Chen <i>et al</i>.

Science advances·2026
Same journal

Magnetically levitated metasurface enabling tangible and bidirectional human-machine interaction.

Science advances·2026
Same journal

A general photoinduced manganese-catalyzed platform for the sequential difunctionalization of [1.1.1]propellane.

Science advances·2026
Same journal

Turning sound and force into light with AlN:Mn<sup>2+</sup> mechanoluminescence.

Science advances·2026
Same journal

Extreme dominance of Earth-origin heavy ions in the intense ring current near the Earth during the May 2024 super geomagnetic storm.

Science advances·2026
See all related articles

Related Experiment Video

Updated: Jul 2, 2025

Fabrication of Flexible Image Sensor Based on Lateral NIPIN Phototransistors
09:59

Fabrication of Flexible Image Sensor Based on Lateral NIPIN Phototransistors

Published on: June 23, 2018

7.8K

Bionic visual-audio photodetectors with in-sensor perception and preprocessing.

Jintao Fu1,2, Changbin Nie1,2, Feiying Sun1

  • 1Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China.

Science Advances
|February 16, 2024
PubMed
Summary
This summary is machine-generated.

A novel visual-audio photodetector mimics human senses for the Internet of Things. This device integrates light and sound detection, enabling efficient, compact, and intelligent hardware systems.

More Related Videos

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare
06:34

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare

Published on: July 7, 2023

2.4K
Techniques for Processing Eyes Implanted with a Retinal Prosthesis for Localized Histopathological Analysis: Part 2 Epiretinal Implants with Retinal Tacks
10:00

Techniques for Processing Eyes Implanted with a Retinal Prosthesis for Localized Histopathological Analysis: Part 2 Epiretinal Implants with Retinal Tacks

Published on: February 14, 2015

11.6K

Related Experiment Videos

Last Updated: Jul 2, 2025

Fabrication of Flexible Image Sensor Based on Lateral NIPIN Phototransistors
09:59

Fabrication of Flexible Image Sensor Based on Lateral NIPIN Phototransistors

Published on: June 23, 2018

7.8K
A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare
06:34

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare

Published on: July 7, 2023

2.4K
Techniques for Processing Eyes Implanted with a Retinal Prosthesis for Localized Histopathological Analysis: Part 2 Epiretinal Implants with Retinal Tacks
10:00

Techniques for Processing Eyes Implanted with a Retinal Prosthesis for Localized Histopathological Analysis: Part 2 Epiretinal Implants with Retinal Tacks

Published on: February 14, 2015

11.6K

Area of Science:

  • Neuromorphic engineering
  • Integrated photonics and acoustics
  • Sensor technology

Background:

  • Current Internet of Things (IoT) hardware relies on discrete sensors, leading to complex and inefficient architectures.
  • Human sensory pathways offer a more integrated and efficient model for perception.
  • Existing sensor systems lack the ability to simultaneously process visual and acoustic data.

Purpose of the Study:

  • To propose a novel visual-audio photodetector inspired by human sensory systems.
  • To develop an all-in-one device for simultaneous visual and acoustic signal detection with integrated computing capabilities.
  • To demonstrate the potential for creating intelligent and compact hardware systems.

Main Methods:

  • Development of a gate-tunable photodetector capable of capturing both light and sound waves.
  • Implementation of programmable photoresponses (positive, negative, and zero) for tunable responsivity.
  • Integration of visual and acoustic sensing within a single hardware unit.

Main Results:

  • The device successfully performs simultaneous visual and acoustic signal detection, functioning as both a "camera" and "microphone".
  • Gate-tunability allows for highly programmable responsivities, enabling diverse computational functions.
  • Demonstrated capabilities include visual feature extraction, object classification, and sound wave manipulation.

Conclusions:

  • The proposed visual-audio photodetector offers a significant advancement over traditional discrete sensor systems.
  • This technology paves the way for more efficient, compact, and intelligent neuromorphic devices.
  • The integrated sensing and computing approach opens new avenues for IoT hardware development.