Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Vision

Vision

Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.

Depth Perception and Spatial Vision

Depth Perception and Spatial Vision

Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.

Visual System

Visual System

Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...

Focusing of Light in the Eye

Focusing of Light in the Eye

Light rays enter the eye through the cornea, a transparent dome-shaped tissue that is the eye's outermost layer. The cornea bends or refracts, light rays traveling to the pupil. The shape of the cornea determines how much of the light is bent and whether the image will be focused correctly on the retina at the back of the eye. Once the light has passed through both refraction layers, it converges into a single focal point onto a small area. This is where photoreceptors start transforming...

Parallel Processing

Parallel Processing

The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...

Angle Closure Glaucoma: Treatment

Angle Closure Glaucoma: Treatment

Angle-closure glaucoma, or closed-angle glaucoma, is an eye condition where the iris bulges out and blocks the iridocorneal angle, resulting in a buildup of aqueous humor and increased intraocular pressure. Immediate medical attention is necessary due to the sudden onset of symptoms. The treatment for angle-closure glaucoma includes short-term and long-term approaches. Short-term treatment involves using eye drops like pilocarpine to lower intraocular pressure by increasing aqueous humor...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Fertility Alteration Characteristics and Cytological Mechanisms of Pollen Abortion in Thermo-Photo-Sensitive Genic Male Sterile Wheat K64S.

Plants (Basel, Switzerland)·2026

Same author

Amphibian-inspired neuromorphic dynamic vision systems based on ferroelectric field-effect transistor.

Nature communications·2026

Same author

Dermal fibroblasts attenuate osteoarthritis by restoring synovial fibroblast homeostasis.

Journal of orthopaedic translation·2026

Same author

An all-optical signal processor enabling terabit-per-second real-time equalization.

Science (New York, N.Y.)·2026

Same author

High encoding-sensitivity vision sensor with complementary nonlinear neuromorphic computing.

Nature communications·2026

Same author

Photonic Mixture-of-Experts for scalable multi-task on-chip optical neural networks.

Nature communications·2026

Same journal

Inside the new political screening that's stalling NIH grants.

Nature·2026

Same journal

Europe's record heatwave: does the continent have a new climate?

Nature·2026

Same journal

Daily briefing: Humans and great apes giggle in the same rhythms.

Nature·2026

Same journal

The surprising career parallels between footballers and researchers.

Nature·2026

Same journal

I study World Cup penalty shoot-outs: they say a lot about the psychology of performance under pressure.

Nature·2026

Same journal

CRISPR's next act: the companies editing the epigenome to treat disease.

Nature·2026

See all related articles

Search research articles

Home
Optical Metasurfaces For General Vision Processing On The Edge.

Home
Optical Metasurfaces For General Vision Processing On The Edge.

Related Experiment Video

Demonstration of Equal-Intensity Beam Generation by Dielectric Metasurfaces

Demonstration of Equal-Intensity Beam Generation by Dielectric Metasurfaces

Published on: June 7, 2019

Optical metasurfaces for general vision processing on the edge.

Jiayong Peng¹, Mingcheng Luo¹, Yuxi Han¹

¹Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong.

|June 17, 2026

View abstract on PubMed

Summary

This summary is machine-generated.

Researchers developed a new optical neural network (ONN) that integrates computer vision principles onto an optical metasurface. This innovation enables high-accuracy, low-latency edge AI for real-time visual processing in natural scenes.

More Related Videos

Demonstration of Spin-Multiplexed and Direction-Multiplexed All-Dielectric Visible Metaholograms

Demonstration of Spin-Multiplexed and Direction-Multiplexed All-Dielectric Visible Metaholograms

Published on: September 25, 2020

Functional Magnetic Resonance Imaging (fMRI) of the Visual Cortex with Wide-View Retinotopic Stimulation

Functional Magnetic Resonance Imaging (fMRI) of the Visual Cortex with Wide-View Retinotopic Stimulation

Published on: December 8, 2023

Related Experiment Videos

Demonstration of Equal-Intensity Beam Generation by Dielectric Metasurfaces

Demonstration of Equal-Intensity Beam Generation by Dielectric Metasurfaces

Published on: June 7, 2019

Demonstration of Spin-Multiplexed and Direction-Multiplexed All-Dielectric Visible Metaholograms

Demonstration of Spin-Multiplexed and Direction-Multiplexed All-Dielectric Visible Metaholograms

Published on: September 25, 2020

Functional Magnetic Resonance Imaging (fMRI) of the Visual Cortex with Wide-View Retinotopic Stimulation

Functional Magnetic Resonance Imaging (fMRI) of the Visual Cortex with Wide-View Retinotopic Stimulation

Published on: December 8, 2023

Area of Science:

Photonics
Artificial Intelligence
Computer Vision

Background:

Large-scale AI models excel in computer vision but demand significant computational resources, hindering edge device deployment.
Optical neural networks (ONNs) offer reduced latency and energy use via light's parallelism but face scalability and task complexity limitations.
Current ONNs struggle to replicate digital models' precise algebraic operations in physical systems.

Purpose of the Study:

To introduce a novel paradigm for scalable, general-purpose computer vision at the edge by embedding core vision principles into optical hardware.
To develop a photonic-electronic engine that overcomes the limitations of existing ONNs.
To enable high-accuracy, low-energy, real-time visual processing on edge devices.

Main Methods:

Developed a large-scale optical metasurface integrating computer vision principles like similarity recognition and attention.
Created a photonic-electronic engine combining a 41-million-parameter optical front end with an 87,000-parameter digital back end.
Unified optical physics with computer vision fundamentals for enhanced processing capabilities.

Main Results:

The system demonstrated superior performance across object detection, segmentation, 3D reconstruction, and video understanding compared to digital models.
Achieved high-accuracy, general-purpose computer vision capabilities on edge devices.
Successfully built and demonstrated a deployable prototype for real-time edge visual processing in natural scenes.

Conclusions:

This work presents a viable path towards practical optical computing for complex, real-world vision tasks.
Enables a new paradigm for low-energy, low-latency, on-device vision intelligence.
Paves the way for widespread adoption of advanced AI on edge devices.