Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Visual System01:26

Visual System

Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Parallel Processing01:20

Parallel Processing

The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
Vision01:24

Vision

Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
Association Areas of the Cortex01:21

Association Areas of the Cortex

Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Photoreceptors and Visual Pathways01:22

Photoreceptors and Visual Pathways

At the molecular level, visual signals trigger transformations in photopigment molecules, resulting in changes in the photoreceptor cell's membrane potential. The photon's energy level is denoted by its wavelength, with each specific wavelength of visible light associated with a distinct color. The spectral range of visible light, classified as electromagnetic radiation, spans from 380 to 720 nm. Electromagnetic radiation wavelengths exceeding 720 nm fall under the infrared category, whereas...
Anatomy of the Eyeball01:20

Anatomy of the Eyeball

The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle layer, the vascular tunic,...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Structure-guided allosteric modulation of the delta opioid receptor.

bioRxiv : the preprint server for biology·2025
Same author

Face and Available Chair Detection and Localization With a Second-Generation (44-Channel) Suprachoroidal Retinal Prosthesis.

Translational vision science & technology·2025
Same author

Navigational outcomes with a depth-based vision processing algorithm in a second-generation suprachoroidal retinal prosthesis.

Journal of neural engineering·2025
Same author

A Second-Generation (44-Channel) Suprachoroidal Retinal Prosthesis: A Single-Arm Clinical Trial of Feasibility.

Ophthalmology science·2024
Same author

Weakly-Supervised Contrastive Learning for Unsupervised Object Discovery.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2024
Same author

An Energy-Based Prior for Generative Saliency.

IEEE transactions on pattern analysis and machine intelligence·2023
Same journal

Analysis of End-Tidal CO2 Variability During Plateau Waves Episodes: An Information Theoretic Approach<sup></sup>.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

AI and Tomosynthesis for Breast Cancer Molecular Subtyping: A step toward precision medicine<sup></sup>.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

Towards Sustainable Protein Recovery from Biological Waste: Assessing Polyethersulfone-based Microfiltration.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

Analysis of the cardiovascular response to standardized polymicrobial peritonitis experimental model.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

Automated Wrist Ultrasound Image Bone Enhancement and Segmentation Using Deep Learning.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

A Deep Learning approach for Depressive Symptoms assessment in Parkinson's disease patients using facial videos.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
See all related articles

Related Experiment Video

Updated: May 25, 2026

Techniques for Processing Eyes Implanted with a Retinal Prosthesis for Localized Histopathological Analysis: Part 2 Epiretinal Implants with Retinal Tacks
10:00

Techniques for Processing Eyes Implanted with a Retinal Prosthesis for Localized Histopathological Analysis: Part 2 Epiretinal Implants with Retinal Tacks

Published on: February 14, 2015

A salient information processing system for bionic eye with application to obstacle avoidance.

Ashley Stacey1, Yi Li, Nick Barnes

  • 1College of Engineering and Computer Science, Australian National University, Canberra, ACT, Australia 2601. ashley.stacey@anu.edu.au

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
|January 19, 2012
PubMed
Summary
This summary is machine-generated.

This article introduces a portable visual processing system designed to help individuals with bionic eye implants navigate their surroundings by identifying obstacles in real-time. Because current implants provide very low image resolution, the system uses advanced algorithms to highlight important visual information, which is then displayed to the user to assist with daily movement.

Keywords:
visual prosthesisassistive navigationimage processingneural stimulation

Frequently Asked Questions

More Related Videos

VisualEyes: A Modular Software System for Oculomotor Experimentation
10:41

VisualEyes: A Modular Software System for Oculomotor Experimentation

Published on: March 25, 2011

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare
06:34

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare

Published on: July 7, 2023

Related Experiment Videos

Last Updated: May 25, 2026

Techniques for Processing Eyes Implanted with a Retinal Prosthesis for Localized Histopathological Analysis: Part 2 Epiretinal Implants with Retinal Tacks
10:00

Techniques for Processing Eyes Implanted with a Retinal Prosthesis for Localized Histopathological Analysis: Part 2 Epiretinal Implants with Retinal Tacks

Published on: February 14, 2015

VisualEyes: A Modular Software System for Oculomotor Experimentation
10:41

VisualEyes: A Modular Software System for Oculomotor Experimentation

Published on: March 25, 2011

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare
06:34

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare

Published on: July 7, 2023

Area of Science:

  • Biomedical engineering and salient information processing systems
  • Assistive technology within sensory restoration research

Background:

Current visual restoration technologies face significant limitations regarding the resolution provided by electrical stimulation devices. Researchers struggle to translate low-density electrode arrays into meaningful environmental awareness for users. This gap motivated the development of specialized processing units capable of interpreting complex surroundings. Prior work has often overlooked the specific constraints imposed by limited pixel counts in implantable hardware. No prior work had resolved how to effectively distill visual data for patients with severe vision loss. That uncertainty drove the need for systems that prioritize essential environmental features over raw image fidelity. It was already known that standard camera feeds overwhelm the limited input capacity of existing bionic hardware. This study addresses the challenge of creating a bridge between high-resolution environmental data and low-resolution neural stimulation.

Purpose Of The Study:

This study aims to develop a visual processing system that assists individuals with bionic eye implants in navigating their environment. The researchers address the significant challenge of low image resolution inherent in current electrical stimulation hardware. They seek to create a method that extracts critical information from complex scenes to facilitate safe movement. The motivation stems from the need to improve daily task performance for people living with blindness. By focusing on obstacle avoidance, the team intends to provide a practical solution for real-world navigation. They explore how advanced algorithms can compensate for the limited pixel density of existing devices. The project investigates whether a portable setup can effectively process and display salient visual data in real-time. This work establishes a framework for enhancing the utility of visual prosthetics through intelligent information filtering.

Main Methods:

The team constructed a fully portable assembly to evaluate their visual processing framework in controlled settings. They utilized a high-definition camera to capture continuous video streams of the surrounding area. A laptop served as the computational engine, executing a sophisticated algorithm to extract key visual markers. This approach prioritized the identification of potential hazards within the field of view. The experimental setup featured various household objects arranged on a textured surface to mimic realistic navigation challenges. Researchers monitored how the software transformed raw footage into simplified, high-contrast representations. They employed a head-mounted display to project these processed results, simulating the output intended for a user. This methodology focused on validating the efficiency of the pipeline from initial capture to final visualization.

Main Results:

The system effectively identifies obstacles within the environment, providing actionable data for navigation. The processing pipeline successfully converts complex visual input into a format suitable for low-resolution hardware. Experimental trials involving shoes, boxes, and foot stands confirm the capability of the software to isolate relevant objects. The architecture maintains efficiency throughout the transformation process, ensuring that the visual output remains timely for the user. By focusing on salient features, the system overcomes the constraints of 100 electrode arrays. This performance demonstrates that the algorithm can distill 12 by 9 pixel representations into meaningful guidance. The findings indicate that the integration of these components supports the detection of hazards on textured ground planes. The results confirm that the proposed method offers a functional bridge for current electrical stimulation devices.

Conclusions:

The authors propose that their portable architecture successfully bridges the gap between limited hardware resolution and environmental navigation needs. They suggest that prioritizing salient visual features allows for effective obstacle detection despite low pixel counts. The system demonstrates that real-time processing of camera feeds remains feasible for mobile assistive applications. Researchers indicate that their approach provides actionable feedback for users navigating unknown spaces. The findings imply that algorithmic filtering serves as a viable strategy for enhancing visual prosthetic utility. The team concludes that their implementation supports daily task performance by simplifying complex visual scenes. They maintain that this processing framework offers a practical solution for current implant limitations. The evidence suggests that such systems could improve independence for individuals living with blindness.

The researchers propose a saliency detection algorithm that filters complex visual input into a simplified format. This mechanism allows the system to highlight critical environmental features, such as obstacles, which are then relayed to the user despite the low resolution of the electrical stimulation device.

The setup utilizes a camera for video capture, a laptop for executing the processing algorithm, and a head-mounted display for visualization. This portable configuration allows for real-time interaction with the environment, distinguishing it from static or non-portable laboratory setups.

A high-density representation is necessary because current implant technology is restricted to approximately 100 electrode arrays. This limitation results in a very low resolution, roughly 12 by 9 pixels, making direct image transmission ineffective for safe navigation.

The laptop acts as the central processing hub, running the saliency detection software. It transforms raw video data into a simplified visual map, which is a vital step before the information is transmitted to the head-mounted display.

The researchers measured the system's performance by testing its ability to identify objects like boxes, shoes, and foot stands. These items were placed on a textured ground plane to simulate challenging, real-world conditions for navigation.

The authors claim that their approach provides useful information for daily tasks. They propose that this method effectively assists patients by converting complex visual scenes into a format compatible with the constraints of existing electrical stimulation devices.