Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jun 11, 2026

Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification
07:47

Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification

Published on: February 14, 2018

Assisting the blind to reach daily objects using smart glasses.

Aditya Singh1,2, Meet Anil Bhanushali1,2, Jingwu Luo1,2

  • 1Schepens Eye Research Institute of Mass Eye & Ear, Boston MA.

Displays
|June 10, 2026
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Editorial: Neuromuscular disorders: biomarkers, precision diagnosis, and targeted therapeutics.

Frontiers in neuroscience·2026
Same author

Nanostructured implants for enhanced integration and localized therapy.

BioImpacts : BI·2026
Same author

Postnatal Care Utilisation Among Adolescent Mothers in India: A Pooled Cross-Sectional Study of NFHS-4 and NFHS-5.

Public health challenges·2026
Same author

Advances in evaluating and delivering nontechnical skills training: The use of simulation, robotics, artificial intelligence and virtual reality.

Current opinion in urology·2026
Same author

In vitro exposure to polystyrene microplastic induces oxidative stress mediated β-cell dysfunction.

Toxicology in vitro : an international journal published in association with BIBRA·2026
Same author

Intraoperative Neuromonitoring and Electrophysiological Nerve Stimulation for the Spinal Accessory and Marginal Mandibular Nerve During Neck Dissection: A Scoping Review.

The Journal of laryngology and otology·2026
Same journal

LightR-YOLOv5: A compact rotating detector for SARS-CoV-2 antigen-detection rapid diagnostic test results.

Displays·2023
Same journal

SELDNet: Sequenced encoder and lightweight decoder network for COVID-19 infection region segmentation.

Displays·2023
Same journal

COVID-19 chest X-ray image classification in the presence of noisy labels.

Displays·2023
Same journal

ViDMASK dataset for face mask detection with social distance measurement.

Displays·2022
Same journal

COVID-19 CT image recognition algorithm based on transformer and CNN.

Displays·2022
Same journal

Recognition efficiency of atypical cardiovascular readings on ECG devices through fogged goggles.

Displays·2022
See all related articles

This study introduces smart glasses that help blind and visually impaired individuals (BVI) find objects using directional audio cues. The novel assistive technology significantly reduces object-finding time compared to existing solutions.

Area of Science:

  • Human-Computer Interaction
  • Assistive Technology
  • Computer Vision

Background:

  • Searching for objects is difficult for blind and visually impaired individuals (BVI).
  • Current large language models (LLMs) and vision language models (VLMs) offer scene descriptions but lack spatial interpretation for efficient object interaction.
  • General-purpose models are not optimized for conveying spatial information crucial for daily tasks.

Purpose of the Study:

  • To develop and evaluate a smart glass solution using open-vocabulary object detection for aiding BVI in searching and reaching for specific objects.
  • To provide hands-free, natural interaction with the environment for BVI.
  • To improve the efficiency and accuracy of object localization for BVI.

Main Methods:

  • Developed smart glasses processing video streams via local or connected devices with open-vocabulary object detection models.
Keywords:
activities of daily livingobject detectionopen vocabulary object detectionsmart glassesvision language modelwearable assistive technology

More Related Videos

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare
06:34

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare

Published on: July 7, 2023

Subjective Refraction Test Using a Smartphone for Vision Screening
05:36

Subjective Refraction Test Using a Smartphone for Vision Screening

Published on: October 18, 2024

Related Experiment Videos

Last Updated: Jun 11, 2026

Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification
07:47

Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification

Published on: February 14, 2018

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare
06:34

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare

Published on: July 7, 2023

Subjective Refraction Test Using a Smartphone for Vision Screening
05:36

Subjective Refraction Test Using a Smartphone for Vision Screening

Published on: October 18, 2024

  • Implemented a hands-free interface allowing verbal custom search prompts and head-based scanning.
  • Integrated stereo audio tones for horizontal and vertical directional cues to guide users to targets.
  • Conducted a pilot study with 5 blindfolded participants comparing the smart glasses solution against Meta glasses with built-in AI.

    • Main Results:

    • The smart glasses solution achieved an average task time of 53 seconds, significantly faster than Meta glasses (126 seconds, p<0.001).
    • Demonstrated successful assistance for a blind user in a grocery shopping scenario.
    • Validated the effectiveness of active orientation guidance in improving object interaction for BVI.

    Conclusions:

    • The developed smart glasses provide effective active orientation guidance, a feature often missing in current VLMs.
    • This solution significantly enhances the ability of BVI to interact with their surroundings, specifically for reaching objects and destinations.
    • The technology shows promise for improving independence and daily living for individuals with visual impairments.