Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

The expert surgical assistant. An intelligent virtual environment with multimodal input.

M Billinghurst1, J Savage, P Oppenheimer

  • 1Human Interface Technology Laboratory, University of Washington, Seattle 98195, USA.

Studies in Health Technology and Informatics
|December 9, 1995
PubMed
Summary

This study introduces an intelligent virtual reality system that combines expert systems with voice and gesture recognition for surgical training. It offers real-time feedback and assistance, enhancing surgical simulation and clinical practice.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Just around the river bend: the fate of plastic bottle pollution in the Thames Estuary.

Marine pollution bulletin·2025
Same author

Big brands impact small islands: Sources of plastic pollution in a remote and protected archipelago.

Marine pollution bulletin·2024
Same author

Measuring particle size distribution and mass concentration of nanoplastics and microplastics: addressing some analytical challenges in the sub-micron size range.

Journal of colloid and interface science·2021
Same author

Microbiological investigation of the mandibular condyle in patients with advanced osteoarthritis of the temporomandibular joint.

Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery·2019
Same author

Assessing an oral surgery specific protocol for patients on direct oral anticoagulants: a retrospective controlled cohort study.

International journal of oral and maxillofacial surgery·2018
Same author

Evaluating the submission of digital images as a method of surveillance for Ixodes scapularis ticks.

Parasitology·2017

Area of Science:

  • Computer Science
  • Medical Simulation
  • Human-Computer Interaction

Background:

  • Virtual Reality (VR) enhances interface intuitiveness but lacks intelligence.
  • Current surgical training methods can be improved with intelligent simulation tools.

Purpose of the Study:

  • To develop an intelligent simulation tool or surgical assistant by coupling expert systems with multimodal input in a virtual environment.
  • To provide automatic feedback and assistance during surgical procedures.

Main Methods:

  • Interpreting voice and gestural input into a common semantic form.
  • Utilizing a rule-based expert system to infer user actions and context.
  • Matching inferred actions to surgical procedures for progress monitoring and feedback.
  • Integrating multimodal commands for navigation and anatomical identification.

Related Experiment Videos

Main Results:

  • A prototype sinus surgery interface was developed.
  • The system demonstrated the ability to monitor user progress and provide automatic feedback.
  • The system can respond to commands for navigational assistance and identification of anatomical structures.

Conclusions:

  • Coupling expert systems with multimodal input in VR creates intelligent simulation tools.
  • This approach has potential for diverse medical and non-medical training applications.
  • Expert systems in VR surgery simulation can significantly benefit surgeons in training and practice.