Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jun 8, 2026

Efficiently Recording the Eye-Hand Coordination to Incoordination Spectrum
07:30

Efficiently Recording the Eye-Hand Coordination to Incoordination Spectrum

Published on: March 21, 2019

RECOGNIZING BEHAVIOR IN HAND-EYE COORDINATION PATTERNS.

Weilie Yi1, Dana Ballard

  • 1Microsoft Corporation One Microsoft Way, Redmond, WA 98052, USA, weiliey@microsoft.com.

International Journal of HR : Humanoid Robotics
|September 24, 2010
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Humans use minimum cost movements in a whole-body task.

Scientific reports·2021
Same author

Human Gaze Assisted Artificial Intelligence: A Review.

IJCAI : proceedings of the conference·2020
Same author

Modeling task control of eye movements.

Current biology : CB·2014
Same author

Eye movements, visual search and scene memory, in an immersive virtual environment.

PloS one·2014
Same author

Predicting human visuomotor behaviour in a driving task.

Philosophical transactions of the Royal Society of London. Series B, Biological sciences·2014
Same author

The role of uncertainty and reward on eye movements in a virtual driving task.

Journal of vision·2012
Same journal

Active Segmentation.

International journal of HR : humanoid robotics·2010
Same journal

A PHYSIOLOGIST'S PERSPECTIVE ON ROBOTIC EXOSKELETONS FOR HUMAN LOCOMOTION.

International journal of HR : humanoid robotics·2008
See all related articles

Researchers developed a dynamic Bayes network (DBN) to model complex human behaviors, enabling real-time recognition of task performance, including hand, head, and eye coordination.

Area of Science:

  • Robotics and Human-Computer Interaction
  • Artificial Intelligence and Machine Learning
  • Cognitive Science and Behavioral Modeling

Background:

  • Accurate modeling of human behavior is crucial for designing intuitive robots and human-computer interfaces (HCIs).
  • Existing constructive models often lack the detailed, moment-to-moment coordination of hand, head, and eye movements observed in complex human tasks.
  • Understanding and replicating these intricate behavioral dynamics is a significant challenge in HCI and robotics.

Purpose of the Study:

  • To develop a computational model capable of capturing the detailed structure of human behavior during complex tasks.
  • To demonstrate a method for programming a dynamic Bayes network (DBN) using observational data of human task performance.
  • To enable real-time recognition of human actions and task instances using the developed DBN.

More Related Videos

Quantification of Visual Feature Selectivity of the Optokinetic Reflex in Mice
09:28

Quantification of Visual Feature Selectivity of the Optokinetic Reflex in Mice

Published on: June 23, 2023

Eye-Tracking Control to Assess Cognitive Functions in Patients with Amyotrophic Lateral Sclerosis
07:00

Eye-Tracking Control to Assess Cognitive Functions in Patients with Amyotrophic Lateral Sclerosis

Published on: October 13, 2016

Related Experiment Videos

Last Updated: Jun 8, 2026

Efficiently Recording the Eye-Hand Coordination to Incoordination Spectrum
07:30

Efficiently Recording the Eye-Hand Coordination to Incoordination Spectrum

Published on: March 21, 2019

Quantification of Visual Feature Selectivity of the Optokinetic Reflex in Mice
09:28

Quantification of Visual Feature Selectivity of the Optokinetic Reflex in Mice

Published on: June 23, 2023

Eye-Tracking Control to Assess Cognitive Functions in Patients with Amyotrophic Lateral Sclerosis
07:00

Eye-Tracking Control to Assess Cognitive Functions in Patients with Amyotrophic Lateral Sclerosis

Published on: October 13, 2016

Main Methods:

  • Collected detailed kinematic and observational data from human subjects performing a complex task (e.g., sandwich making).
  • Utilized this data to program a dynamic Bayes network (DBN), a probabilistic graphical model suitable for sequential data.
  • Implemented the DBN for real-time inference and recognition of task performance instances.

Main Results:

  • The programmed DBN successfully captured the nuanced, moment-to-moment coordination of hand, head, and eye gaze.
  • The DBN demonstrated the ability to recognize new instances of task performance in real time.
  • Specific complex activities, such as sandwich making, were accurately recognized by the DBN.

Conclusions:

  • Dynamic Bayes networks provide a powerful framework for modeling and recognizing complex human behaviors.
  • This approach advances the development of more sophisticated and responsive robots and human-computer interfaces.
  • Real-time recognition of human actions using DBNs opens new possibilities for intelligent systems and assistive technologies.