Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Toward automatic robot programming: learning human skill from visual data.

M Yeasin1, S Chaudhuri

  • 1Dept. of Electr. & Comput. Eng., Miami Univ., Coral Gables, FL.

IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society
|February 5, 2008
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A Multiscale Inelastic Internal State Variable Corrosion Model.

Materials (Basel, Switzerland)·2024
Same author

Can a shock-induced phonon up-pumping model relate to impact sensitivity of molecular crystals, polymorphs and cocrystals?

RSC advances·2022
Same author

A flexible-molecule force field to model and study hexanitrohexaazaisowurtzitane (CL-20) - polymorphism under extreme conditions.

RSC advances·2022
Same author

Improved predictions of thermomechanical properties of molecular crystals from energy and dispersion corrected DFT.

The Journal of chemical physics·2021
Same author

Half metallicity in Cr substituted Fe<sub>2</sub>TiSn.

Scientific reports·2021
Same author

T11TS immunotherapy potentiates the repressed calcineurin-NFAT signalling pathway of T cells in Cryptococcus neoformans infected rats: a cue towards T-cell activation for antifungal immunity.

Journal of applied microbiology·2020
Same journal

Strategic Ability Updating in Concurrent Games by Coalitional Commitment.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2015
Same journal

Meta-Analysis of the First Facial Expression Recognition Challenge.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Adjustable model-based fusion method for multispectral and panchromatic images.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Face Feature Weighted Fusion Based on Fuzzy Membership Degree for Video Face Recognition.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

A New Adaptive Fast Cellular Automaton Neighborhood Detection and Rule Identification Algorithm.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Human-arm-and-hand-dynamic model with variability analyses for a stylus-based haptic interface.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
See all related articles

This study introduces a new robot programming method using a binocular vision system and color stickers to track hand movements. This approach enables robots to learn tasks through human demonstration, optimizing robot pathfinding.

Area of Science:

  • Robotics
  • Computer Vision
  • Machine Learning

Background:

  • Robot programming traditionally requires complex coding.
  • Learning from demonstration (LfD) offers a more intuitive approach.
  • Integrating vision systems enhances LfD capabilities.

Purpose of the Study:

  • To develop a novel method for robot programming via human demonstration.
  • To utilize a binocular vision system for tracking hand and end-effector movements.
  • To enable robots to learn tasks from visual input.

Main Methods:

  • Employing a binocular vision system with color-coded markers on fingertips and wrist.
  • Utilizing a simultaneous feature detection and tracking framework.
  • Implementing a Kalman filter for feature tracking and higher-order statistics (HOS)-based clustering for feature extraction.

Related Experiment Videos

  • Introducing the concept of a trajectory bundle to manage singularities and optimize paths.

    • Main Results:

    • Successfully extracted trajectories and orientation information of the end effector from binocular video sequences.
    • Developed a fast and efficient vision system algorithm for real-time processing.
    • Demonstrated the ability to program robots through visual demonstration.

    Conclusions:

    • The proposed method offers an intuitive and efficient way to program robots.
    • Vision-based learning from demonstration can significantly simplify robot task acquisition.
    • The trajectory bundle concept aids in generating optimal and singularity-free robot paths.