Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Towards generalizable contactless oximetry from multispectral video via deep domain-adaptive learning strategy.

Biomedical optics express·2026
Same author

Assessing PCA and band selection approaches in hyperspectral classification of construction waste.

Waste management (New York, N.Y.)·2026
Same author

Accurate high-speed thermal 3D shape measurement of transparent objects.

Optics express·2025
Same author

Multi-Task Deep Learning Approach for Contactless Simultaneous Heart Rate and Oxygen Saturation Estimation.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same author

Dataset for weld seam analysis and discontinuity prediction in laser beam welding scenarios.

Data in brief·2025
Same author

Photometrically optimized event-based stereo 3D measurements.

Optics express·2025

Related Experiment Video

Updated: Aug 4, 2025

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
13:44

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

13.9K

Interactive robot teaching based on finger trajectory using multimodal RGB-D-T-data.

Yan Zhang1, Richard Fütterer1, Gunther Notni1,2

  • 1Group for Quality Assurance and Industrial Image Processing, Technische Universität Ilmenau, Ilmenau, Germany.

Frontiers in Robotics and AI
|April 3, 2023
PubMed
Summary

This study introduces a new robot teaching method using multimodal 3D imaging. It accurately identifies hand/object contact points for efficient robot path calculation, improving precision and smoothness in Industry 4.0 manufacturing.

Keywords:
RGB-D-T-datafinger trajectory recognitionmeshless finite difference solutionmultimodal image processingpoint cloud processingrobot teaching

More Related Videos

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
05:12

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

Published on: September 18, 2017

546.4K
Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
08:15

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Published on: March 28, 2025

677

Related Experiment Videos

Last Updated: Aug 4, 2025

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
13:44

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

13.9K
Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
05:12

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

Published on: September 18, 2017

546.4K
Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
08:15

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Published on: March 28, 2025

677

Area of Science:

  • Robotics and Automation
  • Human-Computer Interaction
  • Computer Vision

Background:

  • Industry 4.0 demands more efficient and flexible manufacturing processes.
  • Traditional robot programming is complex, necessitating simpler teaching methods.
  • Multimodal sensing offers potential for enhanced robot interaction and control.

Purpose of the Study:

  • To develop an intuitive, finger-touch-based robot teaching schema.
  • To precisely identify hand/object contact points using multimodal 3D image processing.
  • To enable direct robot path calculation from identified contact points.

Main Methods:

  • Utilized a multimodal 3D image processing approach (color, thermal, point cloud).
  • Analyzed heat traces on object surfaces to identify contact points.
  • Employed anchor point prediction via point cloud segmentation and probability density functions.
  • Dynamically analyzed temperature near anchor points to determine likelihood of contact.

Main Results:

  • The proposed method accurately identifies true hand/object contact points.
  • Robot trajectories calculated using multimodal data showed superior accuracy and smoothness.
  • Performance was significantly better compared to methods using only point cloud or static temperature data.

Conclusions:

  • Multimodal 3D image processing enhances the precision and efficiency of robot teaching.
  • The interactive finger-touch schema offers a viable alternative to complex robot programming.
  • This approach contributes to the development of more flexible and intelligent manufacturing systems in Industry 4.0.