Related Experiment Video
Updated: Aug 5, 2025

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
Published on: January 26, 2024
Preprocessing for Keypoint-Based Sign Language Translation without Glosses
Youngmin Kim1, Hyeongboo Baek1
1Department of Computer Science and Engineering, Incheon National University (INU), Incheon 22012, Republic of Korea.
Abstract:
While machine translation for spoken language has advanced significantly, research on sign language translation (SLT) for deaf individuals remains limited. Obtaining annotations, such as gloss, can be expensive and time-consuming. To address these challenges, we propose a new sign language video-processing method for SLT without gloss annotations. Our approach leverages the signer's skeleton points to identify their movements and help build a robust model resilient to background noise. We also introduce a keypoint normalization process that preserves the signer's movements while accounting for variations in body length. Furthermore, we propose a stochastic frame selection technique to prioritize frames to minimize video information loss. Based on the attention-based model, our approach demonstrates effectiveness through quantitative experiments on various metrics using German and Korean sign language datasets without glosses.
More Related Videos
Related Concept Videos
pre-mRNA Processing
Once about 20-40 ribonucleotides have been joined together by RNA polymerase, a group of enzymes adds a “cap” to the 5’ end of the growing transcript. In this process, a 5’ phosphate is replaced by modified guanosine that has a methyl group attached to it (7-Methyl...
Introduction to the Sign Test
Genetic Lingo
Improving Translational Accuracy
Initiation of Translation
Sign Convention
The normal force acts perpendicular to the beam's cross-section and can...

