A Lightweight Vision-Based Emotion Sensing Framework for Assistive Healthcare Robotics

Facial expression recognition (FER) for assistive and telepresence robotics remains challenging under resource-constrained conditions because landmark normalization is often unstable, many datasets have limited variability, and full facial landmark sets introduce redundancy. This paper proposes a lightweight, privacy-preserving FER framework for assistive healthcare robotics based on geometric facial landmarks rather than raw RGB images. The objective is to improve recognition robustness and deployment suitability on low-power edge devices through two complementary contributions: a revised nose-centered landmark normalization method and an optimized Facial Feature Mapping, FFM-L03. The proposed normalization replaces the expression-sensitive upper-lip reference with a geometrically stable nose-center anchor, while FFM-L03 combines FACS-guided anatomical priors with ANOVA F-score, LASSO, PCA, and t-SNE/UMAP to retain 60 informative landmarks. In addition, a heterogeneous Freepik dataset was constructed to increase variability in lighting, background, resolution, and subject appearance. Experimental evaluation across 15 landmark groups, four datasets, and four classifiers shows that the proposed method consistently improves performance over prior landmark configurations, achieving gains of up to 22.4 percentage points over the Ciraolo baseline and 22.1 percentage points over the full-landmark baseline in accuracy, precision, recall, and F1-score, while maintaining lightweight operation. These results demonstrate that principled normalization and targeted landmark selection can substantially improve FER for real-time, privacy-aware assistive robotic systems.