Related Experiment Videos
Bio-Inspired Phase-Aware Skill Graph for Robust Long-Horizon Robotic Manipulation with Promptable Control
Jincheng Sun1,2, Yang Luo2,3, Yaqi Chu2,3
1College of Information Science and Engineering, Northeastern University, Shenyang 110819, China.
Abstract:
Long-horizon robotic manipulation requires coordinating multiple motor primitives under uncertainty, especially in contact-rich and changing environments. Existing end-to-end visuomotor policies often lack explicit temporal structure, causing brittle execution and limited recovery after disturbances. Inspired by biological motor control, where reusable primitives are organized through phase decomposition and feedback-dependent transitions, we propose a bio-inspired phase-aware framework that represents execution as structured transitions over perception-grounded motor phases. The framework integrates three modules: a Multimodal Phase-and-Primitive Detector that extracts semantically and physically consistent phases from visual, proprioceptive, and force-torque signals; a Multimodal Perception Skill Graph (MPSG) that encodes feasible phase transitions and supports skipping, rollback, and recovery; and Promptable Phase Control, which converts language instructions into graph-level ordering constraints for task reordering without retraining low-level policies. Experiments on four multi-stage tasks show improved robustness, increasing the average disturbed-condition success rate from 25.0% to 73.8% relative to the monolithic Action Chunking with Transformers (ACT) baseline.
Related Concept Videos
Open and closed-loop control systems
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal and...
Hierarchy of Motor Control
Sequence Networks of Rotating Machines
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Phase-lead and Phase-lag Controllers
One-Degree-of-Freedom System
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
Control Systems
At the heart...