Related Experiment Video
Updated: Sep 16, 2025

07:46
Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
Published on: August 9, 2024
853
SRT-H: A hierarchical framework for autonomous surgery via language-conditioned imitation learning.
Ji Woong Brian Kim1, Juo-Tung Chen1, Pascal Hansen1
1Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD 21218, USA.
Science Robotics
|July 9, 2025
Summary
This study introduces a hierarchical framework for autonomous surgery, enabling robots to perform complex procedures like cholecystectomy with 100% success. The system uses language-based planning for improved error recovery in real-world surgical tasks.
Area of Science:
- Robotics
- Artificial Intelligence
- Surgical Technology
Background:
- Current autonomous surgery research is limited to simple tasks in controlled settings.
- Real-world surgery requires dexterity, long-term operation, and adaptability to tissue variability, which existing methods struggle with.
Purpose of the Study:
- To develop a hierarchical framework for dexterous, long-horizon autonomous surgical procedures.
- To enable robots to generalize to the variability of human tissue and recover from errors.
Main Methods:
- A hierarchical framework with a high-level task planning policy and a low-level trajectory generation policy.
- The high-level planner uses language space for task instructions and error correction.
- Validation through ex vivo cholecystectomy experiments and ablation studies.
Main Results:
- Achieved a 100% success rate in autonomous ex vivo cholecystectomy on eight gallbladders.
- Demonstrated improved error recovery from suboptimal states in dynamic surgical environments.
- The hierarchical approach enhanced policy robustness for realistic surgical applications.
Conclusions:
- The proposed framework enables step-level autonomy in surgical procedures.
- This research marks a significant advancement toward the clinical deployment of autonomous surgical systems.
- The language-guided hierarchical approach is effective for complex, long-horizon surgical tasks.
Related Concept Videos
Hierarchy of Motor Control
3.7K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
3.7K
Observational Learning
318
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
318
Purposive Learning
208
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
208

