Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Neural Control of Respiration

Neural Control of Respiration

The neural regulation of respiration is a meticulously coordinated process primarily controlled by the respiratory centers located within the brainstem. These centers, composed of specialized neurons, transmit nerve impulses that control the contraction and relaxation of our respiratory muscles.
Respiratory Centers in the Brainstem
Two primary areas comprise the respiratory center: the medullary respiratory center in the medulla oblongata and the pontine respiratory group in the pons. The...

Feedback control systems

Feedback control systems

Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...

Physiological Control of Respiration

Physiological Control of Respiration

Introduction
Breathing, a seemingly passive process, is regulated by the respiratory center in the brainstem. This center coordinates the involuntary control of respirations, which means it occurs without conscious effort, ensuring a smooth and uninterrupted pattern.
Regulation of Ventilation
The body maintains ventilation by monitoring levels of carbon dioxide (CO2), oxygen (O2), and hydrogen ion concentration (pH) in the arterial blood. Among these factors, the level of CO2 plays a crucial...

Open and closed-loop control systems

Open and closed-loop control systems

Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...

Reinforcement

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

A Multi-Source Circular Geodesic Voting Model for Image Segmentation.

Entropy (Basel, Switzerland)·2025

Same author

An ECG Classification Method Based on Multi-Task Learning and CoT Attention Mechanism.

Healthcare (Basel, Switzerland)·2023

Same author

Interpatient ECG Arrhythmia Detection by Residual Attention CNN.

Computational and mathematical methods in medicine·2022

Same author

Automated Atrial Fibrillation Detection Based on Feature Fusion Using Discriminant Canonical Correlation Analysis.

Computational and mathematical methods in medicine·2021

Same author

An ECG Signal Classification Method Based on Dilated Causal Convolution.

Computational and mathematical methods in medicine·2021

Same author

Copper-mediated amidation of alkenylzirconocenes with acyl azides: formation of enamides.

Organic letters·2013

Same journal

RETRACTED: Zhang et al. A Novel Framework for Reconstruction and Imaging of Target Scattering Centers via Wide-Angle Incidence in Radar Networks. <i>Sensors</i> 2025, <i>25</i>, 6802.

Sensors (Basel, Switzerland)·2026

Same journal

Enhancing Unsupervised Multi-Source Domain Adaptation for Person Re-Identification via Mixture of Experts and Graph-Based Relation.

Sensors (Basel, Switzerland)·2026

Same journal

Development of an Instrumented Glove for Palmar Pressure Assessment in Kayakers.

Sensors (Basel, Switzerland)·2026

Same journal

Development and Experimental Validation of an Autonomous IoT-Based Monitoring System for Real-Time Water Quality Assessment in the Amazon River.

Sensors (Basel, Switzerland)·2026

Same journal

Semi-Supervised Adversarial Learning Framework for Controller Area Network Bus Intrusion Detection.

Sensors (Basel, Switzerland)·2026

Same journal

Smart Optimization Method for Safety Signs in Innovative Manufacturing Environments Integrating Industrial Field IoT Sensors and Knowledge Graphs.

Sensors (Basel, Switzerland)·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Aug 8, 2025

Author Spotlight: Exploring Breathing Techniques and Digital Solutions for Enhancing Running Performance

Author Spotlight: Exploring Breathing Techniques and Digital Solutions for Enhancing Running Performance

Published on: September 27, 2024

Constant Force-Tracking Control Based on Deep Reinforcement Learning in Dynamic Auscultation Environment.

Tieyi Zhang^1,2, Chao Chen^1,2, Minglei Shu^1,2

¹School of Mathematics and Statistics, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, China.

Sensors (Basel, Switzerland)

|February 28, 2023

Summary

This summary is machine-generated.

This study introduces a deep reinforcement learning approach for intelligent medical robots performing dynamic auscultation. The novel control strategy ensures safe and accurate constant force tracking during simulated and real-world medical examinations.

Keywords:

auscultation robot compliant control constant force-tracking deep reinforcement learning

More Related Videos

Force and Position Control in Humans - The Role of Augmented Feedback

Force and Position Control in Humans - The Role of Augmented Feedback

Published on: June 19, 2016

Tracking Rats in Operant Conditioning Chambers Using a Versatile Homemade Video Camera and DeepLabCut

Tracking Rats in Operant Conditioning Chambers Using a Versatile Homemade Video Camera and DeepLabCut

Published on: June 15, 2020

Related Experiment Videos

Last Updated: Aug 8, 2025

Author Spotlight: Exploring Breathing Techniques and Digital Solutions for Enhancing Running Performance

Author Spotlight: Exploring Breathing Techniques and Digital Solutions for Enhancing Running Performance

Published on: September 27, 2024

Force and Position Control in Humans - The Role of Augmented Feedback

Force and Position Control in Humans - The Role of Augmented Feedback

Published on: June 19, 2016

Tracking Rats in Operant Conditioning Chambers Using a Versatile Homemade Video Camera and DeepLabCut

Tracking Rats in Operant Conditioning Chambers Using a Versatile Homemade Video Camera and DeepLabCut

Published on: June 15, 2020

Area of Science:

Robotics
Artificial Intelligence
Medical Technology

Background:

Intelligent medical robots can assist healthcare professionals with diagnoses and treatments, addressing personnel shortages.
Dynamic medical auscultation presents challenges for robotic control due to the breathing process.

Purpose of the Study:

To investigate the application of deep reinforcement learning for dynamic medical auscultation tasks.
To develop a robust control strategy for intelligent medical robots in auscultation.

Main Methods:

A constant force-tracking control method for dynamic environments was proposed.
A physically characteristic modeling method was used to simulate dynamic breathing.
An optimal reward function was designed for efficient control strategy learning.

Main Results:

Simulation experiments showed tracking error within ±0.5 N for normal force.
Real-world tests demonstrated effective constant force-tracking in medical auscultation.
Contact force remained within a safe and stable range, averaging approximately 5.2 N.

Conclusions:

The developed deep reinforcement learning control strategy is effective for dynamic medical auscultation.
The approach ensures safe and stable robotic interaction during auscultation procedures.