Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Load-frequency control01:28

Load-frequency control

642
Load-frequency control (LFC) is vital for maintaining power system stability, ensuring that frequency and power flows remain within acceptable limits during load changes. Turbine-governor control eliminates rotor accelerations and decelerations following load changes. However, a steady-state frequency error persists when the change in the turbine-governor reference setting is zero. In an interconnected power system, each area agrees to export or import a scheduled amount of power through...
642
Frequency-Domain Interpretation of PD Control01:24

Frequency-Domain Interpretation of PD Control

356
Proportional-Derivative (PD) controllers are widely used in fan control systems to improve stability and performance. A fan control system can be effectively represented using a Bode plot to illustrate the impact of a PD controller through its transfer function. The Bode plot visually conveys how PD control modifies the fan's response across various frequencies, providing a frequency domain interpretation of the controller's behavior.
The proportional control gain, combined with the...
356
Compact Bone01:27

Compact Bone

16.2K
Most bones contain compact and spongy osseous tissue, but their distribution and concentration vary based on the bone's overall function.
Compact bone, also called cortical bone, is the denser, stronger of the two types of bone tissue. It is found under the periosteum and in the diaphyses of long bones, where it provides support and protection. The microscopic structural unit of compact bone is called an osteon, or haversian system. Each osteon is composed of concentric rings of calcified...
16.2K
Automatic Processing and Automatic Social Behavior01:28

Automatic Processing and Automatic Social Behavior

223
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...
223
Time and frequency -Domain Interpretation of PI Control01:27

Time and frequency -Domain Interpretation of PI Control

403
Proportional-Integral (PI) controllers are essential in many control systems to improve stability and performance. They are commonly used in everyday devices like thermostats to enhance system damping and reduce steady-state error. When the zero in the controller's transfer function is optimally placed, the system benefits significantly in terms of stability and accuracy.
Acting as a low-pass filter, the PI controller slows the system's response and extends settling times. This requires...
403
Precipitate Formation and Particle Size Control01:16

Precipitate Formation and Particle Size Control

6.3K
In precipitation gravimetry, the precipitating agent should react specifically or selectively with the analyte. While a specific reagent reacts with the analyte alone, a selective reagent can react with a limited number of chemical species.
The obtained precipitate should be either a pure substance of known composition or easily converted to one by a simple process, such as ignition or drying. In addition, the precipitate should be insoluble and easily filterable. In general, filterability...
6.3K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Effects of dietary inclusion of blooming Ulva sp. on milk production, methane emitting potential, and physiological parameters in lactating Holstein cows.

Animal bioscience·2025
Same author

Design of beam shaping assembly for 2.4 MeV electrostatic tandem accelerator-based neutron source for boron neutron capture therapy: A Monte Carlo study.

Applied radiation and isotopes : including data, instrumentation and methods for use in agriculture, industry and medicine·2025
Same author

Synthesis of nickel-boron/reduced graphene oxide for efficient and stable lithium-ion storage.

Heliyon·2025
Same author

Fabrication and characterization of chitosan-pectin emulsion-filled hydrogel prepared by cold-set gelation to improve bioaccessibility of lipophilic bioactive compounds.

Food chemistry·2023
Same author

Theragnostic <sup>64</sup>Cu/<sup>67</sup>Cu Radioisotopes Production With RFT-30 Cyclotron.

Frontiers in medicine·2022
Same author

Real-Time Longitudinal Evaluation of Tumor Blood Vessels Using a Compact Preclinical Fluorescence Imaging System.

Biosensors·2021
Same journal

Erratum: "Highly versatile, two-color setup for high-order harmonic generation using spatial light modulators" [Rev. Sci. Instrum. 95, 073002 (2024)].

The Review of scientific instruments·2026
Same journal

Thermal correction method for accurate performance evaluation of micro-thermoelectric coolers.

The Review of scientific instruments·2026
Same journal

Correcting the energy-dependent asymmetry in low-energy muon spin rotation.

The Review of scientific instruments·2026
Same journal

Fiber-integrated acousto-optic-modulator-based phase-controlled Rydberg atomic electrometer.

The Review of scientific instruments·2026
Same journal

A top-loading point-contact spectroscopy probe with in-situ sample exchange for dilution refrigerators.

The Review of scientific instruments·2026
Same journal

Investigation of plasma characteristics in a developed large-diameter, low-aspect ratio, radio frequency plasma source with a flat spiral antenna.

The Review of scientific instruments·2026
See all related articles

Related Experiment Video

Updated: Jan 21, 2026

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

5.3K

The automatic frequency control based on artificial intelligence for compact particle accelerator.

Huisu Kim1, Mitra Ghergherehchi2, Seung-Wook Shin2

  • 1Department of Energy Science, Sungkyunkwan University, Suwon 16419, South Korea.

The Review of Scientific Instruments
|August 3, 2019
PubMed
Summary
This summary is machine-generated.

Researchers developed an intelligent system using reinforcement learning to stabilize the frequency of compact medical particle accelerators. By automatically adjusting settings to match the accelerator and its power source, the system significantly reduces energy loss during operation, even when faced with external disturbances.

Keywords:
reinforcement learningmagnetron frequencylinear acceleratorradio frequency

Frequently Asked Questions

More Related Videos

Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System
05:33

Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System

Published on: July 11, 2025

827
Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization
05:49

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Published on: February 23, 2024

1.4K

Related Experiment Videos

Last Updated: Jan 21, 2026

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

5.3K
Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System
05:33

Introduction of an Integrated Pathology Image Management, Artificial Intelligence, and Reporting System

Published on: July 11, 2025

827
Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization
05:49

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Published on: February 23, 2024

1.4K

Area of Science:

  • Medical physics research within automatic frequency control systems
  • Particle accelerator engineering and control theory

Background:

No prior work had resolved the instability challenges inherent in compact particle accelerator radio frequency systems. Conventional tuning methods often struggle to maintain precise alignment between magnetron sources and accelerator cavities during operation. That uncertainty drove the need for more adaptive, autonomous control architectures. Prior research has shown that reinforcement learning offers potential for complex system optimization. However, applying these techniques to high-power medical hardware remains a significant engineering hurdle. This gap motivated the development of a specialized intelligent control framework. Previous control strategies lacked the agility to respond to rapid environmental fluctuations in real-time. The field required a robust solution capable of managing dynamic disturbances without constant manual intervention.

Purpose Of The Study:

The study aims to develop an intelligent system for stabilizing frequency in compact linear accelerators. Researchers sought to address the persistent issue of frequency mismatch between magnetron sources and accelerator cavities. This mismatch often leads to significant energy loss and operational instability in medical equipment. The authors designed an algorithm based on reinforcement learning to automate the tuning process. They intended to create a controller capable of responding to environmental disturbances like temperature shifts. By implementing reward shaping, the team aimed to guide the software agent toward optimal frequency alignment. This work addresses the need for autonomous systems that reduce the requirement for manual hardware adjustments. The design focuses on improving the reliability of compact radio frequency stations through advanced computational control.

Main Methods:

Review approach involved designing an intelligent control architecture based on reinforcement learning principles. The team constructed a test bench using a medical X-band radio frequency station. They implemented the algorithm in two distinct modes to analyze system responses to periodic waves and random noise. Software agents were trained to perform actions within the simulated environment to optimize frequency matching. Hardware integration included a step motor to induce mechanical shifts for testing robustness. The researchers monitored reflected power levels throughout the experimental trials to assess stability. They compared the intelligent controller performance against standard open-loop operation under identical disturbance parameters. Data collection focused on quantifying power variance and average levels over two thousand training cycles.

Main Results:

Key findings from the literature indicate that the intelligent system significantly reduces power variance compared to open-loop configurations. The experimental setup achieved an average reflected power of 122.8 kW after training. The standard deviation of this power was reduced to 1.75 kW following two thousand iterations. Before training, the system exhibited a standard deviation of 5.63 kW under artificial disturbance. The researchers observed that the agent successfully adapted to random shifts induced by the step motor. These results demonstrate that the reinforcement learning approach maintains better synchronization than traditional methods. The study confirms that the controller effectively manages disturbances caused by mechanical movement and thermal fluctuations. The performance metrics highlight the capability of the agent to minimize energy loss in compact hardware.

Conclusions:

The authors suggest that their reinforcement learning framework successfully stabilizes reflected power in medical accelerators. Synthesis and implications indicate that this approach outperforms traditional open-loop control methods under artificial disturbance conditions. The researchers propose that reward shaping based on reflected power comparisons effectively guides agent learning. Their data confirms that the system achieves lower power variance after two thousand training iterations. This work implies that intelligent agents can manage complex hardware synchronization tasks autonomously. The findings demonstrate that integrating machine learning into radio frequency stations enhances operational reliability. The authors conclude that their specific algorithm provides a viable path for improving compact accelerator performance. Future implementations might leverage these insights to refine control precision in similar high-energy systems.

The researchers propose an advantage actor critic algorithm that optimizes frequency alignment by minimizing reflected power. This mechanism utilizes reward shaping to guide agent actions, resulting in a measured standard deviation of 1.75 kW after training, compared to the initial 5.63 kW observed during uncontrolled disturbances.

The team utilizes a step motor to introduce artificial disturbances by shifting the magnetron shaft randomly every 0.5 seconds. This setup employs white gaussian noise to simulate environmental instability, allowing the authors to evaluate the controller's robustness against external mechanical fluctuations.

The authors state that adjacent frequency data is a technical necessity to obtain maximum rewards during the initial training phase. This information allows the reinforcement learning agent to establish a baseline before it begins optimizing the system response to random noise.

The researchers use reflected power as the primary feedback signal to evaluate system performance. By comparing power levels across adjacent time intervals, the agent calculates the reward, which informs its subsequent adjustments to the accelerator frequency.

The experiment measured an average reflected power of 122.8 kW and a standard deviation of 1.75 kW after 2000 iterations. These values represent a significant improvement over the open-loop performance, which exhibited higher power loss and greater variability under identical disturbance conditions.

The authors propose that their intelligent control system offers a superior alternative to open-loop configurations for medical linear accelerators. They claim that this approach effectively mitigates the impact of temperature changes and random mechanical disturbances on radio frequency synchronization.