Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Chaotic neural control.

A Potapov1, M K Ali

  • 1Department of Physics, University of Lethbridge, 4401 University Drive W, Lethbridge, Alberta, Canada T1K 3M4.

Physical Review. E, Statistical, Nonlinear, and Soft Matter Physics
|April 20, 2001
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Identifying intact and fibrotic parenchyma in pancreatic ductal adenocarcinomas using compression optical coherence elastography.

Scientific reports·2026
Same author

Cell hiding in colorectal cancer: correlation with response to chemotherapy in vitro and in vivo.

Scientific reports·2024
Same author

COVID-19 and tobacco cessation: lessons from India.

Public health·2021
Same author

Effect of a multicomponent intervention on achievement and improvements in quality-of-care indices among people with Type 2 diabetes in South Asia: the CARRS trial.

Diabetic medicine : a journal of the British Diabetic Association·2019
Same author

Uterine exteriorization versus intraperitoneal repair: effect on intraoperative nausea and vomiting during repeat cesarean delivery - A randomized clinical trial.

Facts, views & vision in ObGyn·2019
Same author

Acceptability of a decision-support electronic health record system and its impact on diabetes care goals in South Asia: a mixed-methods evaluation of the CARRS trial.

Diabetic medicine : a journal of the British Diabetic Association·2018
Same journal

Tension on dsDNA bound to ssDNA-RecA filaments may play an important role in driving efficient and accurate homology recognition and strand exchange.

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
Same journal

Publisher's Note: Amplitude-phase coupling drives chimera states in globally coupled laser networks [Phys. Rev. E 91, 040901(R) (2015)].

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
Same journal

Erratum: Shapes of sedimenting soft elastic capsules in a viscous fluid [Phys. Rev. E 92, 033003 (2015)].

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
Same journal

Erratum: Attenuation of excitation decay rate due to collective effect [Phys. Rev. E 90, 022142 (2014)].

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
Same journal

Publisher's Note: Role of connectivity and fluctuations in the nucleation of calcium waves in cardiac cells [Phys. Rev. E 92, 052715 (2015)].

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
Same journal

Publisher's Note: Lattice Boltzmann approach for complex nonequilibrium flows [Phys. Rev. E 92, 043308 (2015)].

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
See all related articles

Discrete control stabilizes unstable equilibria by creating chaotic attractors. Artificial neural networks with reinforcement learning can learn these complex control schemes, exhibiting chaos in both the system and controller.

Area of Science:

  • Control Theory
  • Dynamical Systems
  • Artificial Intelligence

Background:

  • Stabilizing unstable equilibria is a fundamental challenge in control theory.
  • Discrete control, involving controls at discrete times and values, presents unique difficulties.
  • Artificial neural networks (ANNs) with reinforcement learning (RL) show promise in learning complex control strategies.

Purpose of the Study:

  • To investigate the dynamics arising from stabilizing unstable equilibria using discrete control.
  • To demonstrate that discrete control typically induces chaotic attractors near equilibria.
  • To explore the application of ANNs with RL for learning such discrete control schemes.

Main Methods:

  • Theoretical analysis to prove the emergence of chaotic attractors.

Related Experiment Videos

  • Implementation of reinforcement learning algorithms for discrete control.
  • Numerical simulations to analyze system dynamics and controller activity.

    • Main Results:

    • Discrete control of unstable equilibria characteristically generates chaotic attractors.
    • Reinforcement learning successfully learns control schemes for these systems.
    • The resulting dynamics exhibit positive Lyapunov exponents, confirming chaos.
    • Chaos is observable in both the controlled system and the ANN controller's patterns.

    Conclusions:

    • Discrete control, while stabilizing, inherently introduces chaotic dynamics.
    • ANNs with RL provide a viable method for learning effective discrete control strategies.
    • The study highlights the interplay between control, chaos, and artificial intelligence in complex systems.