Deep reinforcement learning in chemistry: A review.
Bhuvanesh Sridharan1, Animesh Sinha1, Jai Bardhan1
1Center for Computational Natural Sciences and Bioinformatics, International Institute of Information Technology, Hyderabad, India.
Journal of Computational Chemistry
|May 3, 2024
Summary
Reinforcement learning (RL) is revolutionizing computational chemistry for tasks like molecule generation and optimization. This review explores RL applications, algorithms, and future directions in chemistry.
Area of Science:
- Computational Chemistry
- Artificial Intelligence
Background:
- Reinforcement learning (RL) demonstrates significant success across diverse computational chemistry domains.
- Key application areas include molecule generation, geometry optimization, and retrosynthetic pathway searches.
Purpose of the Study:
- To motivate the application of RL in chemistry.
- To provide a foundational understanding of RL formalism for chemistry problems.
- To review recent advancements and inspire novel RL applications.
Main Methods:
- Discussion of RL formalism relevant to chemistry.
- Analysis of solution formulations and algorithms from recent literature.
- Comparison of different approaches and their underlying RL algorithms.
Main Results:
- Overview of the current state of RL applications in chemistry.
- Identification of actively researched open problems.
- Insights into utilizing RL for chemical challenges.
Conclusions:
- RL is a powerful tool for advancing computational chemistry.
- Understanding RL principles enables chemists to tackle complex problems.
- The review aims to foster innovation in RL-driven chemical research.
Related Concept Videos
Introduction to Chemical Reactions
8.7K
All chemical reactions begin with a reactant, the general term for one or more substances entering the reaction. Sodium and chloride ions, for example, are the reactants in the production of table salt. One or more substances produced by a chemical reaction are called the product. Chemical reactions follow the law of conservation of mass, which means that matter cannot be created nor destroyed in a chemical reaction. The components of the reactants—the number of atoms and the...
8.7K
Inductive Effects on Chemical Shift: Overview
1.1K
The protons in unsubstituted alkanes are strongly shielded with chemical shifts below 1.8 ppm. Methine, methylene, and methyl protons appear at approximately 1.7, 1.2 and 0.7 ppm, while the proton signal from methane appears at 0.23 ppm. An electronegative substituent, such as chlorine, withdraws the electron density from the protons, increasing their chemical shift. Progressive substitution of the hydrogens in methane by chlorine shifts the proton signals increasingly downfield, to 3.05 ppm in...
1.1K
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
3.1K
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
3.1K
E1 Reaction: Stereochemistry and Regiochemistry
9.5K
One of the critical aspects of the E1 reaction mechanism, as also observed in E2, is the regiochemistry, with multiple regioisomers obtained as products. In the example discussed, the presence of water as a weak base favors elimination over substitution to generate two alkenes. Given that alkenes’ stability increases with the number of alkyl groups across the double bond, typically, E1 reactions lead to the Zaitsev product, for this is more substituted and stable than the Hofmann product.
9.5K
Multi-Step Reactions
7.3K
Chemical reactions often occur in a stepwise fashion involving two or more distinct reactions taking place in a sequence. A balanced equation indicates the reacting species and the product species, but it reveals no details about how the reaction occurs at the molecular level. The reaction mechanism (or reaction path) provides details regarding the precise, step-by-step process by which a reaction occurs. Each of the steps in a reaction mechanism is called an elementary reaction. These...
7.3K
SN2 Reaction: Mechanism
14.3K
The kinetic studies of SN2 reactions suggest an essential feature of its mechanism: it is a single-step process without intermediates. Here, both the nucleophile and the substrate participate in the rate-determining step.
The presence of the more electronegative halogen in the substrate creates a polarized carbon-halide bond. The halide pulls the electron cloud generating an electrophilic center at the carbon atom. Thus, the carbon atom carries a partial positive charge while the halide has a...
The presence of the more electronegative halogen in the substrate creates a polarized carbon-halide bond. The halide pulls the electron cloud generating an electrophilic center at the carbon atom. Thus, the carbon atom carries a partial positive charge while the halide has a...
14.3K


