Related Experiment Video
Updated: Sep 1, 2025

Curation of Computational Chemical Libraries Demonstrated with Alpha-Amino Acids
Published on: April 13, 2022
Molecular Design Method Using a Reversible Tree Representation of Chemical Compounds and Deep Reinforcement Learning
Ryuichiro Ishitani1, Toshiki Kataoka1, Kentaro Rikimaru1
1Preferred Networks, Inc., 1-6-1 Otemachi, Chiyoda-ku, Tokyo 100-0004, Japan.
We developed a novel molecular representation called Reversible Junction Tree (RJT) and used deep reinforcement learning (RL) for automated molecular design. This RJT-RL method enables efficient optimization and fine-tuning for drug discovery tasks.
Area of Science:
- Computational chemistry
- Material informatics
- Drug discovery
Background:
- Automated molecular design is crucial for material informatics and drug discovery.
- Existing methods may lack efficient representations for complex molecular structures.
Purpose of the Study:
- To introduce a novel molecular representation, the Reversible Junction Tree (RJT).
- To formulate molecular design as a tree-structure construction problem using deep reinforcement learning (RJT-RL).
- To demonstrate the applicability of RJT-RL for molecular optimization and fine-tuning in drug discovery.
Main Methods:
- Developed a coarse-grained tree representation of molecules (Reversible Junction Tree; RJT).
- Formulated molecular design and optimization as a tree-structure construction problem using deep reinforcement learning (RJT-RL).
- Ensured all intermediate and final states in RL are convertible to valid molecules.
Main Results:
- The RJT representation is reversely convertible to the original molecule without external information.
- RJT-RL efficiently guided the optimization process in simple benchmark tasks.
- Demonstrated applicability to multiobjective optimization and fine-tuning for realistic drug discovery scenarios.
Conclusions:
- The novel RJT representation and RJT-RL method offer an efficient approach for automated molecular design.
- This method facilitates the optimization and fine-tuning of molecular properties for drug discovery.
- RJT-RL shows promise for advancing computational drug discovery and material informatics.
Related Concept Videos
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
Reinforcement
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Reversible and Irreversible Processes
Phylogenetic Trees
Reinforcement Schedules
Once a behavior is learned,...
Sequence Networks of Rotating Machines
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...

