Related Experiment Video
Updated: Jun 19, 2025

Deep Neural Networks for Image-Based Dietary Assessment
Published on: March 13, 2021
ChemReco: automated recognition of hand-drawn carbon-hydrogen-oxygen structures using deep learning
Hengjie Ouyang1, Wei Liu2, Jiajun Tao1
1School of Informatics, Hunan University of Chinese Medicine, Changsha, 410208, Hunan, People's Republic of China.
ChemReco accurately recognizes hand-drawn chemical structures using an EfficientNet+Transformer model. This tool converts drawings into machine-readable formats, improving chemical research and enabling automated grading for educational purposes.
Area of Science:
- Chemistry
- Computer Science
- Educational Technology
Background:
- Chemical molecular structures are crucial for academic communication and research.
- Hand-drawn chemical structures are common but difficult for computers to process.
- Automated recognition of chemical drawings can aid research and educational assessment.
Purpose of the Study:
- To develop a tool (ChemReco) for recognizing hand-drawn chemical molecular structures.
- To enhance dataset acquisition efficiency for training recognition models.
- To achieve high accuracy in identifying chemical structures from hand-drawn images.
Main Methods:
- Proposed a synthetic image generation method to create hand-drawn chemical structure datasets.
- Developed a chemical molecule structural recognition model using an EfficientNet+Transformer encoder-decoder architecture.
- Focused on recognizing structures involving Carbon (C), Hydrogen (H), and Oxygen (O) atoms.
Main Results:
- Achieved a final recognition accuracy of 96.90% for hand-drawn chemical structures.
- Demonstrated superior performance of the EfficientNet+Transformer model compared to other encoder-decoder combinations.
- Successfully created ChemReco, a tool for identifying simple chemical structures.
Conclusions:
- The developed model and dataset generation method significantly improve the recognition of hand-drawn chemical structures.
- ChemReco offers a convenient solution for researchers and educators.
- Further research can expand the model's capabilities to include more complex structures and elements.
Related Concept Videos
Molecular Models
Structures of Carboxylic Acid Derivatives
Carboxylic acid derivatives contain an acyl group attached to a heteroatom such as chlorine, oxygen, or nitrogen. The carbonyl carbon and oxygen are both sp2-hybridized with an unhybridized p orbital.
The three sp2 orbitals of the carbonyl carbon form three σ bonds, one each with the carbonyl oxygen, the α carbon, and the heteroatom, whereas the other two sp2 orbitals of the carbonyl oxygen are occupied by the lone pairs. Further, the...
Fischer Projections
Aldehydes and Ketones with HCN: Cyanohydrin Formation Mechanism
Structures of Aldehydes and Ketones
In aldehydes (Figures 1a and 1b),...
Aromatic Hydrocarbon Cations: Structural Overview
Removing one hydrogen from the intervening CH2 group...

