Related Experiment Video
Updated: Jun 20, 2026
09:49
Holistic Facial Composite Creation and Subsequent Video Line-up Eyewitness Identification Paradigm
Published on: December 24, 2015
Face photo-sketch synthesis and recognition
1Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong. xgwang@ee.cuhk.edu.hk
IEEE Transactions on Pattern Analysis and Machine Intelligence
|September 19, 2009
Summary
This study introduces a new method for creating face sketches from photos and vice versa, using a multiscale Markov Random Fields (MRF) model for improved face recognition. The system enables efficient searching of photo databases using artist-drawn sketches.
Area of Science:
- Computer Vision
- Artificial Intelligence
- Pattern Recognition
Background:
- Face recognition systems often struggle with variations between real photos and artist sketches.
- Synthesizing realistic sketches from photos and vice versa is a challenging task.
Purpose of the Study:
- To develop a novel method for face photo-sketch synthesis and recognition.
- To enable effective matching between face photos and sketches for identification purposes.
- To create a system with applications in digital entertainment and law enforcement.
Main Methods:
- Utilized a multiscale Markov Random Fields (MRF) model for learning joint photo-sketch models.
- Employed overlapping patches of varying sizes to capture local face structures at multiple scales.
- Developed a system with three components: photo-to-sketch synthesis, sketch-to-photo synthesis, and sketch-based photo retrieval.
Main Results:
- Significantly reduced the difference between face photos and sketches through transformation.
- Demonstrated effective matching between transformed photos and sketches for recognition.
- Conducted experiments on a database of 606 faces, showing the system's efficacy.
Conclusions:
- The proposed multiscale MRF model provides a robust framework for face photo-sketch synthesis and recognition.
- The method allows for straightforward application of existing face recognition techniques to sketch-based recognition.
- The system offers practical utility for applications requiring cross-modal face matching.
Related Concept Videos
01:21Association Areas of the Cortex
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
01:24Facial Feedback Hypothesis
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...
01:22Curve Sketching and Derivatives
Understanding the behavior of a function through its first and second derivatives is essential for analyzing its graph. Derivatives provide insight into where a function increases or decreases, where it attains local maxima or minima, and how its curvature behaves across different intervals.The first derivative of a function reveals the slope of the tangent line at any given point. Points where the derivative is zero or undefined are considered critical, as they often indicate potential extrema...