120 likes | 418 Views
Face Sketch Recognition. [Tang04] IEEE Trans. CSVT, Jan 2004. Problem Statement. Goal: Match face images to face sketches Useful when test faces are in sketch forms (e.g. no photo of suspect). Approach Transform face images to sketches Match sketches of faces using an eigen-sketch approach.
E N D
Face Sketch Recognition [Tang04] IEEE Trans. CSVT, Jan 2004
Problem Statement • Goal: • Match face images to face sketches • Useful when test faces are in sketch forms (e.g. no photo of suspect). • Approach • Transform face images to sketches • Match sketches of faces using an eigen-sketch approach (C) 2005 by Yu Hen Hu
Geometric Methods • Fiducial grid model • Identify anchor points tip of noise, corners of mouth • Derive other fiducial points from the identified anchor point • Geometric features • 35 fiducial points used • 26 distances between key fiducial points measured. • Including sizes of nose, eyes, eyebrows, face contours, etc. • Measure geometric features from both face image and sketches and perform matching (C) 2005 by Yu Hen Hu
Eigen-Sketch Method • Convert face image into eigenface representation. • Generate eigen-sketch from each eigenface. • Project probe sketches (test sketches) onto the subspace spanned by eigen-sketches. • Use feature vectors of eigen-face representation to match the weight vectors • Assumption: • Face images and sketches are normalized in size, lighting, poses, and expression neutral • No occlusions on test images (eye glasses, beard, etc.) (C) 2005 by Yu Hen Hu
Photo-to-sketch transformation Photo – eigen-face – eigen-sketch - sketch Photo-to-sketch transformation examples. (a) Original photo. (b) Reconstructed photo. (c) Reconstructed sketch. (d) Original sketch. (C) 2005 by Yu Hen Hu
Results • Using Feret test set, the proposed method (sketch transform) out-performs conventional method (geometric and eigen-face) by large margin. • Possible reason: • Geometric face: features measured on photo may be different from sketches • Eigenface: gray scale image value differ very much between phton and sketch. (C) 2005 by Yu Hen Hu