Ear biometrics

1. Ear biometrics Advisor: Wei-Yang Lin Professor Group Member: 陳致豪695410070 黃笙慈695410128

2. OUTLINE • Biometric in general • Three kinds of ear biometrics • Burge and Burger • Victor, Chang, Bowyer, Sarkar • Hurley, Nixon and Carter • Related news • Reference

3. Ideal biometric • Universal:each person should possess the characteristics • Unique:no two persons should share thecharacteristics • Permanent:the characteristics should not change • Collectable:easily presentable to a sensor and quantifiable

4. Biometric suitability for authentication purpose [1]

5. Ideal biometric (cont.) • Why do we must have ear biometric? • Many problems in face recognition remain largely unsolved. • A wide variety of imaging problem. • Face is the most changing part of the body. • Facial expression, cosmetics , anaplasty.

6. Before and after • The magic of cosmetic

7. Before and after (cont.) • Anaplasty

8. Before and after (cont.) • Anaplasty and cosmetic

9. Ear shape • Physical biometricischaracterized by the shape of the outer ear, lobes and bone structure • Unique enough? • New biometric, not widely used yet • No applications available yet

10. Alfred Iannarelli • Compared over 10,000 ears drawn from a randomly selected sample in California • Another study was among identical and non-identical twins • Using Iannarelli’s measurements • Result: earsare not identical. Even identical twins had similar but not identical ears.

11. Alfred Iannarelli (cont.) • The structureof the ear does not change radically over time. • The rate of stretching is about five times greater than normal during the period from four months to the age of eight, after which it is constant until around 70 when it again increases.[2]

12. Permanence of biometrics [1]

13. Iannarelli’smeasurements (a) Anatomy, (b) Measurements. (a) 1 Helix Rim, 2 Lobule, 3 Antihelix, 4 Concha, 5 Tragus, 6 Antitragus, 7 Crus of Helix, 8 Triangular Fossa, 9 Incisure Intertragica. (b) The locations of the anthropometric measurements used in the “Iannarelli System”. (Burge et al., 1998) [2]

14. Iannarelli’s system - weaknesses • If the first point is incorrect, all measurements are incorrect • Localizing the anatomical points is not very well suitable for machine vision • some other methods had to be found

15. Methods using pictures (1/3) • Burge and Burger (1998, 2000) • automating ear biometrics with Voronoi diagram of its curve segments. • a novel graph matching based algorithm forauthentication,whichtakes into account the possible error curves, which can be caused by e.g. lightning, shadowing and occlusion.[3]

16. System step • Acquisition • 300*500 image using CCD camera • Localization • Locate the ear • Edge extraction • Compute large curve segments

17. System step (cont.) • Curve extraction • Form large curve segment, remove small ones • Graph model • Build Voronoi diagram and neighborhood graph

18. Error correct group matching • Compute distance between graph model, if it less than a threshold, identification is verified. • For high FRR due to graph model, we can remove the noise curve and use ear curve width.

19. Removal of noise curves in the inner ear Graph model (Burge et al.) and false curves because of e.g. oil and wax of the ear.

20. Improving the FRR with ear curve widths, an example width of an ear curve corresponding to the upper Helix rim  better results

21. Methods using pictures (2/3) • Victor, Chang, Bowyer, Sarkar (at least 2 publications in 2002 and 2003) • principal component analysis approach • comparison between ears and faces • This method is presented later with 2 cases.[4][5]

22. Case 1: an evaluation of face and ear biometrics • The used method is principal component analysis (PCA) and the design principle is adopted from the FERET methodology • Null hypothesis: there is no significant performance difference between using the ear or face as a biometric[4]

23. PCA Method

24. Points for normalization

25. Tests of research • For faces: • Same day, different expression • Different day, similar expression • Different day, different expression • For ears: • Same day, opposite ear • Different day, same ear • Different day, opposite ear

26. Same day, different expression or opposite ear ear

27. Different day, similar expression or same ear ear

28. Different day, different expression or opposite ear ear

29. Experiment # Face/Ear compared Expected Result Result 1 Same day, Same day, Greater variation in Face performs different opposite ear expressions than ears; ears better expression perform better 2 Different day, Different day, Greater variation in Face performs similar same ear expression across days; ears better expression perform better 3 Differet day, Different day, Greater variation in face Face performs different opposite ear expression than ear; ears better expression perform better Victor et al. research result

30. Case 2: Ear and Face images • Hypothesis: • ear provide better biometric performance than images of the face • exploring whether a combination of ear and face images may provide better performance than either one individually[5]

31. Images used in research Same kinds of sets for faces, too. PCA, FERET

32. Tests for the research • Day variation • other conditions constant • Different lightning condition • taken in the same day in the same session • Pose variation • 22.5 degree rotation, other conditions constant, taken in the same day

33. Day variation test

34. Different lightning conditions

35. Pose variation (22.5 degree rotation)

36. Results • In this research face biometrics seem to be better in constant conditions, ear biometrics in changing conditions • Multimodal biometrics face plus ear gives the best results, why not use them?

37. Methods using pictures (3/3) • Hurley, Nixon and Carter (2000, 2005) • force field transformations for ear recognition. • the image is treated as an array of Gaussian attractors that act as the source of the force field • according to the researchers this feature extraction technique is robust and reliable and it possesses good noise tolerance.

38. Error possibilities in ear recognition

39. Possibilities to enhance ear biometrics • Using accurate measurements, e.g. ear curve and upper helix rim • Removing noise curves • Thermograms  removal of obstacles • Better quality cameras  more accurate pictures • Combined biometrics

40. Ear shape applications • currently there are no applications, which use ear identification or authentication • crime investigation is interested in using ear identification • active ear authentication could be possible in different scenarios

41. Related news • A new type of ear-shape analysis could see ear biometrics surpass face recognition as a way of automatically identifying people, claim the UK researchers developing the system. [6] • University of Leicester working with a Northampton company have made a breakthrough in developing a computerized system for ear image and ear print identification.[7]

42. Reference • [1] http://www.bromba.com/faq/biofaqe.htm • [2] A. Iannarelli, Ear Identification. Forensic Identification Series. Paramont Publishing Company, Fremont, California, 1989. • [3] Biometrics Personal Identification in Networked Society, chapter13, Mark Burge and Wilhelm Burger • [4] Victor, B., Bowyer, K., Sarkar, S. An evaluation of face and ear biometrics in Proceedings of International Conference on Pattern Recognition, pp. 429-432, August 2002. • [5] Chang, K., Bowyer. K.W., Sarkar, S., Victor, B. Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics.IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 9, September 2003, pp. 1160-1165. • [6] http://www.newscientist.com/article.ns?id=dn7672 • [7]http://www.findbiometrics.com/Pages/feature%20articles/earprint .html