340 likes | 538 Views
Korea Standardization and Research activities of Biometrics Testing Technique. 16. Sept 2004 Director, Jason Kim / KISA ( jskim@kisa.or.kr /+82-2-4055-470 ). Table of Contents. Instruction of Biometrics Test Technologies BioAPI-CTS Fingerprint and Face-PTS Standardization in Korea
E N D
Korea Standardization and Research activities of Biometrics Testing Technique 16. Sept 2004 Director, Jason Kim / KISA (jskim@kisa.or.kr/+82-2-4055-470)
Table of Contents • Instruction of Biometrics Test Technologies • BioAPI-CTS • Fingerprint and Face-PTS • Standardization in Korea • Korea Activities in ISO/IEC JTC 1/SC 37
Instruction of Biometrics Test Technologies (1/2) • Conformance Test Suites (CTS) • Conformance testing is "black box" testing of the functionality of a standard implementation. • CTS shall be capable of executing the test script sets, capturing the returned results, evaluating the results, and reporting them in a human-readable form.
Instruction of Biometrics Test Technologies (2/2) • Performance Test Suites (PTS) • Performance testing in biometrics allows the developer to rapidly grasp the status of the current technology. • To provide the reliability of the product to users and establishes a wide market. • PTS consists of test target, test index, test method, and database.
BioAPI-CTS (1/7) • BioAPI-CTS • The BioAPI specification, ISO/IEC FCD 19784, enables components of a biometric system provided by different vendors to inter-work through a fully defined Application Programming Interface. • BioAPI Conformance Test Suite (CTS), including documentation of the test suite, describing test categories, test objectives for each individual test, instructions on how to execute the test suite, and the expected results of executing the individual tests. • Three conformance testing models are defined within the methodology, one for the testing of each standard component. • For applications • For Frameworks • For BSPs
BioAPI-CTS (2/7) • Normal BioAPI Component Model
BioAPI-CTS (3/7) • Conformance Testing Model for BioAPI Applications
BioAPI-CTS (4/7) • Conformance Testing Model for BioAPI Frameworks
BioAPI-CTS (5/7) • Conformance Testing Model for BioAPI BSPs (1/2)
BioAPI-CTS (6/7) • Conformance Testing Model for BioAPI BSPs (2/2)
BioAPI-CTS (7/7) • K-CTS(Conformance Test Suite) for BioAPI • Developed conformance test tool for BioAPI v1.1 • To check BSP is conformed to BioAPI • Correctness check • Functionality check
Fingerprint and Face-PTS (1/7) • Fingerprint-PTS • Fingerprint recognition system Performance Test Suite (PTS) • To Test Fingerprint recognition system by KISA fingerprint image Database • Face-PTS • FACE recognition system Performance Test Suite (PTS) • Started in this year (2004) • Developing domestic standard on K-FACE PTS • Draft, Nov. 2004 • To Test Face recognition system by KISA Face image Database
Fingerprint and Face-PTS (2/7) • Collecting Fingerprint & Face Image • Period : 2002 ~ 2004 (3 years) • Goals • Fingerprint : 3,000 persons x 160 images/person • Face : 1,520 persons x 118 images/person • It would be used just for research • Companies, Laboratories of Universities
Fingerprint and Face-PTS (3/7) • Fingerprint-PTS - The Fingerprint PTS program -
PTS Test Items Score Distribution FMR/FNMR ROC Enroll Total Enroll Attempt Failure to Enroll Module Crash Average Enroll Time Match Total Match Attempt Failure to Match Module Crash Average Match Time Total Match Time Equal Error Rate Template Size Fingerprint and Face-PTS (4/7)
Fingerprint and Face-PTS (5/7) • Score Distribution Curve
Fingerprint and Face-PTS (6/7) • FMR/FNMR Curve
Fingerprint and Face-PTS (7/7) • ROC Curve Blue : Atmel Green :Authentec Pink : Hunno Red : Nitgen Black UareU
Standardization in Korea (1/12) • Korea Biometrics Activities ASIA BIOMETRIC WORKING GROUP ABWG Biometric Technology & Standards Submission Collaboration KOREA, JAPAN, TAIWAN, HONGKONG, MALYSIA SINGAPORE, etc Harmonization Collaboration Harmonization
Standardization in Korea (2/12) • Domestic Standardization Korea Information Security Agency KBAKorea Biometrics Association TC 1 / PG103 Biometrics
Standardization in Korea (3/12) • KISA • National Project : • A Development of test techniques standardization for biometric identification system • Overview • Period : January 2004 – December 2005(for 2 years) • Institute : KISA IT Security Technology Standardization Team • Funding : Ministry of Information and Communications (MIC)
Standardization in Korea (4/12) • Goals • Biometric system operation environment and Security Policy • Test Model for user authentication system applied Biometric techniques • Development of Test Methodology (security evaluation and performance test) for biometric system • Development of Test Standards for biometric technologies. • BioAPI Conformance Test(WG2), Fingerprint and Face Performance Test(WG5) Standards to ISO SC37
Standardization in Korea (5/12) • Current Activity • K-BioAPI, K-Face Recognition System Performance Test draft for Domestic Standardization, July, 2004 • K-BioAPI Domestic Standardization processing, TTA TC10/PG103(Technical Committee / Biometric Project Group) • Developed of automatic fingerprint performance testing tool • Developed of Conformance Test Suite for BioAPI of ISO • Developing of Performance test tool for Face Recognition system • Technical and Scenario test using biometic image DB • Developing of face recognition system performance testing tool(’04)
Facial Image Database Standardization in Korea (6/12) • Facial Image Database • Image Collection Studio
Standardization in Korea (7/12) • Samples of Facial Images Database • 4 Facial Expressions
Standardization in Korea (8/12) • Samples of Facial Images Database • Glasses, illumination
Standardization in Korea (9/12) • Samples of Facial Images Database • Pose, Hair-Band, Glasses
Standardization in Korea (10/12) • TTA TC 1/PG 103
Standardization in Korea (11/12) • TTA TC 1/PG 103