1 / 10

March 24, 2004 R.M. McCabe Image Group

International Data Sharing Issues. March 24, 2004 R.M. McCabe Image Group. NIST BIOMETRIC EVALUATIONS. FRVT 2002 - Face Recognition Vendor Test NIST Verification Test Bed (VTB) IDENT ITB – INS/ICE IAFIS ATB – FBI FpVTE 2003 – Fingerprint Vendor Technology Evaluation

ksena
Download Presentation

March 24, 2004 R.M. McCabe Image Group

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. International Data Sharing Issues March 24, 2004 R.M. McCabe Image Group

  2. NIST BIOMETRICEVALUATIONS • FRVT 2002 - Face Recognition Vendor Test • NIST Verification Test Bed (VTB) • IDENT ITB – INS/ICE • IAFIS ATB – FBI • FpVTE 2003 – Fingerprint Vendor Technology Evaluation • SDK Verification Testing • Minutiae Matching Evaluation Test 2004

  3. Data Formats – Image vs Template • Only image-based biometrics are interoperable • All fingerprint vendors claim significant accuracy loss using templates that are not their own unique proprietary pattern or minutia based templates. • No common face template has been accepted. • The only Iris template in use is proprietary. After these projects started an image based iris exchange standard was developed. • Data formats: • ANSI/NIST-ITL 1-2000 • M1 and ISO data format standards

  4. Image Data Variables Fingerprints: • Acquired in either flat or rolled form • Depend on type of sensor used. • Scanned inked image • Rolled images • Slap flats (requires segmenting) • Live rolled images • Live single finger image • Live slap image (requires segmenting) Face: • Lighting, • Background • Size • Pose

  5. Data for Testing • Biometric accuracy determination requires use of large-scale IMAGE databases for testing • Large realistic test samples of images have been obtained by NIST from the DOS, DOJ, DHS, LACSD, OH, and TX • All tests performed at NIST with images – not templates • Testing is being done with 6 million faces and 50 million fingerprints • No large sample of iris data is presently available

  6. FpVTE 2003 • FpVTE is designed to assess the capability of fingerprint systems to meet requirements for both large-scale and small-scale real world applications. • Analysis & methodologies built on FRVT 2002 • Evaluations performed at NIST facility • Preliminary testing required • All data & results to be retained by NIST • Small medium and large scale tests performed • Using one or more fingerprint images • Different types of images • Different levels of quality

  7. Minutiae Matching Evaluation Test 2004 • Purpose: Evaluate the feasibility of using minutiae template data as interchange medium • Objective: Quantify the verification accuracy changes using minutiae rather than images • Vendors submit their SDKs to NIST • Minutiae data to conform to ANSI M1 minutiae • Capability to locate, extract, & format minutiae & compare images • Testing to comprise of combinations of search & file templates derived from different participants

  8. DATA QUALITY IS CRITICAL • Existing high quality public database will yield optimistic results. • Archival databases contain data of widely variable quality. • Demographic factors will affect the accuracy of future systems. • Algorithms are important but vary widely in sensitivity to image quality.

  9. Data/Vendor Variability

More Related