1 / 23

Near-Field People Search Profile

Near-Field People Search Profile. Rogerio Feris , Lisa Brown, Russ Bobbitt. People Search in Surveillance Videos. Traditional Approaches: Face Recognition

dudley
Download Presentation

Near-Field People Search Profile

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Near-Field People Search Profile RogerioFeris, Lisa Brown, Russ Bobbitt

  2. People Search in Surveillance Videos Traditional Approaches: Face Recognition Face recognition is very challenging under lighting changes, pose variation, and low-resolution imagery (typical conditions in surveillance scenarios) Proposed Approach: Attribute-based People Search Rather than relying on face recognition only, we provide a complementary people search framework based on parts and fine-grained attributes Query Example: “Show me allbald peopleat the 42nd street station last monthwith dark skin, wearingsunglasses, wearing ared jacket”

  3. Suspect Description Form

  4. System Overview Video from camera Video from camera Analytics Engine Attribute Detectors Face Detection & Tracking BackgroundSubtraction Database Backend Search Interface Results – thumbnails matching query Suspect Description Form (Query Specification)

  5. Targeted Cameras

  6. Search Interface (Mockup)

  7. Ranking Motivation Time Order (3.6.7) Rank Order (4.0)

  8. Query Examples: Top 9 Bald

  9. Query Examples: Top 9 Sunglasses

  10. Query Examples: Top 9 Dark Skin Tone

  11. Query Examples: Top 9 Torso Color

  12. Query Examples: Multiple Attributes Bald=“Yes” Skin=“Light” Torso=“Black” Caucasian bald male with black shirt

  13. Query Examples: Multiple Attributes Skin=“Dark”, Torso=“Blue and Yellow” African American male, wearing a blue shirt and carrying a yellow bag

  14. Query Examples: Multiple Attributes Sunglasses=“Yes” Skin=“Light”, Torso=“Yellow” Caucasian female with dark sunglasses wearing a yellow dress

  15. Query Examples: Multiple Attributes Skin=“Medium” Torso=“Black and Yellow” Female with medium skin tone wearing a black shirt and carrying a yellow bag

  16. Query Examples: Multiple Attributes Skin=“Light”, Torso=“Black, Green and Yellow” Caucasian male wearing black shirt with green and yellow logo

  17. Query Examples: Multiple Attributes Bald=“Yes” Skin=“Dark” Torso=“White” Bald, African American male wearing a white shirt.

  18. Query Examples: Multiple Attributes Bald=“Yes” Sunglasses=“Yes” Skin=“Dark” Torso=“Blue” African American bald male wearing sunglasses and a blue tie

  19. Known Issues Face Detection Entire Face not Visible Always Looking Down or Face at Strange Orientation Face Always in Profile Non-Faces

  20. Known Issues Sunglasses Detection Shadows Under Eyes Confusion with Eyeglasses

  21. Known Issues Forehead and hair are similar color Headwear gives “bald-like” appearance Bald Detection Dome-shaped hair style High forehead

  22. Known Issues Faces in Shadows Look Similar Skin Tone Detection False-Positives Are Often Classified as “Light” Face Box Includes Bright Non-Face Elements

  23. Known Issues Face captured at bottom of image Torso Color Occlusions White sometimes gives off bluish cast (AWB) Skin included in classification (red)

More Related