1 / 27

IBM Smart Vision Suite An Introduction

IBM Smart Vision Suite An Introduction. Puerto Rico Smart Virtual Shield Project Rick Kjeldsen, PhD. Genetec. Video Archive. User. Video Manager. Video. Streaming Video. Cameras. SVS. Analytics Engine. Alerts. Events. SVS GUI. Metadata Archive. Search. Events and Alerts. Alerts

hinda
Download Presentation

IBM Smart Vision Suite An Introduction

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. IBM Smart Vision SuiteAn Introduction Puerto Rico Smart Virtual Shield Project Rick Kjeldsen, PhD

  2. Genetec Video Archive User Video Manager Video Streaming Video Cameras SVS Analytics Engine Alerts Events SVS GUI MetadataArchive Search

  3. Events and Alerts • Alerts • Show you things happening now • Must be defined in advance • Events • Record everything that happens • Let you search video after an incident

  4. SVS User Interface • Receive alerts • Camera map • Video Player • Home tab • Select cameras • Alerts tab • Alert history • Events tab • Event history

  5. How do Analytics work in SVS ? • What parts of the image are changing ? • Model background • What is different (foreground) ? • What objects are moving ? • Cluster foreground into “blobs” • Cluster blobs into objects • Track objects • What are the object’s characteristics ? • Size, color, location, speed, shape… • What kind of object is it ? • Are the objects doing something “interesting” ? • Alerts

  6. Events • Record information about every moving object the camera sees • Appearance • Color, size • Motion • Track Summary • Speed, Distance, Duration • Full Track (optional) • Exact location at each frame • Object Type (optional) • Person, Vehicle, Other • Based on size and location • Keyframe: • Image showing object and track

  7. Uses of Events • Forensic Search • “Find the guy in a red hat on Franklin St. last Tuesday morning” • Incident investigation • “What caused the fire hydrant leak ?” • Activity Analysis • “What is the fastest way to get an ambulance downtown at rush hour ?” • Forms the basis of Alert Detection

  8. Events and Search • Results type • Thumbnails • Stats • Track summary • Heatmap • Image area (ROI) to search • Search filters • Time period • Camera selection (Multiple camera search)

  9. Alerts • Alert operator to current activity • Trigger s when an object behaves in a specific way at some location in the image. • Record activity for later analysis • Looking for patterns specific activities • Object counting • Base Types • Motion Detection • Directional Motion • Abandoned Bag • Parked Car • Object Removal • Tripwire • Region Alert

  10. Use Cases • Problems are defined in terms of “use cases”, not alerts • Speeding • Car stopped on freeway • Traffic congestion • Use cases get translated to Alerts • Speeding = Directional Motion or Tripwire with Object Type=car, speed as appropriate and other parameters to reduce false alerts. • Stopped car = Region alert with 1 car that stops for > 7 seconds • Congestion = Region alert with 4 cars that stay in region for > 30 seconds

  11. Example alerts Wrong way(a bicycle) Stopped car(unusual location) Speeding Stopped cars (in traffic) Congestion

  12. False Positive alerts • Analytics will never be perfect • False Alert: Alert that should not have fired • Missing Alert: Real incident that did not fire an alert • Alert tuning • Adjust for few False Alerts -> get more Missing Alerts • Adjust for few Missing Alerts -> get more False Alerts • You will see False Alerts as you work with SVS • Always verify alerts by checking keyframes and video

  13. When analytics make more mistakes • Similar activity • E.g. stopped cars during congestion • sitting person or abandoned object ? • High Activity • Heavy traffic, crowds • Night • Hard to see objects, headlights • Hard rain • Water on camera lens, puddles • Sun glare • Reflects off shiny objects • Moving shadows • Blowing trees

  14. Stopped car False Alerts Abandoned bag Headlights Shadow Unknown Light spot Shadow Wrong way Headlights Congestion Long trucks

  15. A real example

  16. Shooter’s car approaches fast

  17. First Shots – muzzle flash

  18. First Shots – glass breaking

  19. Victim flees car

  20. Second Victim flees

  21. Shooter backs up and fires again

  22. One victim appears to return

  23. Two men compared

  24. Drive-by shooting: Alerts that fired Stopped Car AlertCar behind victim stops and remains there for entire shooting. Wrong Way Car AlertShooter’s car backs up to fire again. Stopped Car AlertVictim’s car stops and remains there.

  25. Possible near-term improvements: • Schedules on some cameras to avoid false alerts at • Rush hours • Night • Refined speeds for Speeding alerts • Reduce false Wrong Way alerts • Alert on combinations of basic alerts to recognize complex behavior

  26. Alerting on complex behavior • Complicated use cases are made of a combination of simpler behavior • Traffic Incident (e.g. drive-by shooting) • Cars stop • Cars backup • Cars speed away • Congestion behind incident • Goal: • Fire alert when multiple basic alerts trigger on the same camera in a short period of time (e.g. 60 seconds)

  27. Thank you !Questions ?

More Related