1 / 39

ImageLab : Attività di ricerca e sviluppo in video-sorveglianza

ImageLab : Attività di ricerca e sviluppo in video-sorveglianza. Prof. Ing. Rita Cucchiara ImageLab Dipartimento di Ingegneria dell’Informazione Università di Modena e Reggio Emilia, Italy. Imagelab. Dipartimento di Ingegneria dell’Informazione Università di Modena e Reggio Emilia, Italy.

kerem
Download Presentation

ImageLab : Attività di ricerca e sviluppo in video-sorveglianza

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ImageLab:Attività di ricerca e sviluppo in video-sorveglianza Prof. Ing. Rita Cucchiara ImageLab Dipartimento di Ingegneria dell’InformazioneUniversità di Modena e Reggio Emilia, Italy

  2. Rita Cucchiara-ImageLAB-DII Università di Modena e Reggio Emilia Imagelab Dipartimento di Ingegneria dell’InformazioneUniversità di Modena e Reggio Emilia, Italy Imagelab Laboratory of Image Analysis for Computer Vision and Multimedia Staff Prof. Rita Cucchiara, PhD(Faculty staff) Ing.Andrea Prati, PhD(Faculty staff) Ing. Costantino Grana,PhD (Faculty staff) Ing. Roberto Vezzani,PhD(post-Doc ) Ing. Simone Calderara (PhDstudent) Ing. Giovanni Gualdi (Ph-dStudent) Ing. Daniele Borghesani (fellow) Dr. AmitTilvankar (visitingresearcher) Ing, Rudi Melli, Vision-E Ing. Giuliano Pistoni, Vision-E Ing. Emanuele Perini Vision-E Prof. Massimo Piccardi(UniversityofTechnology, Sidney) 10 Un-graduatedstudents… http://imagelab.ing.unimo.it

  3. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Rita Cucchiara-ImageLAB-DII Università di Modena e Reggio Emilia ResearchActivities at ImageLab Computer Vision for robotic automation Transcoding for Multimedia Image analysis for Medical Imaging Multimedia: video annotation Video analysis for indoor/outdoor surveillance Video analysis for telemetry People and vehicle surveillance

  4. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Rita Cucchiara-ImageLAB-DII Università di Modena e Reggio Emilia CV forroboticautomation Projects in collaborationwithcompanieswithlocal and regionalsupport: some examples Vision-BasedNavigationfor AGV Vehicle (2005-2006) • Researchactivity in vision-basedlocalization, navigation and Obstacle detection forAutomatedGuidedVehicle. System forautomaticcreationofceramicmosaics (2005-2006) • Researchactivity in the developmentof a complete robotic system for the automaticcreationofceramicmosaics. Detectingborders in labelsfortextileimplants (2006-2007) • Researchactivity in the developmentof a complete robotic system for the automaticcreationofceramicmosaics. Analysisofcarvibrations (2006-2007) • analysisof head vibration in Ferrari cars

  5. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Rita Cucchiara-ImageLAB-DII Università di Modena e Reggio Emilia Medical Imaging MedicalImaging: Dentaltomography (1999-2002) Echocardiography ( BurhnamInstitute, CA, USA) (2002-2004) Dermatologicalimageanalysis(1999-2007) • Segmentation • Featureanalysis • Mosaicing • Retrieval

  6. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Rita Cucchiara-ImageLAB-DII Università di Modena e Reggio Emilia Multimedia Cache performance analysis (2000-2004) • MIUR ITALIAN Project (2002-2004) Video Transcoding (2002-2008) Video Annotation (2004-2008) • EU VI FP DELOS Project (2004-2008) • EU VII FP VIDI-VIDEO Project (2007-2009)

  7. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Video surveillance-oldprojects • Experimentssince 1996 ( Universityof Ferrara, UniversityofBololgna) • Projectswith Bologna Municipality (1997-1999) • Sakbot project (Universityof Modena) (1998-2001) • “Domotica per Disabili” Project indoor surveillance (2001-2003) • SakbotforTraficon (2003-2006)

  8. Rita Cucchiara-ImageLAB-DII Università di Modena e Reggio Emilia Video-surveillancenow (1/2) • LAICA (Laboratorio di Ambient Intelligence per una Città Amica)fundedby Regione Emilia-Romagna, Italy (2005-2006-?) Collab. With WTI Techn., Regulus, Comune Reggio Emilia… Surveillance in public parkswithdistributed and ptzcameras. • BE-SAFE BheaviorlEarningfoirSurveillanceapplicationwithfeatureextraction–NATO Science forPeaceprogram (2007-2008) With Israel (HebrewYniv, Magal) • Automatic real-time detection ofinfiltratedobjectsfor security ofairports and trainstations(2006-2008) AustralianResearchCouncil withUniversityoftecnlogy, Sidney • FREE-SURF: Free Surveillance in a Privacy Respectful way FundedbyItalian MUR PRIN Project (2006-2008) WithUniv. offirenze, Palermo, IRST Trento

  9. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Video-surveillancenow (2/2) • CollaborationwithMunicipalPolicy of Modena forforensisanalysis (2006-2007) • Mobile remote Surveillance (2006-2007) fundedbyER PRIITT project with Sistemi integrati spa • Trafficanalysis on highway (2007) withDigitekspa • VISOR Project in Vidivideo (2007-2009) • Smoke detection (WTI 2007)

  10. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia People real time remote surveillance • 2003 -2004 “Domotica per Disabili” FCR Modena • Posture detection for domotic application • 2006 PRIITT “Videosorveglianza mobile” Sistemi Integrati remote surveillance with h264 streaming

  11. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Remote Surveillance • Mobile surveillance • Int. Symp. On Multimedia 2007

  12. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Projects at imagelab • 2004-2006 vehicle and traffic surveillance - Traficon (B) S.Diego highway

  13. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Projects at ImageLab • 2005-2006 LAICA ProjectLaboratorio di Ambient Intelligence per una Città Amica Piano Telematico ER • Public park in Reggio Emilia, • Modena Campus

  14. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Projects at ImageLab • (2006-2008) Automatic real-time detection of infiltrated objects for security of airports and train stationsAustralian Research Council

  15. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Project at imagelab • NEW • 2007-2009 Free SURF free surveillance in a privacy respectful way MIUR PRIN Project (national coordinator) • 2007-2009 BE SAFEBehavioral lEarning in Surveilled Areas with Feature Extraction NATO Science for Peace project with Israel

  16. Rita Cucchiara-ImageLAB-DII Università di Modena e Reggio Emilia Multiple-people Multiple-camera surveillance 1) single fixed camera • SAKBOT: Movingobjectsegmentation (PAMI 2003) • Shadowanalysis (PAMI2003) • Trackingwithocclusions (PR-submitted) • Posture analysis (T SMC 2004) • Face detection (PRL 2005) 2) single moving PT camera • Mosaicing • Motionclustering(RTI 2004) 3) multiple (overlappedFoVs) cameras • HECOL Homography and Epipolarbasedconsistentlabeling (PAMI Submitted, CVIU) 4) multiple (notoverlappedFoVs) cameras • Color analysis and retrieval 5) Trajectoryanalysis • trajectoryclusteringforabnormality detection

  17. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Video surveillance Surveillance of • Environment • Traffic • People Natural environment (fire detection, fog detection…,) Urban Environment ( crowd monitoring in stations, metro..) Abnormal situations detection Road traffic control: Statistical control ( vehicles monitoring, classification ) Accident detection ( queue, incidents..) Urban control: people at road crossing, privileged path.. Naval, aerial traffic control Security: people detection in specific area people tracking for abnormal behavior detection people interaction analysis Safety: people behavior monitoring in house and offices people behavior analysis in public place people behavior analysis in car

  18. modelli Data Storage Data Acquistion modelli internet/ intranet Data Compression Data Compression Universal Multimedia Access Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Human-based video surveillance • Most of commercial available video surveillance systems still provide acquisition, storage (and access) only

  19. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Human-based video surveillance • System generations • 1) analog cameras and CCTV video monitors

  20. 2) Digital video recorder system 3) Digital PC based or embedded encoding system Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Human-based video surveillance • System generations

  21. 4) LAN cameras 5) LAN cameras with streaming Wireless cameras Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Human-based video surveillance • System generations

  22. modelli Data Acquisition DBMS modelli Knowledge extraction Intra-inter net Human/machine based Control center Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Human-based video surveillance • Effort in new hardware solutions • Distributed vs centralized • New cameras • PTZ, infrared, thermal, omnidirectional panoramic cameras • Standard vs. stand alone encoding solutions • User friendly (multimedia) human interface • Exploiting motion detection • Improving human attention • Storage space saving

  23. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia (Automated) computer vision-basedvideo surveillance • Exploiting image processing, pattern recognition and computer vision techniques in order to • Extract moving objects • Detect variations of objects’ motion status • Measure object flow • Classify people and other objects • Track people and objects • Consistent Track in distributed system • Recognize Bheavior, posture, interaction

  24. Sakbot Ad hoc Hecol PPC Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Multiple-people Multiple-camera surveillanceat ImageLab Projects and prototypes since 1996

  25. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Related Imagelab bibliography • TRAFFIC CONTROL • R. Cucchiara, P. Mello, M. Piccardi,"Image Analysis and Rule-Based Reasoning for a Traffic Monitoring," IEEE Transactions on Intelligent Transportation Systems, vol. 1, n. 2, pp. 119-130, 2000 • SAKBOT • R. Cucchiara, C. Grana, M. Piccardi, A. Prati “Detecting Moving Objects, Ghosts and Shadows in Video Streams“, IEEE Transactions on Pattern Analysis and Machine Intelligence, july 2003 • SHADOW DETECTION • Prati, I. Mikic, M.M. Trivedi, R. Cucchiara, "Detecting Moving Shadows: Algorithms and Evaluation," IEEE Transactions on Pattern Analysis and Machine Intelligence, July 2003 • POSTURE ANALYSIS • R. Cucchiara, C. Grana, A. Prati, R. Vezzani, "Probabilistic Posture Classification for Human Behaviour Analysis" in IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, vol. 35, n. 1, pp. 42-54, 2005 • MULTISENSOR • R. Cucchiara, A. Prati, R. Vezzani, L. Benini, E. Farella, P. Zappi, "An Integrated Multi-Modal Sensor Network for Video Surveillance" Journal of Ubiquitous Computing and Intelligence (JUCI), 2006 • DISTRIBUTED SURVEILLANCE • S.Calderara, A.Prati, R. Cucchiara, HECOL Homography and epipolar based consistent labeling for outdoor park surveillance in press on Computer vision and Image Understanding 2007 • FACE DETECTION • R. Cucchiara, A. Prati, R. Vezzani, "A System for Automatic Face Obscuration for Privacy Purposes" in Pattern Recognition Letters, vol. 27, n. 15, pp. 1809-1815, 2006

  26. I t B Background t Background Update Suppression DB t Shadow detection Segmentation Object validation ghost MVO Ghost Ghost shadow MVO shadow MVO MVO shadow t Ghost shadow Tracking Objects History Scene Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Moving object segmentation:SAKBOT • 1) Statistical and knowledge based background modeling • 2) color based background suppression with shadow detection • 3) Classification and MVOs segmentation

  27. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia SAKBOT RESULTS • Experiments against PETS2001, PETS2006 VSSN dataset First classified in background suppression competition ACM Multimedia VSSN06 S.Barbara USA • Future implementation in Intel OpenCV • Used • in indoor and outdoor applications (people detection) • In traffico control • In sea surveillance

  28. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Multiple people Tracking with occlusions: Ad Hoc • Ad hoc : Appearance-based, with occlusion classification tracking • Probabilistic model of tracking • Appearance based (probabilistic at pixel level) • Discriminative: detect the best position and appearance at each frame • Handling occlusion • Occlusion classification • Keep object appearance also during occlusion

  29. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Example • Example of tracking without occlusion update

  30. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Example

  31. park building sec. entrance building Main entrance c1 road benches c2 c1 Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia HECOL: distributed surveillance • HECOL Homography and epipoles based consistent labeling, in a probabilistic framework.. • Compute overlapped camera FoV • Construct the Camera Transition Graph • Sakbot + Ad Hoc tracking for each camera • when one or more new objects are in the overlapped area • Prune the search space with CTG • Construct the hypotheses space • Construct the forward and backward probability to link to other single or group of people • Solve with a double MAP the consistency

  32. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Homography and epipolar lines

  33. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia A priori and conditional probability Matching With occlusion With multiple people

  34. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia

  35. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia

  36. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia

  37. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia New and Future works Tracking people with PT cameras Bheavior analyis Face tracking for identification Surveillance video annotation (VIDI Video Project)

  38. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Smoke detection

  39. Rita Cucchiara- ImageLAB-DII Università di Modena e Reggio Emilia Future events • ICIAP • http://localhost/iciap07/ • International Conference on • Pattern recognition and computer vision • Multimedia • Human centered application • Security and surveillaince • Industrial applications • Workshops • Computational Color imaging • DELOS Visual and Multimedia digital library • The Industrial Forum • European project forum For more information… http://imagelab.ing.unimo.it Rita Cucchiara Tel. 059 2056136 rita.cucchiara@unimo.it

More Related