250 likes | 269 Views
Explore the goals of traffic management, types of traffic sensors, advantages and disadvantages of video sensors, hardware and software enhancement methods, and the future of video road sensors.
E N D
Future Internet Applications for Traffic Surveillance and Management 27-28 October 2011 Sofia, Bulgaria APPLICATIONS OF VIDEO SURVEILLANCE SYSTEMS FOR TRAFFIC DATA ACQUISITION Author: Vasil Lakov e-mail: supervas220@gmail.com
Applications of video surveillance systems for traffic data acquisition TOPICS • Goals of traffic management • Types of traffic sensors • Video road sensors • Advantages of video sensors • Disadvantages of video sensors • Hardware enhancement methods • Software enhancement methods • Future of video road sensors • Conclusion • Examples Slide: 1 / 24
Applications of video surveillance systems for traffic data acquisition • Goals of traffic management • Control by: • Adaptive road intersection • New roads • More parking space • GPS traffic services • Planning of public transport • VMS signs • Law enforcement • Decisions: • Road capacity • Overall view of network • Choosing best projects • Exchanging traffic info • Speed limits • Monitoring of: • Road network utilization • Rush hours • Environmental pollution • Travel times and delays • Dangerous roads • Traffic violations Slide: 2 / 24
Applications of video surveillance systems for traffic data acquisition • Types of traffic sensors In-vehicle sensors (route monitoring) Road sensors (point monitoring) • Mobile phones • GPS navigation • RFID transponders • Microwave radars • Laser scanners • Ultrasound scanners • Audible sound sensors • Infrared cameras • Normal CCTV cameras Slide: 3 / 24
Applications of video surveillance systems for traffic data acquisition • Types of traffic sensors In-vehicle sensors Mobile phones location: Which phone to track? When to track it? Not so accurate! Slide: 4 / 24
Applications of video surveillance systems for traffic data acquisition • Types of traffic sensors Road sensors blue zone – microwave red zone – passive infrared green zone – ultrasonic Slide: 5 / 24
Applications of video surveillance systems for traffic data acquisition • Video road sensors • System parts: • Video cameras • Communication network • Computers + software • System architecture: • Centralized • Distributed • Hybrid Operation: Video frames processing with computer/machine vision techniques Slide: 6 / 24
Applications of video surveillance systems for traffic data acquisition • Video road sensors Only watching Automatic traffic data collecting and watching • Centralized system: • Easy upgrading of functions • Standard cameras • Existing cameras • Distributed system: • Low speed connection • Less complex computers • More expensive cameras Slide: 7 / 24
Applications of video surveillance systems for traffic data acquisition • Advantages of video sensors Video road sensors are good choice for traffic surveillance because: • Using existing CCTV networks • Using existing control centers • Covering many road lanes • Covering long road sections • Capable of detecting traffic violations and incidents • Relocatable traffic sensors • Possibility for adding new functions • Provide video signal without additional devices Slide: 8 / 24
Applications of video surveillance systems for traffic data acquisition • Advantages of video sensors • Additional video sensors features: • Easy installation • Simple maintenance • IT systems integration All this means that video sensors are: • Cheap solution • Universal solution for many traffic projects • Shorter time for deployment • Technology with long life cycle • Adaptable solution to every customer Slide: 9 / 24
Applications of video surveillance systems for traffic data acquisition • Disadvantages of video sensors The difficulties come from video frames processing. There are 3 sources for sub-optimal results: • Low light and bad weather conditions • Scene complexity • Low quality of video frames • Low light and bad weather: • Night time • Heavy rain and snow • Thick fog and mist • Light reflection • Scene complexity: • Camera position and orientation • Various moving objects • Buildings, trees, structures • Low quality: • Camera lens • Image sensor • Low resolution • Blurry image Slide: 10 / 24
Applications of video surveillance systems for traffic data acquisition • Disadvantages of video sensors • Low light and bad weather: • Objects detection • Vehicles missed • Vehicle classification • Vehicle identification • Scene complexity: • Merging of adjacent cars • Counting people and objects • False alarms for violations • Mixing different traffic flows • Low quality: • Video frame distortion • Incorrect traffic params • Unstable frame quality and parameters Slide: 11 / 24
Applications of video surveillance systems for traffic data acquisition • Hardware enhancement methods • Hardware ways for better image quality precede software frame processing stage! • For best results it is necessary to: • Choose appropriate camera installation place • Choose special camera for the traffic monitoring • Configure camera functions for best performance • Use optical filters Slide: 12 / 24
Applications of video surveillance systems for traffic data acquisition • Hardware enhancement methods • Camera place: • High place (pole, traffic light) > 10 m • Road-side building • On the median, center of roadbed or close to road • Tilted down, towards the road, without sky • Shooting receding traffic if height is small • Camera characteristics: • Stationary camera • Zoom is not necessary • Progressive scan matrix • Camera lens with bigger aperture • Optical image stabilization Slide: 13 / 24
Applications of video surveillance systems for traffic data acquisition • Hardware enhancement methods • Optical filters: • Ultraviolet cut filter • Polarized filter • Camera functions: • Back Light Compensation ― • Automatic White Balance ― • Automatic Focus ― • Automatic Iris ― • Automatic Gain Control + • Automatic Electronic Shutter + UV filter reduces haziness created by ultraviolet light. Polarizing filter stopsthe light with a particular direction of polarisation. This reduces oblique reflections and can saturate the image. • Additional video parameters: • Gamma correction • Brightness correction • Contrast correction Slide: 14 / 24
Applications of video surveillance systems for traffic data acquisition • Software enhancement methods After we have excellent video quality, we can write the software (Actual sensor, retrieving traffic data). • Software stage include: • Foreground object detection (identification) / Background evaluation • Object filtering ! • Vehicle filtering ! • Measuring vehicle parameters • Vehicle classification • Checking for violations and accidents Slide: 15 / 24
Applications of video surveillance systems for traffic data acquisition • Software enhancement methods Machine vision is very powerful tool for video object detection. There are many methods and algorithms for this task. Some of them are more or less affected by image quality, vehicle occlusions and other factors. For getting accurate traffic data, it is necessary to do two-stage data filtering. First stage include video frame filtering and second stage filters measured objects parameters. Only after this stage we can count and classify vehicle and check for violations! Filtering and vehicle properties calculating tasks need some parameters to be set up. This is done automatically or manually in the beginning. • Such parameters can be: • Camera height and lens focal length • Road section length, number and borders of lanes • Real world - video coordinates calibration (2D -> 3D) • Threshold values for image binarization, speed limits • ROIs, maximum length and height of vehicles • And many others, depending on algorithms used Slide: 16 / 24
Applications of video surveillance systems for traffic data acquisition • Software enhancement methods Video filtering: Frame – Background Binarized difference Real vehicle detected • Real vehicle properties change slightly between two video frames: • Size • Shape • Speed • Direction • Location Slide: 17 / 24
Applications of video surveillance systems for traffic data acquisition • Future of the video road sensors Development of video road sensors has to be in the direction of solving two base problems: vehicle occlusions and shadow merging and night time working. Occlusions and shadows can be passed over by applying 3D scene recognition with stereoscopic cameras or by calculating object alignment from single 2D video frame. Working during the night can be improved by using more sensitive image sensors in the camera, electronically and digitally intensifying video frames, using infrared projector or by developing new image analyzing algorithms. Slide: 18 / 24
Applications of video surveillance systems for traffic data acquisition • Conclusion • Perfect video sensors have these hardware features: • Progressive scan camera • Optical image stabilization • Vary-focal lens • Fully corrected lens • Ultraviolet and polarized optical filters • DSP computer block and IP communication link • Perfect software features: • Constant and on-demand video streaming • Memory for on-site data storing • Remote update of software • Two-stage data filtering Slide: 19 / 24
Applications of video surveillance systems for traffic data acquisition • Examples Set region of interest (ROI) in the video frame – only road and vehicles Good position for the camera, but the intersection is large! (there are many vehicle flows) Slide: 20 / 24
Applications of video surveillance systems for traffic data acquisition • Examples During bad weather the traffic slows down and traffic management gets really important! No shadows, but the road is white not dark! • Bad combination: • Night time • Wet road Head lights reflections! (counting head lights is not good) Slide: 21 / 24
Applications of video surveillance systems for traffic data acquisition • Examples • Night time: • Wrong place • Low quality image • Many unwanted objects • Single camera – the whole city • Megapixel camera • Separate small subzones • Camera installed on skyscraper Slide: 22 / 24
Applications of video surveillance systems for traffic data acquisition • Examples Intersection monitoring Tracking vehicles and pedestrians (danger situation - car on crossing) Detection and classification of objects (features tracking – without occlusion) Slide: 23 / 24
Future Internet Applications for Traffic Surveillance and Management APPLICATIONS OF VIDEO SURVEILLANCE SYSTEMS FOR TRAFFIC DATA ACQUISITION Thank you for your attention! The road ahead! Vasil Lakov supervas220@gmail.com Slide: 24 / 24