Download
1 / 34
350 likes | 501 Views
Detection and Classification of Vehicles from a video using Time-Spatial Image. Nafi UR RASHID, NILUTHPOL CHOWDHURY, BHADHAN ROY JOY S. M. MAHBUBUR RAHMAN. Department of Electrical and Electronic Engineering Bangladesh University of Engineering And Technology Dhaka – 1000, Bangladesh.
E N D
Detection and Classification of Vehicles from a video using Time-Spatial Image Nafi UR RASHID, NILUTHPOL CHOWDHURY, BHADHAN ROY JOYS. M. MAHBUBUR RAHMAN Department of Electrical and Electronic Engineering Bangladesh University of Engineering And Technology Dhaka – 1000, Bangladesh ICECE 2010
WHY Vehicle Detection AND Classification SYSTEM (VDCS)? • Traffic flow parameter extraction • Intelligent transportation system • Automated traffic control • Automated vehicle counting • Automated checking of toll collection • Toll booth – Bridges, Avenues • Parking lot – Hospital, Shopping Mall • Detection of traffic violation • Speed monitoring • Lane monitoring ICECE 2010
Common TECHNIQUEs • Mechanical techniques - • Induction Loop Sensor • Pneumatic Road Tube • Weight-in-motion Sensor • Piezoelectric Cable Sensor ICECE 2010
LIMITATIONS • High space requirement • High installment & maintenance cost • Setup & repair process time consuming • Calibration • Mechanical Error • Hardware Based ICECE 2010
SMARTAPPROACH - VIDEO PROCESSING • Nonintrusive method. • Less installation and maintenance cost. • No disruption of traffic for installation and repair. • Remote traffic surveillance • Efficient classification of vehicles • Software based • Features & parameters are adaptive • Advanced DSP algorithms could be applied ICECE 2010
Existing Video-based detection system • Motion-based systems • Optical Flow • Gaussian Model • Background Subtraction • Problems of existing systems: • Heavy computational load • Highly sensitive to jittering & pixel intensity • Less suitable for real-time implementation ICECE 2010
Proposed method • VIRTUAL DETECTION LINE BASED METHOD • Time Spatial Image (TSI) Generation • contains both temporal and spatial information • Vehicular width can be approximated • Ensures faster extraction of Key Vehicular Frame(KVF) • Tracking independent • Only one frame per classification • Simple yet efficient • Low computational load ICECE 2010
Virtual Detection line Frame 1 Frame 2 Virtual Detection Line A strip of pixel perpendicular to the direction of vehicle travelling Back ICECE 2010
TSIGeneration Frame 12 ICECE 2010
TIME SPATIAL IMAGE (TSI) Frame 692 ICECE 2010
Edge detection EDGE DETECTOR ICECE 2010
MORPHOLOGICAL OP. EDGE DETECTOR MORPHOLOGICAL OPERATIONS ICECE 2010
TSI PROCESSING Source video TSI Vehicular Blob (TVB) Width Bounding Box Center of Bounding Box ICECE 2010
TSI PROCESSING Center of Bounding Box ICECE 2010
KEY VEHICULAR FRAME • A time frame on which the midpoint of the vehicle is approximately on the VDL • Only KVF requires further processing • No background processing required Bike Car 2 Leguna Car 1 Back ICECE 2010
Segmentation KVF TSI ICECE 2010
Morphological Op. Canny Edge Detection Blob = ((Im⊕Obj)ΘObj) Obj = 5x5 rectangle Filling ‘holes’ ICECE 2010
Feature Extraction • Shape-based feature • Extracted from vehicle blob of TSI & KVF • Feature Selection Criteria: • Distinctiveness • Computational efficiency • Sensitivity to environment • Non-Redundancy ICECE 2010
Features . • Selected Shape-Based Features: • TVB Width • Length-Width Ratio • Major Axis-Minor Axis Ratio • Area • Compactness • Solidity ICECE 2010
Features TVB Width: Vertical length of the segmented region of TSI Vehicle Blob ICECE 2010
Features . Length-Width Ratio : ICECE 2010
Features . Major Axis-Minor Axis Ratio: • This ellipse has the same normalized second central moments as the segmented region. ICECE 2010
Features . Area: • Number of white pixels in the segmented region. ICECE 2010
Features . Compactness: • Determines how compact(circular) a shape is. ICECE 2010
Features . Solidity: • Convex Area is the area of smallest polygon that contain the region ICECE 2010
Feature vector Table ICECE 2010
Classification • K- Nearest Neighborhood (KNN) • Linear • Weighted Distance Measurement • Majority Voting • Why KNN? • Sufficiently low computational complexity • Standard & optimum • Significantly good classification performance • . ICECE 2010
Classification • Steps of obtaining Training Data Set: • Feature vectors were obtained from handpicked vehicles • Obtained feature vectors were partitioned with Fuzzy C-Means Clustering algorithm • Why FCM? • Reduction of memory requirement • Speeding up of searching time • Majority voting among the training data set determines vehicle class ICECE 2010
Experimental Setup • Camera Elevation: 21 feet • Camera Angle: 45 degrees • Frame Rate: 25 fps • Resolution: 144x176 pixels • Color Profile: Monochrome • Weather Condition: Sunny, Cloudy, Normal • System Specification: Intel Pentium D 2.66 GHz, 1GB DDR2 RAM ICECE 2010
Block Diagram Object Detection Feature Extraction Video-Input Extracted Frames KVF Extraction Training Dataset KNN VDL Blob Detection Class Type TSI Generation ICECE 2010
Experimental Data Method [1]: ICPR 2002, IICETC 2009 Method [10]: In. J. Intel. Eng. Sys. 2009 Total Frames: 3082 (Sequence 1) Method [1]: 35.4s Proposed Method: 10.3s ICECE 2010
Future WORK • Introduction of texture based & motion invariant • features to reduce classification errors • Multiple VDL • Speed Calculation • Improved detection & classification • Occlusion minimization ICECE 2010
Conclusion • Significant improvement in terms computational load • Efficient designing of intelligent transportation system • Significantly low misclassification & misdetection rate than that of traditional methods • Practically implementable in many important sectors ICECE 2010
