220 likes | 407 Views
Data Set and Ground Truth. Data set and Ground truth. Data set contents Data set resources Ground truth contents Ground truth resources. Data set contents. Goal: Capture realistic video sequences with graduate difficulties: lighting variations, occlusions …
E N D
Data set and Ground truth • Data set contents • Data set resources • Ground truth contents • Ground truth resources
Data set contents Goal: Capturerealisticvideo sequences with graduate difficulties: • lighting variations, • occlusions … covering predefined scenarios.
Data set contents Video providers, main characteristics • Inrets: Building Entrance, Indoor/Outdoor, Multi-view • CEA: Corridor + Road, Indoor/Outdoor, Visible/IR • RATP: Metro, Indoor, Crowded environment • iLids: Road, Outdoor, Real street context • Silogic: Aircraft parking zone, Multi-view
Data set contents 5 Topics • Apron • Building Corridor • Building Entrance • Metro • Road
Data set contents 2 points of view APRON Different weather conditions
Data set contents BUILDING CORRIDOR Visible and IR clip
Data set contents BUILDING ENTRANCE Entrance and Car Park 4 points of view
Data set contents METRO Real subway scene
Data set contents ROAD Visible and IR clip Real scene
Data set and Ground truth • Data set contents • Data set resources • Ground truth contents • Ground truth resources
Data set resources • 2 video data set (test + evaluation) • 2*2 DVD provided • Documentation (metrics, annotation rules, structures and formats) • Context and calibration information • Data base (xls file)
Data set and Ground truth • Data set contents • Data set resources • Ground truth contents • Ground truth resources
Ground truth contents • Context information • Physical objects of interest and events annotation Annotation rules provided to participant in a document and updated during the project Examples…
Data set and Ground truth • Data set contents • Data set resources • Ground truth contents • Ground truth resources
Conclusion & Feedback Difficulties encountered: • Definition of event • Annotation subjectivity Proposition for other evaluation project: • Ground truth done before data set distribution: Easier to identify difficulties that may encountered participants and add explanations and specific annotation rules • Ground truth given between the deadline submission and the results processing to be able to correct ground truth before evaluation -> Time consuming