1 / 27

Are Buildings Only Instances? Exploration in Architectural Style Categories

Are Buildings Only Instances? Exploration in Architectural Style Categories. Abhinav Goel , Mayank Juneja and C.V. Jawahar Centre for Visual Information and Technology IIIT Hyderabad. Instance Retrieval. Oxford Buildings, Philbin et. al (2007). Smooth Object Retrieval,

galvin
Download Presentation

Are Buildings Only Instances? Exploration in Architectural Style Categories

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Are Buildings Only Instances?Exploration in Architectural Style Categories Abhinav Goel, MayankJuneja and C.V. Jawahar Centre for Visual Information and Technology IIIT Hyderabad

  2. Instance Retrieval Oxford Buildings, Philbinet. al (2007) • Smooth Object Retrieval, • Arandjelović and Zisserman(2011) Video Google, Sivicet. al (2003)

  3. Category Retrieval CATEGORY Retrieval : Hampi Temples QUERY IMAGE INSTANCE Retrieval : Vittala Temple Entrance Images

  4. Category Retrieval CATEGORY Retrieval : Hampi Temples QUERY IMAGE Same architectural style Different sites CATEGORY Retrieval : Vijaynagara Empire

  5. Architectural Styles Retrieval Mughal Domes Pyramid Dravidian Classification Twin Minarets British Query Image Retrieved Images Mining

  6. Classification Pipeline Original Image SIFT Features at Interest Points HOG Blocks (3x3) at Interest Points Histogram Representation

  7. Classification Pipeline St. Elisabeth’s Church SagradaFamilia Casa Batllo Casa Mila Casa LleoMorera Testing Set Training Set Art Noveau Architecture

  8. Dataset of European Monuments Art Noveau Baroque Gothic Renaissance Romanesque

  9. Bag of Words Method Character Recognition in Natural Images, ManikVarma, 2009

  10. Mining Pairs of Visual Words Visual Phrases

  11. Mining Pairs of Visual Words k1 k3 k2 k3 i k5 k1 k2 k5

  12. Mining Pairs of Visual words Top P visual word pairs P-length extended histogram K X K pair histogram

  13. Results Image Categorization Image Retrieval Query Results

  14. Comparison Visual Pattern, Chu et. al, ICMR (2012)

  15. Discovering Semantic Patterns

  16. Why Mining is Hard • Clustering based methods • Not discriminative • Large dimensional features • Discriminative Classifier based methods • Millions of windows to be searched – Slow • Leverage Instance retrieval to solve Category retrieval • Inverted index for fast searching • Spatial verification for efficient matching • Retrieval in the order of milliseconds

  17. Seed Generation Candidate Seeds

  18. Mining Characteristic Features Query Image Retrieved Results

  19. Refining • Spatial Verification • Affine transformation • Generate hypotheses from single pair of correspondences • Allow for large re-projection errors • LBP Refinement • Represent each image as histogram of LBP features

  20. Results: Gothic Architecture • http://en.wikipedia.org/wiki/Rose_window

  21. Results: Gothic Architecture • http://en.wikipedia.org/ • wiki/Gothic_architecture

  22. Results: Renaissance Architecture • http://en.wikipedia.org/wiki/Renaissance_architecture

  23. Results: Baroque Architecture • http://en.wikipedia.org/wiki/ • Baroque_architecture

  24. Where are We? • Interesting architecture classification problem. • Efficient mining technique, using instance retrieval pipeline. • Semantically meaningful regions. • Use these for classification, retrieval.

  25. Thank You Extending our mining algorithm to Google Street View

More Related