1 / 18

A Game-Theoretic Perspective on Registration and Recognition of 3D Shapes

A Game-Theoretic Perspective on Registration and Recognition of 3D Shapes. Emanuele Rodolà <rodola@dsi.unive.it>. Surface registration. The aim is to rigidly align (“register”) two or more 3D surfaces so as to attain a utomatic assemblage of range data (demo). Surface registration.

chipo
Download Presentation

A Game-Theoretic Perspective on Registration and Recognition of 3D Shapes

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Game-Theoretic Perspective on Registration and Recognition of 3D Shapes EmanueleRodolà <rodola@dsi.unive.it>

  2. Surface registration The aim is to rigidly align (“register”) two or more 3D surfaces so as to attain automatic assemblage of range data (demo)

  3. Surface registration • Typically a 2-step process: • Coarse motion estimation • Refinement

  4. Coarse alignment Knowledge of the acquisition process Marker-based RANSAC-based DARCES PROSAC variants PCA / 4PCS / Genetic

  5. Refinement Given a “good enough” initial alignment, it is possible to refine the registration iteratively. This is usually done by establishing pointwise correspondences among the two surfaces, and using them to estimate the rigid transformation. (demo chef)

  6. A Game-Theoretic approach We cast the registration problem to an inlier selection scenario: • We are given a set of candidate correspondences (strategies) • Then we look for a robust set of inlier correspondences wrt some notion of “rigidity” • Finally we can estimate the rigid transformation between the two surfaces

  7. Enforcing rigidity We wish to bring global information into the matching process by favoring sets of point-associations that are mutually compatible with a single rigid transformation. We do this by operating at a local level. Given a model mesh M, a data mesh D, and a set of candidate correspondences (or strategies): We define a rigidity-enforcing payoff function giving a measure of compatibility among strategies:

  8. The evolutionary process The search for a solution is performed by simulating the evolution of a natural selection process. The choice of an actual selection process is not crucial and can be driven mostly by considerations of efficiency and simplicity.

  9. Building the strategies set It is not practical to deal with all the surface points from both the surfaces, i.e. we restrict to Moreover, the isolation of interest points can help to avoid false correspondences

  10. Surface descriptors Surface vertices can be described using information at the vertex and of a local patch around it. • Spin Images (ref. axis) • Integral Invariants (no ref.) • Point Signatures (ref. frame) • Signatures of Histograms (stable ref. frame) • And many more

  11. Surface Hashes To fully exploit our inlier selection method, we need descriptors with the following properties: • high repeatability • weak distinctiveness • We introduce the Surface Hashes (demo): • Normal Hash • Integral Hash • Mixed

  12. Interest point detection Relevance-based sampling Clustering (via a Matching Game) Simple threshold on the Integral Hash

  13. Enhancing the framework The set of strategies can now be greatly reduced: The descriptor prior gives better candidates The least likely correspondences are pruned The selection process converges more rapidly Much lower memory requirements Memory is the bottleneck!

  14. Object-in-clutter Focus is on recognition rather than alignment We now have a known, usually complete model to match against an incomplete and cluttered scene. (demo)

  15. Object-in-clutter A good point selection strategy Robust descriptors wrt to occlusion and clutter

  16. Object-in-clutter

  17. Future directions Scale invariance could be attained by taking into account the geodesic path between strategies • Non-rigid registration

  18. Questions?

More Related