210 likes | 328 Views
A NOVEL RIEMANNIAN FRAMEWORK FOR SHAPE ANALYSIS OF 3D OBJECTS. S. Kurtek 1 , E. Klassen 2 , Z. Ding 3 , A. Srivastava 1 1 Florida State University Department of Statistics 2 Florida State University Department of Mathematics 3 Vanderbilt University Institute of Imaging Science.
E N D
A NOVEL RIEMANNIAN FRAMEWORK FOR SHAPE ANALYSIS OF 3D OBJECTS S. Kurtek1, E. Klassen2, Z. Ding3, A. Srivastava1 1Florida State University Department of Statistics 2Florida State University Department of Mathematics 3Vanderbilt University Institute of Imaging Science *This research was supported in part by grants from AFOSR, ONR and NSF.
PROBLEM INTRODUCTION Consider these two parameterized surfaces: d(f1,f2) = ? f1 f2 Main Goal: To compare the shapes of these surfaces using a metric that is invariant to scale, translation, rotation and re-parameterization.
MOTIVATION • Medical Image Analysis • Bioinformatics • Facial Recognition • Geology • Image Matching
CURRENT METHODS • Deformable Templates - Davatzikos et al. 1996; Joshi et al. 1997; Grenander and Miller 1998; Csernansky et al. 2002. • Level Set Methods - Malladi et al. 1996. • Landmarks, Active Shape Models - Kendall 1985; Cootes et al. 1995; Dryden and Mardia 1998. • Iterative Closest Point Algorithm - Besl and McKay 1992; Almhdie et al. 2007. • Medial Representation - Siddiqi and Pizer 1992; Bouix et al. 2001; Gorczowski et al. 2010. These do not analyze shapes of parameterized surfacesdirectly, which is our goal.
PARAMETERIZED SURFACES MAIN ISSUE • S denotes a 2D smooth and differentiable surface. • Define a parameterization of surface S as . • Let Гbe the set of all diffeomorphisms of . The natural • action of Г on is on the right by composition . • In general , is not area preserving and therefore the • isometry condition is not satisfied under the metric: • Existing Solutions: • Restrict to area preserving re-parameterizations - Gu et al. 2004. • Fix the parameterization (SPHARM) of all surfaces - Brechbüler et al. 1995; Styner et al. 2006.
NEW REPRESENTATION OF SURFACES • Definition: • Given a differentiable surface f, define as the • “area multiplication factor” of f at s: • where {us, vs} is an orthonormal basis of . • b. Define a q-map, using by
SHAPE ANALYSIS OF SURFACES • Achieving the desired invariances: • Remove Directly: • Scale, . • Translation, . • Remove Using Algebraic Operations: • Rotation, SO(3): Given , the action of the rotation group is defined as (O,q)=Oq. • Re-parameterization, Г: Given , the action of the re-parameterization group is defined as
DISTANCE BETWEEN SURFACES • Equivalence Class: • Shape Space: • Distance Between Surfaces: • Distance Between Orbits: • Optimization Problem: • Rotation, SO(3): Procrustes analysis. • Re-Parameterization, Г: gradient descent.
OPTIMIZATION PROBLEM OVER Г • Define the energy as: • where γ0is fixed and γis a variable. • Define the mapping: • The Jacobian of φ(γ) is: • where b is an orthonormal basis of and . • 4. The directional derivative of E is:
INITIALIZATION OF GRADIENT SEARCH • Optimize over 60 elements in the group of symmetries of the • dodecahedron. • The largest finite subgroup of SO(3). • Equivalent to placing the North Pole at 60 different positions. f1 f2 Energy Minimizer Cost Function
BRAIN STRUCTURE SURFACES TWO LEFT PUTAMENS f1 f2 O*(f2 ◦ γ*) ||γ*(s)-s|| d([q1],[q2])= =0.0207 Energy at each iteration
BRAIN STRUCTURE SURFACES LEFT PUTAMEN AND LEFT THALAMUS ||γ*(s)-s|| f1 f2 O*(f2 ◦ γ*) d([q1],[q2])= =0.0790 Energy at each iteration
ADHD STUDY SINGLE STRUCTURE CLASSIFICATION • T1 weighted brain magnetic resonance images of young • adults of ages between 13 and 17 recruited from the Detroit • Fetal Alcohol and Drug Exposure Cohort. • Left and right brain structures (total of 11) for 34 subjects, 19 • with ADHD and 15 healthy. • Leave-one-out nearest neighbor classification scheme.
ADHD STUDY MULTIPLE STRUCTURE CLASSIFICATION • Combined weighted single structure distances to maximize • the ADHD classification rate. • Using our method, the combination of left putamen, left • pallidus and right pallidus distances provided a 91.2% • classification rate. • Other methods: • Harmonic – 85.3% • ICP – 88.2% • SPHARM-PDM – 85.3%
EXTENSION TO OTHER TYPES OF SURFACES • So far we have presented the framework and results for • shape analysis of closed surfaces only. • The extension to quadrilateral (D=[0,1]2) and hemispherical • (D=unit disk) surfaces is straightforward.
QUADRILATERAL SURFACES IMAGE MATCHING I1 I2 f1 f2 O*(f2 ◦ γ*) |I1-I2| |I1-O*(I2 ◦ γ*)| γ* d([q1],[q2])= =0.0567 Energy at each iteration
QUADRILATERAL SURFACES IMAGE MATCHING I1 I2 f1 f2 O*(f2 ◦ γ*) |I1-I2| |I1-O*(I2 ◦ γ*)| γ* d([q1],[q2])= =0.0953 Energy at each iteration
HEMISPHERICAL SURFACES CROPPED FACES f1 f2 O*(f2 ◦ γ*) ||γ*(s)-s|| d([q1],[q2])= =0.0288 Energy at each iteration
OPTIMAL PATHS BETWEEN SURFACES • We computed certain optimal paths between two toy shapes • with and without re-parameterization. • The displayed paths are not geodesic with respect to our • metric but under a metric described by Kilian et al. 2007. Without Re-Parameterization With Re-Parameterization M. Kilian, N. Mitra, and H. Pottman. “Geometric Modeling in Shape Space.”, in ACM Transactions on Graphics, vol. 26, no. 3, 2007, 1-8.
CONCLUSION AND FUTURE WORK • Shape analysis of 3D objects is very important in many • scientific fields. • We have proposed a novel approach for the analysis of 3D • objects, which is invariant to rigid motion, scaling and most • importantly re-parameterization. • This results in a proper metric on the space of q-maps. • In the future, we would like to be able to show geodesics • between surfaces. • We would also like to apply this methodology to more data • sets.