Signal Processing and Representation Theory

Signal Processingand Representation Theory Lecture 4

Outline: • Review • Fourier Transforms • Applications • Invariant Descriptors

Representation Theory Review Circle: If G is the group of 2D rotations / reflections, acting on the space of functions on the circle, the irreducible sub-representations of G are the 1D subspaces spanned by the complex exponentials: Vk=Span{eik}

Representation Theory Review Circle: Given a function f defined on the circle, we can obtain a rotation / reflection invariant representation by computing the Fourier decomposition:and storing the norms of the Fourier coefficients:

Representation Theory Review Circle: Given two functions f and h defined on the circle, we can correlate the functions by computing the Fourier decompositions:multiplying the Fourier coefficients:and computing the inverse Fourier transform.

Representation Theory Review Sphere: If G is the group of 3D rotations / reflections, acting on the space of functions on the sphere, the irreducible sub-representations of G are the (2d+1)-dimensional subspaces spanned by the spherical harmonics of frequency d:

Representation Theory Review Sphere: Given a function f defined on the sphere, we can obtain a rotation / reflection invariant representation by computing the spherical harmonic decomposition:and storing the norms of the frequency components:

Representation Theory Review Sphere: Given two functions f and h defined on the sphere, we can correlate the functions by computing the spherical harmonic decompositions:multiplying the spherical harmonic coefficients:and computing the inverse Wigner-D transform.

Outline: • Review • Fourier Transforms • Applications • Invariant Descriptors

Representation Theory Fourier Transforms 2D: If we have the space of functions in the plane, we can consider the representation obtained by the group of translations. Since translations are commutative, Schur’s Lemma tells us that the irreducible representations are all one-dimensional.

Representation Theory Fourier Transforms 2D: The irreducible representations are the sub-spaces spanned by the functions: Translating each function by (x0,y0) we get:

Representation Theory Fourier Transforms 2D (Invariance): If f(x,y) is a function defined on the plane, we can express the function in terms of its Fourier decomposition:and obtain a rotation invariant representation by storing the energy in each frequency:

Representation Theory Fourier Transforms 2D (Correlation): If f and g are functions defined on the plane whose Fourier decompositions are:the correlation of f with g over the space of translations can be computed by multiplying the Fourier coefficients:

Representation Theory Fourier Transforms 3D: If we have the space of functions in 3D, we can consider the representation obtained by the group of translations. Since translations are commutative, Schur’s Lemma tells us that the irreducible representations are all one-dimensional.

Representation Theory Fourier Transforms 3D: The irreducible representations are the sub-spaces spanned by the functions: Translating each function by (x0,y0,z0) we get:

Representation Theory Fourier Transforms 3D (Invariance): If f(x,y,z) is a function defined in 3D, we can express the function in terms of its Fourier decomposition:and obtain a rotation invariant representation by storing the energy in each frequency:

Representation Theory Fourier Transforms 3D (Correlation): If f and g are functions defined in 3D whose Fourier decompositions are:the correlation of f with g over the space of translations can be computed by multiplying the Fourier coefficients:

Outline: • Review • Fourier Transforms • Applications • Circle • 2D • Sphere • 3D • Invariant Descriptors

Representation Theory Applications Circle: If we have a real-valued function f on the circle, we can express the function in terms of its Fourier decomposition:where ak,bkℝ and bk=-b-k.

Representation Theory Applications Circle: Given the space of real-valued functions on the circle, the Fourier decomposition can be used for correlation and invariants-extraction with respect to the group of 2D rotations / reflections.

Representation Theory Applications Circle: What if we consider the smaller group of axial flips:that arise due to the ambiguity in PCA alignment?

Representation Theory Applications Circle: Initial x-flip y-flip x,y-flip f() f(-) f(π-) f(π+)

Representation Theory Applications Circle: Because axial flips are a subgroup of the rotations / reflections, sub-representations for the entire group of rotations / reflections are also sub-representations for the group of axial flips.

Representation Theory Applications Circle: Initial x-flip y-flip x,y-flip f() f(-) f(π-) f(π+)

Representation Theory Applications Circle: If f is a real-valued function on the circle expressed in terms of its Fourier decomposition as:an axial-flip invariant representation can be obtained by storing the norms of the real and imaginary components:

Representation Theory Applications Circle: If f and h are real-valued functions on the circle, we could compute the correlation of f with h over all axial flips by comparing at each axial flip independently. This would take four times as long.

Representation Theory Applications Circle: Instead, if we express f and h in terms of their Fourier decomposition:then the correlation of f with h becomes:

Representation Theory Applications Circle: By computing the different summations independently:we can compute the correlation at the different axial flips more efficiently. α (real, even) β (imaginary, even) γ (real, odd) δ (imaginary, odd)

Representation Theory Applications Circle: Initial x-flip y-flip x,y-flip

Representation Theory Applications Circle: So by pre-computing the values of α, β, γ, and δ, we can compute the correlation at each of the four axial flips by summing the values of α, β, γ, and δ with the appropriate sign. Instead of taking 4 times as long, it takes 16 extra arithmetic ops. to compute the correlation values.

Representation Theory Applications 2D (Rotation): If we are given a function f defined on the set of points inside the unit disk (x2+y21), we can express the function in terms of radius and angle: r 

Representation Theory Applications 2D (Rotation): If we hold the radius fixed, we get a function defined on a circle:and we can apply methods from functions on a circle to obtain rotation invariants and to correlate. r 

Representation Theory Applications 2D (Rotation): To get rotation invariants, we can express the initial function f as a collection of circular functions, obtained by restricting f to different radii: r 

Representation Theory Applications 2D (Rotation): Computing the Fourier decomposition of each circular restriction:we can obtain a rotation invariant representation by storing the norms of the different frequency components of the different circular restrictions:

Representation Theory Applications 2D (Rotation): To correlate two functions f and h, we can express the initial functions as collections of circular functions, obtained by restricting to different radii:

Representation Theory Applications 2D (Rotation): Then the correlation can be obtained by multiplying the Fourier coefficients of each of the restrictions: Complexity: • 2N forward Fourier Transforms: O(N2 logN) • Frequency multiplication: O(N2) • One inverse Fourier Transform: O(N logN)

Representation Theory Applications 2D (Axial Flips): Given two functions f and h defined on the plane, we can express the two functions in terms of the Fourier decomposition of their radial restrictions:with ar,k,br,k,cr,k,dr,kℝ.

Representation Theory Applications 2D (Axial Flips): By computing the different summations independently:the correlation at all four axial flips can be computed with only 16 extra arithmetic operations. α (real, even) β (imaginary, even) γ (real, odd) δ (imaginary, odd)

Representation Theory Applications Sphere: If we have a real-valued function f on the sphere, we can express the function in terms of its spherical harmonic decomposition:where alm,blmℝ, al-m=(-1)malm, and bl-m=(-1)mblm.

Representation Theory Applications Sphere: Given the space of real-valued functions on the sphere, the spherical harmonic decomposition can be used for correlation and invariants-extraction with respect to the group of 3D rotations / reflections.

Representation Theory Applications Sphere: What if we consider the smaller group of axial flips:that arise due to the ambiguity in PCA alignment?

Representation Theory Applications Sphere: Because axial flips are a subgroup of the rotations / reflections, sub-representations for the entire group of rotations / reflections are also sub-representations for the group of axial flips.

Representation Theory Applications Sphere: Using the facts that:and the harmonic of frequency l are even (resp. odd) when l is even (resp. odd), we get:

Representation Theory Applications Sphere: An axial flip invariant representation can be obtained by computing the spherical harmonic decomposition: and separately storing the norms of the real and imaginary components of the harmonic coefficients:

Representation Theory Applications Sphere: and in a similar manner as before, we can compute the correlation at all eight axial flips with only 64 extra arithmetic operations.

Representation Theory Applications 3D (Rotation): If we are given a function f defined on the set of points inside the unit disk (x2+y2+z21), we can express the function in terms of radius and angle:

Signal Processing and Representation Theory