60 likes | 75 Views
Learn about SVD, M = U.S.VT, the concept of Orthogonal, Rotate, Stretch, and how to interpret matrices into scaled outer products. Explore the separate operations in each dimension. Discover the key insights behind SVD.
E N D
Math Tools
Singular Value Decomposition (SVD) M = U S VT Orthogonal Orthogonal (“Rotate”) (“Rotate”) Diagonal (“Stretch”)
SVD S U VT Output Scaling Input
A simple case V= U S VT u2 O S I x Outer Product! v2 u1 v1
SVD can be interpreted as • A sum of outer products! • Decomposing the matrix into a sum of scaled outer products. • Key insight: The operations on respective dimensions stay separate from each other, all the way – through v, s and u. • They are grouped, each operating on another piece of the input.