690 likes | 1.64k Views
test for definiteness of matrix. Sylvester’s criterion and schur’s complement. outline. Why we test for definiteness of matrix? detiniteness . Sylvester’s criterion Schur’s complement conclusion. Why we test for definiteness of matrix?. Many application Correlation matrix
E N D
test for definiteness of matrix Sylvester’s criterion and schur’s complement
outline • Whywe test for definiteness of matrix? • detiniteness. • Sylvester’s criterion • Schur’s complement • conclusion
Whywe test for definiteness of matrix? • Many application • Correlation matrix • Factorization • Cholesky decomposition. • classification
submatrix • k x k submatrix of an n x n matrix A deleting n − k rows and n − k columns of A • Principal submatrix of A deleted row indices and the deleted column indices are the same • leading Principal submatrix of A principal submatrix which is a north-west corner of the matrix A • Principal minor : determinant of principal submatrix • Leading principal minor : determinant of leading principal submatrix
Positive definite matrix • Definition • A nxn real matrix M is positive definite if • Equivalence at real symmetric martixM • All eigenvalues of M > 0 • All leading principal minor > 0 • All diagonal entries of LDU decomposition > 0 • There exist nonsingular matrix Rs.t
Negative definite matrix • Definition • A nxn real matrix M is negative definite if • Equivalence at real symmetric martixM • All eigenvalues of M < 0 • All leading principal minor of even size > 0 and all leading principal minor of odd size < 0 • All diagonal entries of LDU decomposition < 0
Positive semi-definite matrix • Definition • A nxn real matrix M is positive semi-definite if • Equivalence at real symmetric martixM • All eigenvalues of M ≥ 0 • All principal minor ≥ 0 • All diagonal entries of LDU decomposition ≥ 0 • There exist possibly singular matrix Rs.t
Negative semi-definite matrix • Definition • A nxn real matrix M is negative semi-definite if • Equivalence at real symmetric martixM • All eigenvalues of M ≤ 0 • All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0 • All diagonal entries of LDU decomposition ≤ 0
Indefinite matrix • Definition • A nxn real matrix Mindetinite if and
Positive definite matrix • Definition • A nxn real matrix M is positive definite if • Equivalence at real symmetric martixM • All eigenvalues of M > 0 • All leading principal minor > 0 • All diagonal entries of LDU decomposition > 0 • There exist nonsingular matrix Rs.t
Negative definite matrix • Definition • A nxn real matrix M is negative definite if • Equivalence at real symmetric martixM • All eigenvalues of M < 0 • All leading principal minor of even size > 0 and all leading principal minor of odd size < 0 • All diagonal entries of LDU decomposition < 0
Positive semi-definite matrix • Definition • A nxn real matrix M is positive semi-definite if • Equivalence at real symmetric martixM • All eigenvalues of M ≥ 0 • All principal minor ≥ 0 • All diagonal entries of LDU decomposition ≥ 0 • There exist possibly singular matrix Rs.t
Negative semi-definite matrix • Definition • A nxn real matrix M is negative semi-definite if • Equivalence at real symmetric martixM • All eigenvalues of M ≤ 0 • All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0 • All diagonal entries of LDU decomposition ≤ 0
Sylvester’s criterion • A nxn real symmetric matrix M is positive definite iff All leading principal minor > 0 • A nxn real symmetric matrix M is negative definiteiff All leading principal minor of even size > 0 and all leading principal minor of odd size < 0 • A nxn real symmetric matrix M is positive semi- definite iff All principal minor ≥ 0 • A nxn real symmetric matrix M is positive definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0
Sylvester’s criterion • A nxn real symmetric matrix M is positive semi- definite iff all leading principal minor ≥ 0 : False! • /ex/ all leading principal minor ≥ 0 Exist 1 negative eigenvalue. It is not positive definite
positive definite • A nxn real symmetric matrix M is positive definite iff All leading principal minor > 0 • sufficient condition real symmetric matrix M is positive definite ⇒let ⇒ ⇒kxk size leading principal minor
positive definite • A nxn real symmetric matrix M is positive definite iff All leading principal minor > 0 • necessary condition kxk size leading principal minor ⇒kth diagonal entry of LDU decomposition ⇒ ⇒ real symmetric matrix M is positive definite
negative definite • A nxn real symmetric matrix M is negative definite iff All leading principal minor of even size > 0 and all leading principal minor of odd size < 0 • sufficient condition real symmetric matrix M is negative definite ⇒let ⇒ ⇒kxk size leading principal minor if k is even if k is odd
negative definite • A nxn real symmetric matrix M is negative definite iff All leading principal minor of even size > 0 and all leading principal minor of odd size < 0 • necessary condition ⇒i-th diagonal entry of LDU decomposition ⇒ ⇒ real symmetric matrix M is negative definite
positive semi-definite • A nxn real symmetric matrix M is positive semi-definite iff All principal minor ≥ 0 • sufficient condition real symmetric matrix M is positive semi-definite ⇒le ⇒ is positive semi-definite ⇒ principal minor
positive semi-definite • A nxn real symmetric matrix M is positive semi-definite iff All principal minor ≥ 0 • necessary condition principal minor ⇒let ⇒
positive semi-definite • A nxn real symmetric matrix M is positive semi-definite iff All principal minor ≥ 0 • necessary condition
positive semi-definite • A nxn real symmetric matrix M is positive semi-definite iff All principal minor ≥ 0 • necessary condition ⇒ ⇒ real symmetric matrix M is positive semi-definite
negative semi-definite • A nxn real symmetric matrix M is negative semi-definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0 • sufficient condition real symmetric matrix M is negative semi-definite ⇒let ⇒ is negative semi-definite ⇒ principal minor
negative semi-definite • A nxn real symmetric matrix M is negative semi-definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0 • necessary condition principal minor ⇒let ⇒
negative semi-definite • A nxn real symmetric matrix M is negative semi-definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0 • necessary condition
negative semi-definite • A nxn real symmetric matrix M is negative semi-definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0 • necessary condition ⇒ ⇒ ⇒ real symmetric matrix M is negative semi-definite
Schur’s complement • is positive definite iff and are both positive definite. • is positive definite iff and are both positive definite. • If is positive definite, is positive semi-definite iff is positive semi-definite • If is positive definite, is positive semi-definite iff is positive semi-definite
Schur’s complement • is positive definite iff and are both positive definite. • sufficient condition is positive definite Let ⇒ and are both positive definite.
Schur’s complement • is positive definite iff and are both positive definite. • necessary condition and are both positive definite. ⇒
Schur’s complement • is positive definite iff and are both positive definite. • necessary condition ⇒ is positive definite ⇒ is positive definite
Schur’s complement • is positive definite iff and are both positive definite. • sufficient condition is positive definite Let ⇒ and are both positive definite.
Schur’s complement • is positive definite iff and are both positive definite. • necessary condition and are both positive definite. ⇒
Schur’s complement • is positive definite iff and are both positive definite. • necessary condition ⇒ is positive definite ⇒ is positive definite
Schur’s complement • If is positive definite, is positive semi-definite iff is positive semi-definite • sufficient condition is positive semi-definite Let ⇒ is positive semi-definite.
Schur’s complement • If is positive definite, is positive semi-definite iff is positive semi-definite • necessary condition is positive definite. Is positive semi-definite ⇒
Schur’s complement • If is positive definite, is positive semi-definite iff is positive semi-definite • necessary condition ⇒ is positive definite ⇒ is positive semi-definite
Schur’s complement • If is positive definite, is positive semi-definite iff is positive semi-definite • sufficient condition is positive semi-definite Let ⇒ is positive semi-definite.
Schur’s complement • If is positive definite, is positive semi-definite iff is positive semi-definite • necessary condition is positive definite. Is positive semi-definite ⇒
Schur’s complement • If is positive definite, is positive semi-definite iff is positive semi-definite • necessary condition ⇒ is positive definite ⇒ is positive semi-definite
Sylvester’s criterion • A nxn real symmetric matrix M is positive definite iff All leading principal minor > 0 • A nxn real symmetric matrix M is negative definiteiff All leading principal minor of even size > 0 and all leading principal minor of odd size < 0 • A nxn real symmetric matrix M is positive semi- definite iff All principal minor ≥ 0 • A nxn real symmetric matrix M is positive definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0
Schur’s complement • is positive definite iff and are both positive definite. • is positive definite iff and are both positive definite. • If is positive definite, is positive semi-definite iff is positive semi-definite • If is positive definite, is positive semi-definite iff is positive semi-definite