I have a problem with finding: <munder> <mo movablelimits="true" form="prefix">max

Bailee Short

Bailee Short

Answered question

2022-06-27

I have a problem with finding:

max a R p a C a a B a ,

where C and B are p × p symmetric matrices.

After differentiation I get the following result:

2 a C ( a B a ) 2 a B ( a C a ) ( a B a ) ( a B a ) = 0

I can’t solve the above equation for a. How to find it?

Answer & Explanation

Abigail Palmer

Abigail Palmer

Beginner2022-06-28Added 30 answers

The maximum won't generally exist. It can be guaranteed to exist, however, if B is positive definite.

In this case, suppose that B = M M for some invertible matrix M (we can compute M via a Cholesky decomposition for instance). We then have
max a a C a a B a = max a a C a a M M a = max a a C a ( M a ) ( M a ) = max b ( M 1 b ) C ( M 1 b ) b b = max b b ( [ M ] 1 C M ) b b b .
By the Rayleigh-Ritz theorem, this maximum is the largest eigenvalue of [ M ] 1 C M.
vittorecostao1

vittorecostao1

Beginner2022-06-29Added 5 answers

Denote the scalar which you wish to optimize as
λ = a T C a a T B a
Take your gradient result, transpose it, multiply it by a T B a 2 , , and write it as
C a = λ B a
This is a generalized eigenvalue problem and you want the eigenvector corresponding to the largest such eigenvalue.

If B 1 exists, then this can be reduced to an ordinary eigenvalue problem for L = B 1 C.
L a = λ a

If C 1 exists, then it becomes an eigenvalue problem for the reciprocal eigenvalues ( μ = 1 λ ) of the matrix M = C 1 B.
M a = μ a

Do you have a similar question?

Recalculate according to your conditions!

New Questions in High school geometry

Ask your question.
Get an expert answer.

Let our experts help you. Answer in as fast as 15 minutes.

Didn't find what you were looking for?