I am representing my 3d data in convariance matrix. I just want to know what the determinant of Conv

Dale Tate

Dale Tate

Answered question

2022-06-13

I am representing my 3d data in convariance matrix. I just want to know what the determinant of Convariance Matrix gives. If the determinant is positive, zero, negative, high positive, high negative. What does it mean or represent?
Thanks
EDIT:
Covariance is being used to represent variance for 3d coordiantes that I have. If my covariance matrix A determinant is +100, and the other covariance matrix B determinant is +5. Which of these values show if the variance is more or not. Which value tells that datapoints are more dispersed. Which value shows that readings are further away from mean.

Answer & Explanation

mallol3i

mallol3i

Beginner2022-06-14Added 20 answers

I would like to point out that there is a connection between the determinant of the covariance matrix of (Gaussian distributed) data points and the differential entropy of the distribution.
To put it in other words: Let's say you have a (large) set of points from which you assume it is Gaussian distributed. If you compute the determinant of the sample covariance matrix then you measure (indirectly) the differential entropy of the distribution up to constant factors and a logarithm. See, e.g, Multivariate normal distribution.
The differential entropy of a Gaussian density is defined as:
H [ p ] = k 2 ( 1 + ln ( 2 π ) ) + 1 2 ln | Σ | ,,
where k is the dimensionality of your space, i.e., in your case k=3.
Σ is positive semi-definite, which means | Σ | 0.
The larger | Σ |, the more are your data points dispersed. If | Σ |=0, it means that your data ponts do not 'occupy the whole space', meaning that they lie, e.g., on a line or a plane within R 3 . Somewhere I have read, that | Σ | is also called generalized variance. Alexander Vigodner is right, it captures the volume of your data cloud.
Since a sample covariance matrix is defined somewhat like:
Σ = 1 N 1 i = 1 N ( x i μ ) ( x i μ ) T
it follows, that you do not capture any information about the mean. You can verify that easily by adding some large constant vectorial shift to your data; | Σ | should not change.
I don't want to go to much into detail, but there is also a connection to PCA. Since the eigenvalues λ 1 , λ 2 , λ 3 of Σ correspond to the variances along the principal component axis of your data points, | Σ | captures their product, because by definition the determinant of a matrix is equal to the product of its eigenvalues.
Note that the largest eigenvalue corresponds to the maximal variance w.r.t. to your data (direction given by the corresponding eigenvector, see PCA).

Do you have a similar question?

Recalculate according to your conditions!

Ask your question.
Get an expert answer.

Let our experts help you. Answer in as fast as 15 minutes.

Didn't find what you were looking for?