PCA vs Correlation What is the relationship between (first) principal component(s) and the correlation matrix or the average correlation of the data. For example, in an empirical application I observe that the average correlation is almost the same as the ratio of the variance of the first principal component (first eigenvalue) to the total variance (sum of all eigenvalues). Is there a mathematical relationship?

Shannon Andrews

Shannon Andrews

Answered question

2022-07-16

PCA vs Correlation
What is the relationship between (first) principal component(s) and the correlation matrix or the average correlation of the data. For example, in an empirical application I observe that the average correlation is almost the same as the ratio of the variance of the first principal component (first eigenvalue) to the total variance (sum of all eigenvalues).
Is there a mathematical relationship?

Answer & Explanation

minotaurafe

minotaurafe

Beginner2022-07-17Added 22 answers

Short Answer: The principal components are the eigenvectors of the correlation matrix. Therefore, each principle component (V) multiplied by the correlation matrix (C) will give us the same correlation matrix times the corresponding eigenvalue λ:
C V = λ V
Details: Given n-dimensional data x i R n , suppose we have m datapoints represented as rows in a matrix X (An m × n matrix). Given that Cor(i,j) is the correlation of 2 dimensions i and j, the correlation matrix is defined as:
C = [ C o r ( 0 , 0 ) C o r ( 0 , 1 ) C o r ( 0 , n 1 ) C o r ( 1 , 0 ) C o r ( 1 , 1 ) C o r ( 1 , n 1 ) C o r ( n 1 , n 1 ) ]
Since the correlation matrix is a square matrix of size n × n, there are n possible eigenvectors for this matrix, and these vectors are the principle components of this data. each principle component V is of size n × 1, and it's corresponding eigenvalue λ is a scalar value.

Do you have a similar question?

Recalculate according to your conditions!

New Questions in Inferential Statistics

Ask your question.
Get an expert answer.

Let our experts help you. Answer in as fast as 15 minutes.

Didn't find what you were looking for?