Correlation matrix with same pairwise correlation coefficientQuestionCorrelation matrix. Consider 𝑛 random variables with the same pairwise correlation coefficient ρ n . Find the highest possible value of ρ n fora) n=3b) n=4c) general, n ≥2HINT: Correlation matrix must be positive semi-definite.My WorkingsThis is what I infer from "same pairwise coefficients": ( 1 ρ n ρ n ρ n 1 ρ n ρ n ρ n 1 ) Because a correlation matrix is positive semi-definite, all principal minors have to be positiveFor n=3, the principal minors calculations yield ∣ H 1 ∣=1 ∣ H 2 ∣=1- ρ n 2 ≥ 0 ⇒ ρ n ≤ 1 ∣ H 3 ∣= ρ n 2 - ρ n ≥ 0 ⇒ ρ n ≥ 1 ∣ H 4 ∣= ( 1 3 +2 ρ n 3 )-(3 ρ n 2 ) ≥ 0 . I solved for the roots and found 1Conclusion: For n=3, max ρ n =1I did the same method for n=4 and found max ρ n =1 againMy ProblemResult looks too simple and false. Method is tediousI have no idea how to do the general case. (by induction ?)Thank you for your helpINDUCTION ATTEMPT H 0 ( 1 ρ 2 ρ 2 1 ) ⇒ − 1 2 − 1 ≤ ρ 2 ≤ 1 H n : Pn: Suppose that for a nxn correlation matrix An with same pairwise coefficients ρ n , − 1 n − 1 ≤ ρ n ≤ 1 holds H n + 1 − 1 n − 1 ≤ ρ n ≤ 1 ⇐⇒ − 1 ( n + 1 ) − 1 ≤ ρ n + 1 ≤ 1 ⇐⇒ − 1 n ≤ ρ n + 1 ≤ 1And because for all − 1 n ≥ − 1 n − 1 − 1 n − 1 ≤ ρ n + 1 ≤ 1

Question

Correlation matrix with same pairwise correlation coefficientQuestionCorrelation matrix. Consider 𝑛 random variables with the same pairwise correlation coefficient       ρ    n  . Find the highest possible value of       ρ    n  fora) n=3b) n=4c) general, n   ≥2HINT: Correlation matrix must be positive semi-definite.My WorkingsThis is what I infer from &quot;same pairwise coefficients&quot;:      (                            1                                      ρ            n                                                ρ            n                                                            ρ            n                                    1                                      ρ            n                                                            ρ            n                                                ρ            n                                    1                      )  Because a correlation matrix is positive semi-definite, all principal minors have to be positiveFor n=3, the principal minors calculations yield  ∣      H    1    ∣=1  ∣      H    2    ∣=1-      ρ    n    2     ≥  0   ⇒      ρ    n     ≤  1  ∣      H    3    ∣=      ρ    n    2   -       ρ    n    ≥  0   ⇒       ρ    n     ≥  1  ∣      H    4    ∣=  (      1    3  +2      ρ    n    3  )-(3      ρ    n    2  )  ≥  0 . I solved for the roots and found 1Conclusion: For n=3, max       ρ    n  =1I did the same method for n=4 and found max       ρ    n  =1 againMy ProblemResult looks too simple and false. Method is tediousI have no idea how to do the general case. (by induction ?)Thank you for your helpINDUCTION ATTEMPT      H    0        (                            1                                      ρ            2                                                            ρ            2                                    1                      )    ⇒  −      1          2      −      1        ≤      ρ    2    ≤  1      H    n  : Pn: Suppose that for a nxn correlation matrix An with same pairwise coefficients       ρ    n  ,   −      1          n      −      1        ≤      ρ    n    ≤  1 holds      H          n      +      1        −      1          n      −      1        ≤      ρ    n    ≤  1  ⇐⇒  −      1          (      n      +      1      )      −      1        ≤      ρ          n      +      1        ≤  1  ⇐⇒  −      1    n    ≤      ρ          n      +      1        ≤  1And because for all   −      1    n    ≥  −      1          n      −      1        −      1          n      −      1        ≤      ρ          n      +      1        ≤  1

Tasinazzokbc · Accepted Answer

A symmetric matrix is positive semidefinite if and only if all eigenvalues are nonnegative.This type of correlation matrix has eigenvalues       λ    1    =  1  +  (  n  −  1  )      ρ    n   of multiplicity 1 and       λ    2    =  1  −      ρ    n   of multiplicity n−1. By inspection it is easy to see that the vector       e    1    +      e    2    +  …  +      e    n    =  (  1  ,  1  ,  …  ,  1      )    T   is an eigenvector corresponding to       λ    1  . Since the matrix is real symmetric the remaining eigenvectors are orthogonal. Again by inspection, we see that       e    1    −      e    2    ,      e    1    −      e    3    ,  …      e    1    −      e    n   are the remaining eigenvectors all corresponding to       λ    2  The conditions for the matrix to be positive semidefinite are  1  −      ρ    n    ⩾  0  ,      1  +  (  n  −  1  )      ρ    n    ⩾  0  ,which implies for all   n  ⩾  2  −      1          n      −      1        ⩽      ρ    n    ⩽  1Using Principal MinorsPrincipal minors are determinants of submatrices obtained by deleteing rows and columns with the same indexes.For n=3:The three first-order principal minors are obtained by deleting (1) the first and second rows and columns, (2) the first and third rows and columns, and (3) the second and third rows and columns. All have value 1.The three second-order principal minors are obtained by deleting (1) the first row and column, (2) the second row and column, and (3) the third row and column. All have value      |                            1                                      ρ            3                                                            ρ            3                                    1                      |    =  1  −      ρ    3    2  The third-order principal minor is the full determinant      D    3    =      |                            1                                      ρ            3                                                ρ            3                                                            ρ            3                                    1                                      ρ            3                                                            ρ            3                                                ρ            3                                    1                      |    =  1  −  3      ρ    3    2    +  3      ρ    3    3    =  (  1  +  2      ρ    3    )  (  1  −      ρ    3        )    2  To ensure that all principal minors are nonnegative we must have  1  −      ρ    3    2    ⩾  0    ⟹        ρ    3    ⩽  1  ,    (  1  +  2      ρ    3    )  (  1  −      ρ    3        )    2      ⟹        ρ    3    ⩾  −  1      /    2  ,and the largest possible value is       ρ    3    =  1 if the matrix is positive semi-definite.For n = 4:Because all off-diagonal entries are identical the principal minors of first-, second- and third-order are identical (replacing       ρ    3  with       ρ    4  ) to those obtained for n=3, imposing the requirement    −  1      /    2  ⩽      ρ    4    ⩽  1The fourth-order principal minor is the determinant      D    4    =      |                            1                                      ρ            4                                                ρ            4                                                ρ            4                                                            ρ            4                                    1                                      ρ            4                                                ρ            4                                                            ρ            4                                                ρ            4                                    1                                      ρ            4                                                            ρ            4                                                ρ            4                                                ρ            4                                    1                      |    =      |                            1          −                      ρ            4                                                ρ            4                    −          1                          0                          0                                                  ρ            4                                    1                                      ρ            4                                                ρ            4                                                            ρ            4                                                ρ            4                                    1                                      ρ            4                                                            ρ            4                                                ρ            4                                                ρ            4                                    1                      |  where the RHS is obtained by subtracting the second row from the first row in the LHS.Expanding we get      D    4    =  (  1  −      ρ    4    )      |                            1                                      ρ            4                                                ρ            4                                                            ρ            4                                    1                                      ρ            4                                                            ρ            4                                                ρ            4                                    1                      |    −  (      ρ    4    −  1  )      |                                        ρ            4                                                ρ            4                                                ρ            4                                                            ρ            4                                    1                                      ρ            4                                                            ρ            4                                                ρ            4                                    1                      |  Using the result for       D    3   for the first determinant on the RHS and subtracting the third column from the first column in the second determinant we get      D    4    =  (  1  −      ρ    4    )  (  1  +  2      ρ    4    )  (  1  −      ρ    4        )    2    −  (      ρ    4    −  1  )  (      ρ    4    −  1  )      ρ    4    (      ρ    4    −  1  )    =  (  1  +  3      ρ    4    )  (  1  −      ρ    4        )    3  Given that we must have       ρ    4    ⩽  1, the only new constraint obtained by imposing       D    4    ⩾  0 is       ρ    4    ⩾  −  1      /    3For n&amp;gt;4:Proceeding inductively we find the same conditions obtained for n−1 and the additional condition obtained by examining the nth-order principal minor. Using the same manipulations as above this can be expanded in two terms involving lower-order determinants leading to      D    n    =  (  1  +  (  n  −  1  )      ρ    n    )  (  1  −      ρ    n        )          n      −      1      For all n the largest possible value ensuring that the matrix is positive semi-definite is       ρ    n    =  1

Answered question

Answer & Explanation

New Questions in Inferential Statistics