 Blericker74

2022-07-05

If I have $m$ measurements to estimate an $n$ dimensional state vector, and I am using Kalman filter to do the filtering, then: Should I put all the $m$ measurements together in the measurement matrix (measurement transformation matrix ) and perform the filtering or, should I filter each measurement sequentially? Please provide some supporting explanation for your choice.
For e.g: Let $m=2$ and $n=3$. The state vector is 3 dimensional and we need to use the two measurements to get the posterior estimate the state vector. Now I can use one of these two methods:

1. Use all these measurements together to form a gain matrix of size $3×2$.
2. Use one measurement at one time and perform the filtering two times. The gain matrix will be $3×1$ in this case.

Which of the two methods is a better choice? Karla Hull

This is an interesting question that I have wondered myself, but I have not worked out this problem. My intuition says that both approaches are equivalent as long as the measurements are uncorrelated. The reason is that if the measurements are correlated, then you must include the off diagonal terms of the covariance matrix. This wouldn't be possible if the updates are performed one after another.
However, we can know once and for all if we work out the equations, which shouldn't be too difficult. Here, we will consider scalar measurements for simplicity, but the concept applied for vector measurements as well.

I suggest looking at the information form of the Kalman filter (KF) and extended Kalman filter (EKF) for more insight in this respect. The information matrix (i.e., inverse of covariance matrix) of the information form can be written in a single equation as follows where the time indices are omitted for clarity:
$\begin{array}{r}{P}^{-1}=\left(F{P}^{-1}{F}^{T}+Q{\right)}^{-1}+{H}^{T}{R}^{-1}H\end{array}$
where $P$ is the covariance matrix, $F$ and $H$ are the Jacobians for the process and observation models, and $Q$ and $R$ are the covariance matrices for the process and observation noises.

Let $A=\frac{\mathrm{\partial }{h}_{A}}{\mathrm{\partial }{x}_{i}}$ represent the Jacobian for the first measurement with measurement function ${h}_{A}$, and let $B=\frac{\mathrm{\partial }{h}_{B}}{\mathrm{\partial }{x}_{i}}$ represent the Jacobian for the second measurement with measurement function ${h}_{B}$. If we perform sequential updates, then we have the following:
$\begin{array}{r}{P}^{-1}=\left(F{P}^{-1}{F}^{T}+Q{\right)}^{-1}+{A}^{T}{R}_{A}^{-1}A+{B}^{T}{R}_{B}^{-1}B\end{array}$
Now, assume the measurement is a scalar, then
${A}^{T}{R}_{A}^{-1}A=\left[\begin{array}{ccc}{a}_{00}& \cdots & {a}_{0n}\\ ⋮& \ddots & ⋮\\ {a}_{n0}& \cdots & {a}_{nn}\end{array}\right],\phantom{\rule{thickmathspace}{0ex}}\phantom{\rule{thickmathspace}{0ex}}\phantom{\rule{thickmathspace}{0ex}}\phantom{\rule{thickmathspace}{0ex}}{B}^{T}{R}_{B}^{-1}B=\left[\begin{array}{ccc}{b}_{00}& \cdots & {b}_{0n}\\ ⋮& \ddots & ⋮\\ {b}_{n0}& \cdots & {b}_{nn}\end{array}\right]$
where
${a}_{ij}={R}_{A}^{-1}\frac{\mathrm{\partial }{h}_{A}}{\mathrm{\partial }{x}_{i}}\frac{\mathrm{\partial }{h}_{A}}{\mathrm{\partial }{x}_{j}},\phantom{\rule{thickmathspace}{0ex}}\phantom{\rule{thickmathspace}{0ex}}\phantom{\rule{thickmathspace}{0ex}}{b}_{ij}={R}_{A}^{-1}\frac{\mathrm{\partial }{h}_{B}}{\mathrm{\partial }{x}_{i}}\frac{\mathrm{\partial }{h}_{B}}{\mathrm{\partial }{x}_{j}}$
Therefore,
$\begin{array}{r}{A}^{T}{R}^{-1}A+{B}^{T}{R}^{-1}B=\left[\begin{array}{ccc}{a}_{00}+{b}_{00}& \cdots & {a}_{0n}+{b}_{0n}\\ ⋮& \ddots & ⋮\\ {a}_{n0}+{b}_{n0}& \cdots & {a}_{nn}+{b}_{nn}\end{array}\right]\end{array}$

Case 2 (Simultaneous Updates) Let h=[hA,hB]T represent the measurement function, but in this case, the measurement function is a vector-valued function; therefore, the Jacobian and is given as follows:
$H=\left[\begin{array}{ccc}\frac{\mathrm{\partial }{h}_{A}}{\mathrm{\partial }{x}_{0}}& \frac{\mathrm{\partial }{h}_{A}}{\mathrm{\partial }{x}_{1}}& \cdots \\ \frac{\mathrm{\partial }{h}_{B}}{\mathrm{\partial }{x}_{0}}& \frac{\mathrm{\partial }{h}_{B}}{\mathrm{\partial }{x}_{1}}& \cdots \end{array}\right]$
Now,
${H}^{T}{R}^{-1}H=\left[\begin{array}{ccc}{H}_{00}& \cdots & {H}_{0n}\\ ⋮& \ddots & ⋮\\ {H}_{n0}& \cdots & {H}_{nn}\end{array}\right]$
where
${H}_{ij}=\frac{\mathrm{\partial }{h}_{A}}{\mathrm{\partial }{x}_{j}}\left({R}_{A}^{-1}\frac{\mathrm{\partial }{h}_{A}}{\mathrm{\partial }{x}_{i}}+{R}_{BA}^{-1}\frac{\mathrm{\partial }{h}_{B}}{\mathrm{\partial }{x}_{i}}\right)+\frac{\mathrm{\partial }{h}_{B}}{\mathrm{\partial }{x}_{j}}\left({R}_{AB}^{-1}\frac{\mathrm{\partial }{h}_{A}}{\mathrm{\partial }{x}_{i}}+{R}_{B}^{-1}\frac{\mathrm{\partial }{h}_{B}}{\mathrm{\partial }{x}_{i}}\right)$
where (with slight abuse of notation)
${R}^{-1}=\left[\begin{array}{cc}{R}_{A}^{-1}& {R}_{AB}^{-1}\\ {R}_{BA}^{-1}& {R}_{B}^{-1}\end{array}\right]$
So, if the measurements are uncorrelated (i.e., ${R}_{AB}^{-1}={R}_{BA}^{-1}=0$), then ${H}^{T}{R}^{-1}H={A}^{T}{R}^{-1}A+{B}^{T}{R}^{-1}B$, which means that applying the updates sequentially or simultaneously givens the same results. However, in general, you cannot apply the updates sequentially for correlated measurements.

Do you have a similar question?