Markov Chains and Conditional Probability: Easy rat in the maze problem Why is the following soluti

Brock Byrd

Brock Byrd

Answered question

2022-07-03

Markov Chains and Conditional Probability: Easy rat in the maze problem
Why is the following solution to this problem incorrect,
A rat is trapped in a maze with three doors and some hidden cheese. If the rat takes door one, he will wander around the maze for 2 minutes and return to where he started. If he takes door two, he will wander around the maze for 3 minutes and return to where he started. If he takes door three, he will ind the cheese after 1 minute. If the rat returns to where he started he immediately picks a door to pass through. The rat picks each door uniformly at random. How long, on average, will the rat wander before finding the cheese?
1. Construct a graph with three vertices: X, Y, Z, each of which represents a door in the original problem.
2. Add edges between every vertex, including self-loops, each of which has a weight of 1/3.
3. Take the stationary distribution to be (1/3, 1/3, 1/3). It is unique because the probability transition question for the graph in (1) is regular (i.e., its limit is just the same matrix with all entries equal to 1/3)
4. Compute the expected time as 21 / 3 + 31 / 3 + 1 1 / 3 = 2
The correct answer is 6. I know that the set-up is completely wrong and that I should use conditional probability, but is there a way to do it like this? The main issue is that we don't know the total time spent in the maze (this is kind of what we need to find) so I can see that it doesn't really make sense to take this approach.

Answer & Explanation

Perman7z

Perman7z

Beginner2022-07-04Added 13 answers

Step 1
The rat's sojourn time may be modeled by a Markov chain with transition matrix
P = ( 0 1 3 1 3 0 1 3 0 0 0 1 0 0 1 0 0 0 1 0 0 0 0 0 0 0 0 1 ) .
Let Q be the matrix whose entries are the expected number of visits to a transient state starting from another transient state, then since Q 1 = sup 1 i t j = 1 t Q i j = 2 3 < 1, the series
N = k = 0 Q k
converges to
( 3 2 1 2 3 3 1 3 3 3 2 3 3 2 1 3 ) .
Step 2
The expected number of steps before being absorbed when starting in a transient state are given by the entries of the vector
t = N 1 = ( 8 10 11 9 ) .
It follows that the expected soujourn time is 8.

Do you have a similar question?

Recalculate according to your conditions!

New Questions in Discrete math

Ask your question.
Get an expert answer.

Let our experts help you. Answer in as fast as 15 minutes.

Didn't find what you were looking for?