Question

Sally and Mike are playing frisbee at the beach. When Sally throws the frisbee the probability is 0.14 that it comes back to Sally, the probability is 0.7 that it goes to Mike, and the probability is 0.16 that the dog runs away with the frisbee. When Mike throws the frisbee there is a 0.66 probability that Sally gets it, a 0.28 probability that it comes back to Mike, and a 0.06 probability that the dog runs away with the frisbee. Treat this as a 3--state Markov Chain with the dog being an absorbing state. If Mike has the frisbee, what is the expected value for the number of times Mike will throw the frisbee before the dog gets it? (Give your answer correct to 2 decimal places.)

Answer 1