Question

In: Statistics and Probability

A gambler tosses a coin and a tetrahedron at each stage. If "H", he receives the...

A gambler tosses a coin and a tetrahedron at each stage. If "H", he receives the amount appearing at the face of the tetrahedron. If "T", he pays the amount. The tetrahedron is fair, but the probability of H is ⅔. The game ends if the gambler reaches 0 or less wealth, or accumulates 6 or more wealth.

Define X_n = 0 if wealth is less than or equal to zero.
Define X_n = i if wealth is i = 1,2,3,4,5.
Define X_n = 6 if wealth is greater than or equal to 6.

Determine the transition probability matrix.

Solutions

Expert Solution

Tetrahedron has four faces, so the probability of getting 1, 2, 3, or 4 is 1/4

Let X be the amount of gain/loss at each stage.

P(X = 1) = P(X = 2) = P(X = 3) = P(X = 4) = (1/4) * (2/3) = 1/6

P(X = -1) = P(X = -2) = P(X = -3) = P(X = -4) = (1/4) * (1/3) = 1/12

Thus, the transition probabilities from state 0 are,

P(X_n+1 = 0 | X_n = 0) = 1 (State 0 is an absorbing state as the game ends here)

The transition probabilities from state 1 are,

P(X_n+1 = 2 | X_n = 1) = P(X_n+1 = 3 | X_n = 1) = P(X_n+1 = 4 | X_n = 1) = P(X_n+1 = 5 | X_n = 1) = 1/6

P(X_n+1 = 0 | X_n = 1) = P(X = -1) + P(X = -2) + P(X = -3) + P(X = -4) = 4 * 1/12 = 1/3

The transition probabilities from state 2 are,

P(X_n+1 = 3 | X_n = 2) = P(X_n+1 = 4 | X_n = 2) = P(X_n+1 = 5 | X_n = 0) = P(X_n+1 = 6 | X_n = 2) = 1/6

P(X_n+1 = 1 | X_n = 2) = P(X = -1) = 1/12

P(X_n+1 = 0 | X_n = 2) = P(X = -2) + P(X = -3) + P(X = -4) = 3 * 1/12 = 1/4

The transition probabilities from state 3 are,

P(X_n+1 = 4 | X_n = 3) = P(X_n+1 = 5 | X_n = 3) = 1/6

P(X_n+1 = 6 | X_n = 3) = P(X = 3) + P(X = 4) = 2 * 1/6 = 1/3

P(X_n+1 = 2 | X_n = 3) = P(X_n+1 = 1 | X_n = 3) = P(X = -1) = P(X = -2) = 1/12

P(X_n+1 = 0 | X_n = 2) = P(X = -3) + P(X = -4) = 2 * 1/12 = 1/6

The transition probabilities from state 4 are,

P(X_n+1 = 5 | X_n = 4) = 1/6

P(X_n+1 = 6 | X_n = 4) = P(X = 2) + P(X = 3) + P(X = 4) = 3 * 1/6 = 1/2

P(X_n+1 = 3 | X_n = 4) = P(X_n+1 = 2 | X_n = 4) = P(X_n+1 = 1 | X_n = 4) = P(X = -1) = P(X = -2) = P(X = -3) = 1/12

P(X_n+1 = 0 | X_n = 4) = P(X = -4) = 1/12

The transition probabilities from state 5 are,

P(X_n+1 = 6 | X_n = 5) = P(X = 1) + P(X = 2) + P(X = 3) + P(X = 4) = 4 * 1/6 = 2/3

P(X_n+1 = 4 | X_n = 5) = P(X_n+1 = 3 | X_n = 5) = P(X_n+1 = 2 | X_n = 5) = P(X_n+1 = 1 | X_n = 5) = P(X = -1) = P(X = -2) = P(X = -3) = P(X = -4) = 1/12

The transition probabilities from state 6 are,

P(X_n+1 = 6 | X_n = 6) = 1 (State 6 is an absorbing state as the game ends here)

The transition probability matrix with states 0, 1, 2, 3, 4, 5, 6 are


Related Solutions

A gambler tosses a coin and a tetrahedron at each stage. If "H", he receives the...
A gambler tosses a coin and a tetrahedron at each stage. If "H", he receives the amount appearing at the face of the tetrahedron. If "T", he pays the amount. The tetrahedron is fair, but the probability of H is ⅔. The game ends if the gambler reaches 0 or less wealth, or accumulates 6 or more wealth. Define X_n = 0 if wealth is less than or equal to zero. Define X_n = i if wealth is i =...
A player tosses a fair coin n times. Each time, if the coin lands on Head,...
A player tosses a fair coin n times. Each time, if the coin lands on Head, the player win a dollar, otherwise, the player loses a dollar. What is the expected earning of the player? What is the variance of the earning of the player? Now the player apply a new strategy: the player will play the game until he gets a head. What is the expected earning of the new strategy? Does the result depend on n?
sean tosses a coin 40 times and gets 15 heads while Micah tosses a coin 30...
sean tosses a coin 40 times and gets 15 heads while Micah tosses a coin 30 times and gets 16 heads. Suppose that the outcomes of sean's coin tosses are iid random variable with probability p1 of getting heads on each toss while Micah’s outcomes are also iid with a potentially different probability p2 of getting heads. (1) Calculate the maximum likelihood and method of moments estimators of p1. (2) Show that the MLE of p1 is an MVUE for...
COIN TOSSES In a large class of introductory Statistics students, the professor has each student toss...
COIN TOSSES In a large class of introductory Statistics students, the professor has each student toss a coin 16 times and calculate the proportion of his or her tosses that were heads. The students then report their results, and the professor plots a histogram of these several proportions. What shape would you expect this histogram to be? Why? Where do you expect the histogram to be centred? How much variability would you expect among these proportions? Explain why a Normal...
A class has 8 GSIs. Each GSI tosses a coin 20 times and notes the number...
A class has 8 GSIs. Each GSI tosses a coin 20 times and notes the number of heads. What is the probability that none of the GSIs gets exactly 10 heads?
Fair Coin? In a series of 100 tosses of a token, the proportion of heads was...
Fair Coin? In a series of 100 tosses of a token, the proportion of heads was found to be 0.43. However, the margin of error for the estimate on the proportion of heads in all tosses was too big. Suppose you want an estimate that is in error by no more than 0.05 at the 90% confidence level. (a) What is the minimum number of tosses required to obtain this type of accuracy? Use the prior sample proportion in your...
Find the probability of getting 8 heads in 12 tosses of a coin.
Find the probability of getting 8 heads in 12 tosses of a coin.
Fair Coin? In a series of 100 tosses of a token, the proportion of heads was...
Fair Coin? In a series of 100 tosses of a token, the proportion of heads was found to be 0.43. However, the margin of error for the estimate on the proportion of heads in all tosses was too big. Suppose you want an estimate that is in error by no more than 0.03 at the 95% confidence level. (a) What is the minimum number of tosses required to obtain this type of accuracy? Use the prior sample proportion in your...
Fair Coin? In a series of 100 tosses of a token, the proportion of heads was...
Fair Coin? In a series of 100 tosses of a token, the proportion of heads was found to be 0.58. However, the margin of error for the estimate on the proportion of heads in all tosses was too big. Suppose you want an estimate that is in error by no more than 0.05 at the 90% confidence level. (a) What is the minimum number of tosses required to obtain this type of accuracy? Use the prior sample proportion in your...
Fair Coin? In a series of 100 tosses of a token, the proportion of heads was...
Fair Coin? In a series of 100 tosses of a token, the proportion of heads was found to be 0.58. However, the margin of error for the estimate on the proportion of heads in all tosses was too big. Suppose you want an estimate that is in error by no more than 0.05 at the 90% confidence level. (a) What is the minimum number of tosses required to obtain this type of accuracy? Use the prior sample proportion in your...
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT