Q1. Let {Xn : n ≥ 0} denote the random walk on 9-cycle. Express it as...

Q1. Let {Xn : n ≥ 0} denote the random walk on 9-cycle. Express it as a random walk on a group (G, ·) with transition probabilities given by pxy = µ(y · x −1 ) for an appropriate distribution µ on G.

Q2. Consider the stochastic process {Xn|n ≥ 0}given by X0 = 1, Xn+1 = I{Xn = 1}Un+1 + I{Xn 6= 1}Vn+1, n ≥ 0, where {(Un, Vn)|n ≥ 1} is an i.i.d. sequence of random variables such that Un is independent of Vn for each n ≥ 1 and U1−1 is Bernoulli(p) and V1−1 is Bernoulli(q) random variables. Show that {Xn|n ≥ 1} is a Markov chain and find its transition matrix. Also find P{Xn = 2}

. Q3. Let {Xn|n ≥ 0} be the Markov chain given Q.2. Find a Markov chain {Yn|n ≥ 0} of the form Yn+1 = f(Yn, Zn), n ≥ 1, Y0 = 1 where {Zn|n ≥ 1} is an i.i.d. sequence of R-valued random variables such that finite dimensional distributions of {Xn|n ≥ 0} and {Yn|n ≥ 0} coincide.

Q4. (Unit demand inventory system) Consider an inventory system in discrete time with the following description. At the beginning of the period the inventory decreases by one unit if the inventory level at the beginning is positive other the level remains zero till the end of the period. At the end of the period nth period, the inventory is increased by an amount Vn, where {Vn|n ≥ 1} is i.i.d. with P{V1 = i} = pi , i ≥ 0. Let Xn denote the level of the inventory at the beginning(just before the probable inventory decrease) of the period [n, n + 1). Show that {Xn|n ≥ 0} is a Markov chain under the assumption that X0 is Z + valued random variable which is independent of {Vn|n ≥ 1}. Also find its transition matrix.

Expert Solution

orchestra answered 1 year ago

4. (Reflected random walk) Let {Xn|n ≥ 0} be as in Q6. Show that Xn+1 =...

4. (Reflected random walk) Let {Xn|n ≥ 0} be as in Q6. Show that Xn+1 = X0 + Zn+1 − Xn m=0 min{0, Xm + Vm+1 − Um+1}, where Zn = Xn m=1 (Vm − Um), n ≥ 1. Q5. (Extreme value process) Let {In|n ≥ 0} be an i.i.d. sequence of Z-valued random variables such that P{I1 = k} = pk, k ∈ Z and pk > 0 for some k > 0. Define Xn = max{I1, I2, ·...

Let Xn is a simple random walk (p = 1/2) on {0, 1, · · ·...

Let Xn is a simple random walk (p = 1/2) on {0, 1, · · · , 100} with absorbing boundaries. Suppose X0 = 50. Let T = min{j : Xj = 0 or N}. Let Fn denote the information contained in X1, · · · , Xn. (1) Verify that Xn is a martingale. (2) Find P(XT = 100). (3) Let Mn = X2 n − n. Verify that Mn is also a martingale. (4) It is known that...

Q1. Let {Xn|n ≥ 0} is a Markov chain with state space S = {0, 1,...

Q1. Let {Xn|n ≥ 0} is a Markov chain with state space S = {0, 1, 2, 3} and transition probability matrix (pij ). Let τi = min{n ≥ 1 : Xn = i}, i = 0, 1, 2, 3. Define Bij = {Xτj = i}. Is Bij ∈ σ(X0, · · · , Xτj ) ? Q2. Let {Xn|n ≥ 0} is a Markov chain with state space S = {0, 1, 2, 3}, X0 = 0, and transition...

Q1. Let {Xn|n ≥ 0} is a Markov chain with state space S. For i ∈...

Q1. Let {Xn|n ≥ 0} is a Markov chain with state space S. For i ∈ S, define τi = min{n ≥ 0|Xn = i}. Show that τi is a stopping time for each i. Q2. Let τi as in Q1. but for any discrete time stochastic process. Is τi a stopping time? Q3. Let {Xn|n ≥ 0} be a Markov chain and i is a state. Define the random time τ = min{n ≥ 0|Xn+1 = i}. If τ...

Let x = (x1,...,xn) ∼ N(0,In) be a MVN random vector in Rn. (a) Let U...

Let x = (x1,...,xn) ∼ N(0,In) be a MVN random vector in Rn. (a) Let U ∈ Rn×n be an orthogonal matrix (UTU = UUT = In) and nd the distribution of UTx. Let y = (y1,...,yn) ∼ N(0,Σ) be a MVN random vector in Rn. Let Σ = UΛUT be the spectral decomposition of Σ. (b) Someone claims that the diagonal elements of Λ are nonnegative. Is that true? (c) Let z = UTy and nd the distribution of...

Let X1,…, Xn be a sample of iid N(0, ?) random variables with Θ=(0, ∞). Determine...

Let X1,…, Xn be a sample of iid N(0, ?) random variables with Θ=(0, ∞). Determine a) the MLE ? of ?. b) E(? ̂). c) the asymptotic variance of the MLE of ?. d) the MLE of SD(Xi ) = √ ?.

Let z denote a random variable having a normal distribution with ? = 0 and ?...

Let z denote a random variable having a normal distribution with ? = 0 and ? = 1. Determine each of the probabilities below. (Round all answers to four decimal places.) (a) P(z < 0.3) = (b) P(z < -0.3) = (c) P(0.40 < z < 0.85) = (d) P(-0.85 < z < -0.40) = (e) P(-0.40 < z < 0.85) = (f) P(z > -1.26) = (g) P(z < -1.5 or z > 2.50) =

Let X1, X2, . . . , Xn be a random sample of size n from...

Let X1, X2, . . . , Xn be a random sample of size n from a Poisson distribution with unknown mean µ. It is desired to test the following hypotheses H0 : µ = µ0 versus H1 : µ not equal to µ0 where µ0 > 0 is a given constant. Derive the likelihood ratio test statistic

Q5. Let {Xn|n ≥ 0} is a Markov chain with state space S = {0, 1,...

Q5. Let {Xn|n ≥ 0} is a Markov chain with state space S = {0, 1, 2, 3}, and transition probability matrix (pij ) given by   2 3 1 3 0 0 1 3 2 3 0 0 0 1 4 1 4 1 2 0 0 1 2 1 2   Determine all recurrent states. 1 2 Q6. Let {Xn|n ≥ 0} is a Markov chain with state space S = {0, 1, 2} and transition...

Let {Xn|n ≥ 0} is a Markov chain with state space S = {0, 1, 2,...

Let {Xn|n ≥ 0} is a Markov chain with state space S = {0, 1, 2, 3}, and transition probability matrix (pij ) given by   2 3 1 3 0 0 1 3 2 3 0 0 0 1 4 1 4 1 2 0 0 1 2 1 2   Determine all recurrent states. Q3. Let {Xn|n ≥ 0} is a Markov chain with state space S = {0, 1, 2} and transition probability matrix (pij...

Question