Problem(3) Consider a r.v. representing coin throws (Bernoulli Variable with Σ = {0,1} ). Let the...

Problem(3)
Consider a r.v. representing coin throws (Bernoulli Variable with Σ = {0,1} ). Let the true
probability distribution be p(0) = r, p(1) = 1-r.
Someone guesses a different distribution q(0) = s, q(1) = 1-s.
(a) Find expressions for the Kullback–Leibler distances D(p||q) and D(q||p) between the
two distributions in terms of r and s.
(b) Show that in general, D(p||q) ≠ D(q||p) and that equality occurs iff r = s.
(c) Compute D(p||q) and D(q||p) for the case r = 1/2 and s = 1/4.

python or C++

Solutions

Expert Solution

orchestra answered 1 year ago

Next > < Previous

Related Solutions

Consider a r.v. representing coin throws (Bernoulli Variable with Σ = {0,1} ). Let the true...

Consider a r.v. representing coin throws (Bernoulli Variable with Σ = {0,1} ). Let the true probability distribution be p(0) = r, p(1) = 1-r. Someone guesses a different distribution q(0) = s, q(1) = 1-s. (a) Find expressions for the Kullback–Leibler distances D(p||q) and D(q||p) between the two distributions in terms of r and s. (b) Show that in general, D(p||q) ≠ D(q||p) and that equality occurs iff r = s. (c) Compute D(p||q) and D(q||p) for the case...

Information theory Consider a random variable representing coin throws (Bernoulli Variable with Σ = {0,1} )....

Information theory Consider a random variable representing coin throws (Bernoulli Variable with Σ = {0,1} ). Let the true probability distribution be p(0) = r, p(1) = 1-r. Someone guesses a different distribution q(0) = s, q(1) = 1-s. (a) Find expressions for the Kullback–Leibler distances D(p||q) and D(q||p) between the two distributions in terms of r and s. (b) Show that in general, D(p||q) ≠ D(q||p) and that equality occurs iff r = s. (c) Compute D(p||q) and D(q||p)...

1. A coin is tossed 3 times. Let x be the random discrete variable representing the...

1. A coin is tossed 3 times. Let x be the random discrete variable representing the number of times tails comes up. a) Create a sample space for the event; b) Create a probability distribution table for the discrete variable x; c) Calculate the expected value for x. 2. For the data below, representing a sample of times (in minutes) students spend solving a certain Statistics problem, find P35, range, Q2 and IQR. 3.0, 3.2, 4.6, 5.2 3.2, 3.5...

Consider two ips of a coin. Let X1 be the random variable which is 1 if...

Consider two ips of a coin. Let X1 be the random variable which is 1 if the rst coin is heads and 0 otherwise; let X2 be the random variable which is 1 if the second coin is heads and 0 otherwise; and let X3 be the random variable which is 1 if the two coins are the same and 0 otherwise. Show that these three variables are pairwise independent but not independent.

Let X be a random variable with mean μ and standard deviation σ. Consider a new...

Let X be a random variable with mean μ and standard deviation σ. Consider a new random variable Z, obtained by subtracting the constant μ from X and dividing the result by the constant σ: Z = (X –μ)/σ. The variable Z is called a standardised random variable. Use the laws of expected value and variance to show the following: a E(Z) = 0 b V (Z) = 1

Let X be the random variable representing the number of calls received in an hour by...

Let X be the random variable representing the number of calls received in an hour by a 911 emergency service. A probability distribution of X is given below. Value of X 0 1 2 3 4 Probability P(x) 0.32 ____ ____ 0.16 0.08 (a) Suppose the probability that X = 1 and the probability that X = 2 are the same. What are these probabilities? Incorrect: Your answer is incorrect. (b) What is the probability that at least one call...

At a used dealership, let X be an independent variable representing the age in years of...

At a used dealership, let X be an independent variable representing the age in years of a motorcycle and Y be the dependent variable representing the selling price of used motorcycle. The data is now given to you. X = {5, 10, 12, 14, 15} Y = {500, 400, 300, 200, 100} 1) What is the value for S^2? 2) What is the value for s? 3) Construct a 95% confidence interval for B1. what is the upper bound and...

Let x be a random variable that represents the percentage of successful free throws a professional...

Let x be a random variable that represents the percentage of successful free throws a professional basketball player makes in a season. Let y be a random variable that represents the percentage of successful field goals a professional basketball player makes in a season. A random sample of n = 6 professional basketball players gave the following information. x 89 64 82 82 72 64 y 61 47 56 47 53 48 Verify that Se ≈ 4.443, a ≈...

Let x be a random variable that represents the percentage of successful free throws a professional...

Let x be a random variable that represents the percentage of successful free throws a professional basketball player makes in a season. Let y be a random variable that represents the percentage of successful field goals a professional basketball player makes in a season. A random sample of n = 6 professional basketball players gave the following information. x 87 88 70 84 78 76 y 53 57 50 51 46 50 Given that Se ≈ 3.054, a ≈ 16.547,...

Let x be a random variable that represents the percentage of successful free throws a professional...

Let x be a random variable that represents the percentage of successful free throws a professional basketball player makes in a season. Let y be a random variable that represents the percentage of successful field goals a professional basketball player makes in a season. A random sample of n = 6 professional basketball players gave the following information x 67 65 75 86 73 73 y 44 42 48 51 44 51 (a) Verify that Σ x = 439, Σ...

Subjects