Question

In: Electrical Engineering

Consider the following discrete memoryless channel: Y = X + Z, where Pr{Z = 0} =...

Consider the following discrete memoryless channel: Y = X + Z, where Pr{Z = 0} = Pr{Z = a} = 1/2 and the alphabet for x is {0, 1}. Assume that Z is independent of X.

a) Find the capacity of the channel in terms of a.

b) Explain how capacity is affected by a in terms of signal-to-noise ratio (SNR).

Solutions

Expert Solution

a) Here depending on the value of (a) various case can be made

Case 1 ---> a =0

For this case Y = X and max I(X:Y) = max I(X)=1. So the capacity here is 1

Case 2 ---> a 0

For this case Y has four possible value 0,1,a,1+a. Knowing Y, we know the X which was sent, and hence H(X Y) = 0 . Hence max I(X; Y ) = max H(X) = 1, achieved for an uniform distribution on the input X

Case 3 ---> a =1

In this case, Y has three possible output values, 0, 1, and 2. The channel is identical to the binary erasure channel with a = 1/2. The capacity of this channel is 1/2 bit per transmission.

Case 4 ---> a =1

In this case, Y has three possible output values, 0, 1, and 2. The channel is identical to the binary erasure channel with a = 1/2. The capacity of this channel is 1/2 bit per transmission.

Case 4 ---> a = -1

This is similar to the case when a = 1 and the capacity here is also 1/2 bit per transmission.

b) Capacity and SNR relation is given by

So when the SNR iincrease by then capacity is increse by 1  


Related Solutions

1. (Memoryless property) [10] Consider a discrete random variable X ∈ N (X ∈ N is...
1. (Memoryless property) [10] Consider a discrete random variable X ∈ N (X ∈ N is a convention to represent that the range of X is N). It is memoryless if Pr{X > n + m|X > m} = Pr{X > n}, ∀m,n ∈{0,1,...}. a) Let X ∼ G(p), 0 < p ≤ 1. Show that X is memoryless. [2] b) Show that if a discrete positive integer-valued random variable X is memoryless, it must be a geometric random variable,...
For a discrete random variable X, it is known that Pr[X = 1] = 0.15, Pr[X...
For a discrete random variable X, it is known that Pr[X = 1] = 0.15, Pr[X = 3] = 0.3, Pr [X = 5] = 0.35, and Pr[X = 7] = 0.2. Find Pr[X < 5].
Q1, what is negations of(∃x ∈ Z)x ≤ 0 ⇒ (∀y ∈ Z). xy > 0...
Q1, what is negations of(∃x ∈ Z)x ≤ 0 ⇒ (∀y ∈ Z). xy > 0 Q2, Prove by induction that 14n + 12n − 5 n is divisible by 7 for all n > 0
Consider the following function: f (x , y , z ) = x 2 + y...
Consider the following function: f (x , y , z ) = x 2 + y 2 + z 2 − x y − y z + x + z (a) This function has one critical point. Find it. (b) Compute the Hessian of f , and use it to determine whether the critical point is a local man, local min, or neither? (c) Is the critical point a global max, global min, or neither? Justify your answer.
Let X and Y be independent discrete random variables with the following PDFs: x 0 1...
Let X and Y be independent discrete random variables with the following PDFs: x 0 1 2 f(x)=P[X=x] 0.5 0.3 0.2 y 0 1 2 g(y)= P[Y=y] 0.65 0.25 0.1 (a) Show work to find the PDF h(w) = P[W=w] = (f*g)(w) (the convolution) of W = X + Y (b) Show work to find E[X], E[Y] and E[W] (note that E[W] = E[X]+E[Y])
Find the volume of D= {(x,y,z): x^2+y^2+z^2<_ 4, x _>0, y_>0
Find the volume of D= {(x,y,z): x^2+y^2+z^2<_ 4, x _>0, y_>0
Find the center mass of the solid bounded by planes x+y+z=1x+y+z=1, x=0x=0, y=0y=0, and z=0z=0, assuming...
Find the center mass of the solid bounded by planes x+y+z=1x+y+z=1, x=0x=0, y=0y=0, and z=0z=0, assuming a mass density of ρ(x,y,z)=5√z.
Given function f(x,y,z)=x^(2)+2*y^(2)+z^(2), subject to two constraints x+y+z=6 and x-2*y+z=0. find the extreme value of f(x,y,z)...
Given function f(x,y,z)=x^(2)+2*y^(2)+z^(2), subject to two constraints x+y+z=6 and x-2*y+z=0. find the extreme value of f(x,y,z) and determine whether it is maximum of minimum.
Consider the following planes. x + y + z = 7,     x + 3y + 3z =...
Consider the following planes. x + y + z = 7,     x + 3y + 3z = 7 (a) Find parametric equations for the line of intersection of the planes. (Use the parameter t.) (x(t), y(t), z(t)) =     (b) Find the angle between the planes. (Round your answer to one decimal place.) °
The center of buoyancy of a floating body is at x = 0, z = 0 and its center of gravity is at x = 0, z = 0.9 where (x, z) are the horizontal and vertical coordinates.
The center of buoyancy of a floating body is at x = 0, z = 0 and its center of gravity is at x = 0, z = 0.9 where (x, z) are the horizontal and vertical coordinates. The body is tilted through an angle θ = 5◦ so that the center of buoyancy shifts to x = 0.1, z = 0. Will the floating body (a) Return to its undisturbed configuration (b) Move further away from its undisturbed configuration...
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT