(Binary Erasure Cannel) Suppose that Γ is the binary erasure channel (BEC), the input probabilities of...

(Binary Erasure Cannel) Suppose that Γ is the binary erasure channel (BEC), the input probabilities of 0 and 1 are ? and ?̅, and the probability of sending source symbols correctly is ?. Assume ?=0.6 and ?=0.7. Please compute the system entropies H(A), H(B), H(A|B), H(B|A), and H(A,B).

Solutions

Expert Solution

We have given input probability of 0 and 1 are ? and ?̅

Where, ? = 0.6

As we know ? + ?̅ = 1, So, ?̅ = 1 – 0.6 = 0.4

?̅ = 0.4

The probability of sending source symbols correctly is P and probability of sending source symbols with error is P

Where, P = 0.7, 1 - P = 0.3

This problem is solved below:-

venereology answered 1 year ago

Next > < Previous

Related Solutions

Suppose γ is a random variable with Exp(θ) distribution. Conditioning on γ, Y ∼ Poisson(γ). Provide...

Suppose γ is a random variable with Exp(θ) distribution. Conditioning on γ, Y ∼ Poisson(γ). Provide the marginal mean and variance of Y

Suppose a binary message is transmitted through a noisy channel. The transmitted signal S has uniform...

Suppose a binary message is transmitted through a noisy channel. The transmitted signal S has uniform probability to be either 1 or −1, the noise N follows normal distribution N(0,4) and the received signal is R=S+N . Assume the receiver conclude the signal to be 1 when R>=0 and -1 when R<0 . 1. What is error probability when one signal is transmitted? 2. What is error probability when one signal is transmitted if we triple the amplitude of the...

Design a combinational circuit with four inputs (A, B, C and D) and four outputs (W, X, Y and Z). When the binary input is less than 10 the binary output is two greater than the input. When the binary input is equal or greater than 10 the binary output

Design a combinational circuit with four inputs (A, B, C and D) and four outputs (W, X, Y and Z). When the binary input is less than ten the binary output is two greater than the input. When the binary input is equal or greater than ten the binary output is three less than the input.

So, I'm trying to get revolutions/second from a given binary data. for example, the input binary...

So, I'm trying to get revolutions/second from a given binary data. for example, the input binary data is: V=[0 1 0 0 1 0 0 0 1 0 1 1 0 0 0 0 0 1 0 ] let's say the distance between each value is arbitrary (for this example, you can use 0.1). Each 1 represents a full rotation of a bike pedal, and I'm trying to calculate the pedal rate from a given binary dataset in Matlab. How...

Suppose that 8% of emails is spam and 92% (prior probabilities) are normal. The probabilities (likelihood...

Suppose that 8% of emails is spam and 92% (prior probabilities) are normal. The probabilities (likelihood of evidence) of occurrence of various worlds in normal and spam emails are given in the following table: word P(word|spam) P(word|normal) abandoned fund 0.5 0.01 deceased customer 0.6 0.05 Bank account 0.2 0.1 Consider the following email message “I am Mrs Sarah Boardman. I have decided to seek a confidential co-operation with you, During the course of our bank year auditing, I discovered an...

Design a 8-to-3 binary encoder, with priority in binary sequence (i.e. input line 0 has higher...

Design a 8-to-3 binary encoder, with priority in binary sequence (i.e. input line 0 has higher priority than input line 1 etc). There should also be an "active" output which is 1 when any input line is active, and "0" when all input lines are 0. If all input lines are 0, the output lines other than the "active" output are "don't care".

Consider a binary channel transmitting bits independently. Each bit is demodulated with a 0 corresponding to...

Consider a binary channel transmitting bits independently. Each bit is demodulated with a 0 corresponding to 0 volts and a 1 corresponding to 5 volts. Thus, the received random variable v is normally distributed with variance σ2 = 1 and mean μ = 0 or μ = 5. The demodulated voltage v is compared to a threshold τ to decide whether a bit is a 0 or 1, i.e., decide that a 1 was sent if v > τ and...

Sorting with Binary Search Tree This assignment asks you to sort the lines of an input...

Sorting with Binary Search Tree This assignment asks you to sort the lines of an input file (or from standard input) and print the sorted lines to an output file (or standard output). Your program, called bstsort (binary search tree sort), will take the following command line arguments: % bstsort [-c] [-o output_file_name] [input_file_name] If -c is present, the program needs to compare the strings case sensitive; otherwise, it's case insensitive. If the output_file_name is given with the -o option,...

A binary counter has one input X and counts as follows. If X = 0, it...

A binary counter has one input X and counts as follows. If X = 0, it counts 2, 3, 1 and repeats; if X = 1, it counts 1, 0, 3 and repeats. You can assume that the following cases do not occur: counter value is 0 with X = 0, and counter value is 2 with X = 1. (a) Draw the state diagram of the binary counter above. Use the binary counting values as the state names. You...

I need the vhdl code to display the binary number specified by an 8 input dip...

I need the vhdl code to display the binary number specified by an 8 input dip switch on a 7 segment display.

Subjects