Question

In: Computer Science

Huffman Coding Huffman coding is a lossless data compression algorithm. The idea is to assign variable-...

Huffman Coding

Huffman coding is a lossless data compression algorithm. The idea is to assign variable- length codes to input characters; lengths of the assigned codes are based on the frequencies of corresponding characters. The most frequent character gets the smallest code and the least frequent character gets the largest code.

The variable-length codes assigned to input characters are Prefix Codes, means the codes (bit sequences) are assigned in such a way that the code assigned to one character is not prefix of code assigned to any other character. This is how Huffman Coding makes sure that there is no ambiguity when decoding the generated bit stream.

In this project, you will be using a priority queue and a binary tree of your design to implement a file compression/uncompression algorithm called "Huffman Coding".
Your program will read a text file and compress it using your implementation of the Huffman coding algorithm found in the explanation. The compressed text will be written to a file. That compressed file will be then be read back by your program and uncompressed. The uncompressed text will then be written to a third file. The uncompressed text file should of course match the original text file.

Summary of Processing

  • Read the specified file and count the frequency of all characters in the file.

  • Create the Huffman coding tree based on the frequencies.

  • Create the table of encodings for each character from the Huffman coding tree.

  • Encode the file and output the encoded/compressed file.

  • Read the encoded/compressed file you just created, decode it and output the

    decoded file.

Solutions

Expert Solution

Prefix Codes, means the codes (bit sequences) are assigned in such a way that the code assigned to one character is not the prefix of code assigned to any other character.This is how Huffman Coding makes sure that there is no ambiguity when decoding the generated bitstream.Let us understand prefix codes with a counter example.Let there be four characters a, b, c and d, and their corresponding variable length codes be 00, 01, 0 and 1.This coding leads to ambiguity because code assigned to c is the prefix of codes assigned to a and b.If the compressed bit stream is 0001, the de-compressed output may be “cccd” or “ccb” or “acd” or “ab”.There are mainly two major parts in Huffman Coding1) Build a Huffman Tree from input characters...................

Steps to build Huffman Tree
Input is an array of unique characters along with their frequency of occurrences and output is Huffman Tree.

1. Create a leaf node for each unique character and build a min heap of all leaf nodes (Min Heap is used as a priority queue. The value of frequency field is used to compare two nodes in min heap. Initially, the least frequent character is at root)

2. Extract two nodes with the minimum frequency from the min heap.

3. Create a new internal node with a frequency equal to the sum of the two nodes frequencies. Make the first extracted node as its left child and the other extracted node as its right child. Add this node to the min heap.

4. Repeat steps#2 and #3 until the heap contains only one node. The remaining node is the root node and the tree is complete.

Let us understand the algorithm with an example:

character   Frequency
    a            5
    b           9
    c           12
    d           13
    e           16
    f           45

Step 1. Build a min heap that contains 6 nodes where each node represents root of a tree with single node.

Step 2 Extract two minimum frequency nodes from min heap. Add a new internal node with frequency 5 + 9 = 14.

Now min heap contains 5 nodes where 4 nodes are roots of trees with single element each, and one heap node is root of tree with 3 elements

character           Frequency
       c               12
       d               13
 Internal Node         14
       e               16
       f                45

Step 3: Extract two minimum frequency nodes from heap. Add a new internal node with frequency 12 + 13 = 25

Step 4: Extract two minimum frequency nodes. Add a new internal node with frequency 14 + 16 = 30

Steps to print codes from Huffman Tree:
Traverse the tree formed starting from the root. Maintain an auxiliary array. While moving to the left child, write 0 to the array. While moving to the right child, write 1 to the array. Print the array when a leaf node is encountered.


The codes are as follows:

character   code-word
    f          0
    c          100
    d          101
    a          1100
    b          1101
    e          111

Related Solutions

Based on the scenario above, implement the Huffman coding algorithm using Java NetBeans. Assume the characters...
Based on the scenario above, implement the Huffman coding algorithm using Java NetBeans. Assume the characters and frequencies as listed below. The total number of nodes is n = 6.
Encode “GOOGLE” using Huffman coding algorithm. Show that the entropy of “GOOGLE” specifies the lower bound...
Encode “GOOGLE” using Huffman coding algorithm. Show that the entropy of “GOOGLE” specifies the lower bound for the average number of bits to code each symbol in “GOOGLE”.
C++ Data Structures: Use Huffman coding to encode text in given file (Pride_and_Prejudice.txt). TO_DO: Define a...
C++ Data Structures: Use Huffman coding to encode text in given file (Pride_and_Prejudice.txt). TO_DO: Define a struct for Huffman tree node. This struct contains links to left/right child nodes, a character, and its frequency.Define a function for file reading operation. This function should take in a filename (string type) as parameter and return a proper data structure object that contains characters and their frequencies that will be used to generate Huffman tree nodes.The construction of Huffman tree requires taking two...
4. a) Distinguish between adaptive Huffman coding and Adaptive Arithmetic coding in terms of adaptation rate....
4. a) Distinguish between adaptive Huffman coding and Adaptive Arithmetic coding in terms of adaptation rate. b) Describe how quick changes are adapted and prevented in each method for source statistics? Explain in elaborate?
Say that the input for an Huffman coding contains 256 letters. Each appearing the the same...
Say that the input for an Huffman coding contains 256 letters. Each appearing the the same number of times. (a) If we choose to code all letters by codes of the same length, what is the number of bits required? (b) Is the Huffman code better than the code of the first item?
Prove / Disprove the following 2 properties using Huffman Coding: a) If some characters occur with...
Prove / Disprove the following 2 properties using Huffman Coding: a) If some characters occur with a frequency of more than 2/5, then there is a codeword that is guaranteed to be a length of 1. b) If all characters occur with a frequency of less than 1/3, then there are no codewords guaranteed to be a length of 1.
In an isobaric compression of an idea gas, a) the internal energy of the gas remains...
In an isobaric compression of an idea gas, a) the internal energy of the gas remains constant,    b) no heat flows into the gas, c) no work is done on the gas, d) work is done on the gas,        and/or e) work is done by the gas. An ideal gas undergoes an isothermal expansion from one state to another.  In this process determine the following (using the sign conventions on page 413): Q = 0, Q > 0 or Q < 0 W...
Create your own data type using a C++ structure. Assign values to a variable of that...
Create your own data type using a C++ structure. Assign values to a variable of that data type. Retrieve values from the variable of that data type. Description: In this lab you will choose the statements to create a program that: Creates a brand new data type called "Monster". Once created, creates a variable of type Monster and assign values to the variable and then display the contents. This lab will again take the form of a guided multiple-choice quiz...
Python HW with Jupyter Notebook Declare a variable named DATA as a dictionary object. Assign the...
Python HW with Jupyter Notebook Declare a variable named DATA as a dictionary object. Assign the set of key/value pairs shown below. Create a function named iter_dict_funky_sum() that takes one dictionary argument.    Declare a running total integer variable. Extract the key/value pairs from DATA simultaneously in a loop. Do this with just one for loop and no additional forms of looping. Assign and append the product of the value minus the key to the running total variable. Return the funky...
Using the idea of the Bubble Sort algorithm, design an algorithm in pseudocode that gets 3...
Using the idea of the Bubble Sort algorithm, design an algorithm in pseudocode that gets 3 numbers a, b, c, from the user, and prints the 3 numbers in ascending order
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT