Utilize Python to create a key-value program similar to MapReduce on Hadoop. For this assignment, do...

Utilize Python to create a key-value program similar to MapReduce on Hadoop. For this assignment, do the following:

Create a dictionary (also called an associative array) that contains at least 50 values. An example of a key may be state and value as capital. Another example may be number in an alphabet and letter in an alphabet.
Write a command that enumerates the contents of key-values in the dictionary.
Write a command that lists all keys.
Write a command that lists all values.
Write a command that replaces key number "1" with a new value.

How this program could operate in a distributed environment where the dictionary is spread across a cluster of nodes. What would be the limitations of this architecture? Is there a threshold for the amount of data and the overhead of operating on a cluster?

Expert Solution

venereology answered 1 year ago

Write a MapReduce program in hadoop to find the words that occurs more than 2000 times...

Write a MapReduce program in hadoop to find the words that occurs more than 2000 times in book.txt file. To count the occurrences of the words and filter the Filterwords in book.txt, convert all words into lower case. Also filter the digits (0-9) and punctuation. The class made to filter the word are below. Filterwords.isOneOfThem(String in) returns true if in is a Filterword. class Filterwords { public static String [] myFilterWordsArray = { "a", "an", "the", "am", "are", "is","at"}; public...

Description of the Assignment: Write a Python program to (a) create a new empty stack. Then,...

Description of the Assignment: Write a Python program to (a) create a new empty stack. Then, (b) add items onto the stack. (c) Print the stack contents. (d) Remove an item off the stack, and (e) print the removed item. At the end, (f) print the new stack contents: Please use the following comments in your python script: # ************************************************* # COP3375 # Student's full name ( <<< your name goes here) # Week 8: Assignment 1 # ************************************************* #...

How to do this in Python (using Lists): Create a python program that allows a user...

How to do this in Python (using Lists): Create a python program that allows a user to display, sort and update as needed a List of U.S States containing the State Capital and State Bird. You will need to embed the State data into your Python code. The user interface will allow the user to perform the following functions: 1. Display all U.S. States in Alphabetical order along with Capital and Bird 2. Search for a specific state and display...

Create a python program to determine which years are leap years (see key information at the...

Create a python program to determine which years are leap years (see key information at the bottom). Note: Do not use any lists. 1. Define a function that takes a parameter (year) and verifies if the parameter year is a leap year. If it is a leap year, the function returns True. Else, it returns False. Note: the function should not print anything. 2. Using the function, check if each of the years from 2000 to 2200 (both inclusive) is...

You will utilize a large dataset to create a predictive analytics algorithm in Python. For this...

You will utilize a large dataset to create a predictive analytics algorithm in Python. For this assignment, complete the following: Utilize one of the following Web sites to identify a dataset to use, preferably over 500K from Google databases, kaggle, or the .gov data website Utilize a machine learning algorithm to create a prediction. K-nearest neighbors is recommended as an introductory algorithm. Your algorithm should read in the dataset, segmenting the data with 70% used for training and 30% used...

For Python: In this assignment you are asked to write a Python program to determine the...

For Python: In this assignment you are asked to write a Python program to determine the Academic Standing of a studentbased on their CGPA. The program should do the following: Prompt the user to enter his name. Prompt the user to enter his major. Prompt the user to enter grades for 3 subjects (A, B, C, D, F). Calculate the CGPA of the student. To calculate CGPA use the formula: CGPA = (quality points * credit hours) / credit hours...

Write a python program that keeps names and email addresses in a dictionary as key-value pairs....

Write a python program that keeps names and email addresses in a dictionary as key-value pairs. The program should display a menu that lets the user look up a person’s email address, add a new name and email address, change an existing email address, and delete an existing name and email address. The program should bind the dictionary and save it to a file when the user exits the program. Each time the program starts, it should retrieve the dictionary...

Java/Python/C++ Assignment Write a program to implement one round of AES-128 Input is the key and...

Java/Python/C++ Assignment Write a program to implement one round of AES-128 Input is the key and plaintext a. Show the plaintext as a 4x4 matrix b. Show the result after adding RoundKey0 c. Show the result after SubBytes d. Show the result after ShiftRows e. Show the result after MixColumns f. Show the result after first round

In Python, create a program with 2 classes that do the following. HashCreate class, this class...

In Python, create a program with 2 classes that do the following. HashCreate class, this class will accept a directory and hash each file in the directory and store the results in a dictionary. The dictionary will contain the hash value and file name. HashVerify, the second class will accept the dictionary as input and save that in an instance attribute. This class must also contain a method for lookups that require a file path as input. The lookup method...

Create a Python script in IDLE or Kali Python3 CLI to create the following Python Program:...

Create a Python script in IDLE or Kali Python3 CLI to create the following Python Program: Your program will create a username of your choice using a Kali Linux command "useradd -m mark", then set the password for that user using the Kali Linux Command "echo "mark:10101111" | chpasswd". Then you create a dictionary file using the Kali Linux command "crunch 8 8 01 > mylist.txt" Your python script should crack the password for that user and display on the...

Question