Lesson 2: Hadoop Distributed File System, MapReduce, and BigData Applications

In this class, we will address the problem statement of Hadoop MapReduce and Hadoop Distributed File System (HDFS): 1. Counting the frequency of words in the given input use MapReduce algorithm: using the word count in the Cloudera eclipse to do the odd-even count.

You are required to use your IDE. I used Eclipse Luna here which is already in the distribution of Cloudera Hadoop. Open Eclipse— > Click on New— > Java Project— > Project name— > Finish click. Here I create a project called BigDataProgramming, under which I create a subdirectory named ICP2, under which I create 3 java programs named WordCount.java, NumberCount.java, and CharFreq.java.

Input Text

Map Reducer

Q1 Code

Q1 Output

Q2 Code

Q2 Output

Hue Output 1

Hue Output 2