ICP1 - acsenvila/-CSEE5590-490-Big-Data-Programming- GitHub Wiki
This is the Wiki for ICP1 - Implementation of ICP-1 Big Data Programming. For this ICP, Cloudera in Oracle VM VirtualBox was used as the OS environment. Inside Cloudera was integrated other Big Data software, such as Hadoop, Hive, Hbase, Hue, and others.
Objective for In Class Exercise
- Dataset1: https://umkc.box.com/s/ums4eav9ms5ejlyo7m5qnruhq917zafr
- Dataset2: https://umkc.box.com/s/gwha5sfufjat6o1cg2wcbturni9fsvmr
Visualization of Hadoop file with Hue You are required to follow the steps below to complete your ICP today
- Use the given dataset
- Load it in hadoop hdfs
- Use the second file
- Append it to the first file
- Visualize file with Hue
- View the first and last lines(approximately 5) of merged dataset using appropriate hdfs commands
- Create a new text file and load it into hdfs and try to append all three datasets.
### > > ### File Manipulation and Input
### ### Output
