ICP4 - smqhw/kdm1 GitHub Wiki

A. Description about the ICP

The given ICP is to perform at least 3 tasks in transformations and 3 tasks in Actions using data.csv file Firstly i have imported all the libraries from the apache spark and installed the Hadoop version with all sources i performed 3 tasks in transformation and 3 tasks in actions using some data functions.

B. The main objective of the program is determine sql operations by using pyspark.sql in the given data frames c. Screenshots Provided in the Issues D. video provided in the code with the file name ICP4 video