ICP12: Graph Frames and GraphX - gabriellawillis/BigData GitHub Wiki
Source Code: SourceCode
Part –1:
1.Import the dataset as a csv file and create data frames directly on import than create graph out of the data frame created.
2.Concatenate chunks into list & convert to DataFrame
3.Remove duplicates
4.Name Columns
5.Output DataFrame
6.Create vertices
7.Show some vertices
8.Show some edges
9.Vertex in-Degree
10.Vertex out-Degree
11.Apply the motif findings.
12.Apply Stateful Queries.
13.Subgraphs with a condition.
Bonus
1.Vertex degree
2.What are the most common destinations in the dataset from location to location?
4.Save graphs generated to a file.
