ICE 3 - AvniM/Big-Data-Analytics GitHub Wiki
Link to source code
Team Members:
Name: Avni Mehta, Class Id: 11
Name: (Trinada) Raji Muppala, Class Id: 14
Objective:
Problem 1 :
Build the Linear Regression model using 50 iterations , Split data into 70% training and 30% testing, Report Training Mean Square Error, Report Test Mean Square Error
Input:
Output: Training Mean Square Error, Report Test Mean Square Error
Code Screenshot1
Code Screenshot2
Code Explaination
- First split the data using "," delimeter
- Then randomly split the parsed data into 70% Training and 30% test data
- Use LinearRegressionWithSGD function to train the dataset for 50 iterations and 0.00000001 step size.
- Then after predicting the values for both training and test dataset, calculate training MSE and test MSE
Problem 2 :
Implement K-Mean Clustering on provided 3D Road Network , Cluster the data into 3 and 4 classes, Evaluate clustering by computing Within Set Sum of Squared Errors , Compare their results
Input:
Output:
Sum of Squared error with Cluster 3
Sum of Squared error with Cluster 4
Comparion chart for culster with 3 cluster with 4
Code
Code Explaination
- First split the data using "," delimeter
- Use KMeans function to train the dataset for 3 clusters first.
- Compute Sum of Squared Errors for 3 clusters and predict values for all clusters.
- Then use KMeans function to train the dataset for 4 clusters first.
- Compute Sum of Squared Errors for 4 clusters and predict values for all clusters.
Contritbution of Team Members:
100% for both since both team members completed the ICE individually.