janecww / spark-cloud Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

Using Spark to analyze a dataset, public or self-collected, and drawing some insights from it

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 16 Commits
Codes		Codes
Datasets		Datasets
README.md		README.md
Spark Project Report.pdf		Spark Project Report.pdf

Repository files navigation

Data Analysis with Spark

This project is to analyze the MovieLens 1M Dataset from Grouplens and draw some insights from it using Apache Spark.

Data File

https://grouplens.org/datasets/movielens/1m/

Techniques Involved

Exploratory Data Analysis & Visualization
Correlation-based Recommendation System
Alternating Least Square (ALS) Matrix Factorization using MLlib

About

Using Spark to analyze a dataset, public or self-collected, and drawing some insights from it

spark data-visualization cloud-computing recommendation-system big-data-analytics alternating-least-squares

Report repository

Releases

No releases published

Packages

No packages published

Languages