Getting started with EMR - OXYGEN-MARKET/oxygen-market.github.io GitHub Wiki

HOME > SNOWPLOW SETUP GUIDE > Step 6: Get started analyzing Snowplow data > Getting started with EMR and Hive

Elastic Mapreduce (EMR) is a service provided by Amazon that makes it relatively straight forward to use Hadoop and Hadoop-powered tools (e.g. Hive, Pig, Mahout, Cascading) to process data stored in S3. Amazon has made it easy to spin up clusters of machines of varying sizes to process large volumes of data, and spin them down once querying is complete.

Because Snowplow data is stored on S3 and Snowplow data volumes are often very large, processing them using Hadoop on EMR is a particularly attractive option for a wealth of analysis. This is especially true for people who wish to run machine learning algorithms on the Snowplow data set using Mahout. (E.g. to develop recommendation engines or segment audience by behaviour.)

More details on EMR can be found on the Amazon website.