Plan - Gukie/building-recommend GitHub Wiki

Value & Vision

  • Value of this App: crawl data from Internet, analyze and then give a valuable recommendation for subscribers, which should be a auto-recommendation system

  • vision: It should be a in Big Data work way, including crawling, filtering, analyzing, reporting...

HOW

    1. crawl enough data
    1. avoid store duplicate data
    1. how to retrieve the changed & valuable data, and recommend to subscribers?

Version 1

    1. crawl data (done with 2 source)
    1. store data (done without avoiding duplication)
    1. recommend data (not yet)