Near Realtime Epic OSM Processing - Project-EPIC/epic-osm-realtime GitHub Wiki

TO-DO

Framework Enhancements:

  1. Implement developmentseed/planet-stream to write to a port for easy integration with Apache Spark-Streaming
  • Connect to Mongo and write objects directly? Does this scale with large editing events?
  1. Connect Apache Spark with Hadoop Mongo Connector
  2. Write complete changesets from planet-stream to Mongo (from Spark)