Epic OSM Improvments - Project-EPIC/epic-osm-realtime GitHub Wiki

Goals for Improving Epic-OSM

Epic-OSM fails to scale well for numerous reasons. Most important of which is the slow import process and the lack of intelligent data structures in the Mongo database.

Steps for Improving

  1. Use the Pyosmium (maintained) python bindings for osmium to read PBF file and save to Mongo.

  2. Through either the reading process or through post-import map-reduce functions, build more intelligent collections such as "changesets_with_objects" and "users_with_changesets" etc.

Database Structure Improvements

  1. Consider collections for unique objects (with embedded object versions)