Snowplow docker - GabrielXia/telemetry GitHub Wiki

Snowplow docker integrate snowplow collector, enrich and elasticsearch sink

/img/server-snowplow.jpg

Description

  • Each software uses stdin, sdout or sterr to communicate with each other.

  • You can find all the configurations and scripts in the respo

  • Collector(snowplow-stream-collector-0.9.0)

    • Collects events from clients on port 80
    • Sends "good" event to raw-events-pipe
    • Sends "bad" event to bad-events-pipe
  • Enrich(snowplow-stream-enrich-0.10.0)

    • Reads events from the raw-events-pipe
    • Checks if the event type is registered in iglu
    • Sends "good" events to good-events-pipe
    • Sends "bad" events to the bad-events-pipe
  • Sink good(snowplow-elasticsearch-sink-0.8.0-2x)

    • Reads events in from the good-events-pipe
    • Sends the events to the "good" index of elasticsearch cluster
  • Sink bad(snowplow-elasticsearch-sink-0.8.0-2x)

    • Reads events in from bad-events-pipe
    • Sends the events to the "bad" index of elasticsearch cluster

How to develop