Queue Evaluation Criteria - OpenData-tu/documentation GitHub Wiki

Authorship

Version Date Modified by Summary of changes
0.1 2017-05-25 Oliver Bruski Initial version

What are we looking for

We are looking for an additional layer of security and fault-tolerance. We need a publish-subscribe system so that we have the possibility to control the load on our database. Further we want a component that takes away the necessity to manage data flow in the code of the importing workers and writing workers.

Queue Requirements

  1. Open source or at the very least an open license is required.
    • Active community
  2. Distributed characteristics of the system
    • Not a monolith - fit into our microservice architecture
    • Easily scalable
  3. Publish-Subscribe system for asynchronous messaging
  4. Easy to include into our workflow (API)
  5. Always available
    • Fault-tolerant to machine failures
    • Replication to prevent data loss
  6. Logging, success/failure notifications