Queue Evaluation Criteria - OpenData-tu/documentation GitHub Wiki
Authorship
| Version | Date | Modified by | Summary of changes |
|---|---|---|---|
| 0.1 | 2017-05-25 | Oliver Bruski | Initial version |
What are we looking for
We are looking for an additional layer of security and fault-tolerance. We need a publish-subscribe system so that we have the possibility to control the load on our database. Further we want a component that takes away the necessity to manage data flow in the code of the importing workers and writing workers.
Queue Requirements
- Open source or at the very least an open license is required.
- Active community
- Distributed characteristics of the system
- Not a monolith - fit into our microservice architecture
- Easily scalable
- Publish-Subscribe system for asynchronous messaging
- Easy to include into our workflow (API)
- Always available
- Fault-tolerant to machine failures
- Replication to prevent data loss
- Logging, success/failure notifications