SQS Configuration - tomohisaota/fluent-plugin-forward-aws GitHub Wiki
SQS Paramteres
name | description |
---|---|
Default Visibility Timeout | Depends on your configuration. 5 min is recommended |
Message Retention Period | Depends on your application |
Maximum Message Size | Default value (64K) should be fine |
Delivery Delay | Default value (0) should be fine |
Receive Message Wait Time | Long polling. 20 sec is recommended |
Tuning Visibility Timeout for load balancing
Default Visibility Timeout should not matter if you have only 1 process monitoring the queue.
If you loadbalance log processing, you need to finetune visibility timeout so that same log won't get processed twice. fluent-plugin-forward-aws may fetch 10 messages at a time.
Default Visibility Timeout > (Max time to process log chunk) x 10
If you're not sure, make it long enough. It will not matter as long as your servers are stable.