5. Kafka Consumer - stm29/Kafka GitHub Wiki

Kafka Consumer

• Consumer actually consume messages from partition , which is inside topic
• Every consumer should associated with consumer group
• if no group_id is provided for a consumer, random consumer group id will be given
• Configuration needed by the consumer
  • topic
  • bootstrap_server (kafka cluster)
  • group_id

---

Consumer Group in Kafka

• Logical grouping of 1 or more consumer
• Consumer instances are separate process
• Consumer instance of same consumer group can be on different nodes

---

Important points to note

• Consumer can consume from more than 1 partition
• Same partition can't be assigned to multiple consumers in same consumer group