Apache Kafka Installation (v2.4.1)

1. Download and Extract Kafka

wget https://archive.apache.org/dist/kafka/2.4.1/kafka_2.11-2.4.1.tgz
tar xvf kafka_2.11-2.4.1.tgz
mv kafka_2.11-2.4.1 kafka
cd kafka

2. Configure ZooKeeper

nano config/zookeeper.properties

Update:

dataDir=./zookeeper

Start ZooKeeper:

bin/zookeeper-server-start.sh config/zookeeper.properties

3. (Optional) Fix ZooKeeper Port Conflict

If ZooKeeper fails to start or is already running on port 2181, update Kafka config:

nano config/server.properties

On line 123 change port to:

zookeeper.connect=localhost:32181

Then adjust ZooKeeper config to match:

nano config/zookeeper.properties

On line 18 change:

clientPort=32181

4. Start Kafka Broker

bin/kafka-server-start.sh config/server.properties