Kafka mini provisioning - Seagate/cortx-utils GitHub Wiki

Pre-Requisites:

1. Kafka

Download the Kafka rpm using the command and install it in all the nodes

curl "http://cortx-storage.colo.seagate.com/releases/cortx/third-party-deps/centos/centos-7.8.2003-2.0.0-latest/commons/kafka/kafka-2.13_2.7.0-el7.x86_64.rpm" -o kafka.rpm
yum install kafka.rpm

Enable services

Enable the services on each node.

systemctl enable kafka-zookeeper
systemctl enable kafka

2. cortx-py-utils

Refer to the link to Build and Install cortx py utils

Kafka mini-provisioning steps:

Edit this template file and save as /tmp/kafka_miniprovisioning_tmpl

  • As of now, the same template file is used in all phases.
cortx:
  software:
    kafka:
      servers:
      # Value should be in format <FQDN>:<port>. Port is optional
      - TMPL_KAFKA_SERVER1_FQDN:TMPL_KAFKA_SERVER1_PORT
      - TMPL_KAFKA_SERVER2_FQDN:TMPL_KAFKA_SERVER2_PORT
  • cortx>software>kafka>servers ==> Is the list of kafka_servers:port. Port is optional, if not passed, default Kafka port 9092 is used.

Post Install

/opt/seagate/cortx/utils/bin/kafka_setup post_install --config yaml:///tmp/kafka_miniprovisioning_tmpl

Prepare

/opt/seagate/cortx/utils/bin/kafka_setup prepare --config yaml:///tmp/kafka_miniprovisioning_tmpl

Config

/opt/seagate/cortx/utils/bin/kafka_setup config --config yaml:///tmp/kafka_miniprovisioning_tmpl

Init

/opt/seagate/cortx/utils/bin/kafka_setup init --config yaml:///tmp/kafka_miniprovisioning_tmpl

Test

/opt/seagate/cortx/utils/bin/kafka_setup test --config yaml:///tmp/kafka_miniprovisioning_tmpl

Cleanup

/opt/seagate/cortx/utils/bin/kafka_setup cleanup --config yaml:///tmp/kafka_miniprovisioning_tmpl

Reset

/opt/seagate/cortx/utils/bin/kafka_setup reset --config yaml:///tmp/kafka_miniprovisioning_tmpl

⚠️ **GitHub.com Fallback** ⚠️