Kafka Single Node Single Broker Configuration


Kafka Single Node Single Broker Configuration
In this configuration you have a single ZooKeeper and broker id instance. Following are the steps to configure it.
 
Steps to follow
Step 1 - Open a new terminal (CTRL + ALT + T) and change the directory to /usr/local/kafka
 
$ cd /usr/local/kafka
Step 2 - Start the zookeeper
 
$ ./bin/zookeeper-server-start.sh config/zookeeper.properties
Step 3 - Open a new terminal (CTRL + ALT + T) and change the directory to /usr/local/kafka
 
$ cd /usr/local/kafka
Step 4 - Start the kafka server
 
$ ./bin/kafka-server-start.sh config/server.properties
Step 5 - Open a new terminal (CTRL + ALT + T) and just type 'jps' (without quotes). It shows all the java processes that are running.
 
Here Kafka is the kafka server and QuorumPeerMain is zookeeper process.
Step 6 - Open a new terminal (CTRL + ALT + T) and change the directory to /usr/local/kafka
 
$ cd /usr/local/kafka
Step 7 - Create a topic.
 
$ ./bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic Hello-Kafka
Step 8 - List a topics. (optional)
 
$ ./bin/kafka-topics.sh --list --zookeeper localhost:2181
Step 9 - Open a new terminal (CTRL + ALT + T) and change the directory to /usr/local/kafka
 
$ cd /usr/local/kafka
Step 10 - Producer
 
$ ./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic Hello-Kafka
Step 11 - Open a new terminal (CTRL + ALT + T) and change the directory to /usr/local/kafka
 
$ cd /usr/local/kafka
Step 12 - Consumer
 
$ ./bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic Hello-Kafka --from-beginning
Step 13 - Stop zookeeper, kafka server, producer and consumer. Just press 'CTRL + D' in the terminals of zookeeper, kafka server, producer and consumer.
 
 


Have any Question or Comment?

Leave a Reply

Your email address will not be published. Required fields are marked *