Kafka commands

 Producer console

./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic testTopic --partition 0



Consumer console

./bin/kafka-console-consumer.sh --broker-list localhost:9092 --topic testTopic --partition 0


Describe a topic

./bin/kafka-topic.sh --describe --zookeeper localhost:2181 --topic <topicName>


Broker Version

./bin/kafka-broker-api-versions --bootstrap-server localhost:9092 --version


Create a topic 

/bin/kafka-topics.sh --zookeeper $ZK_HOSTS --create --topic $TOPIC_NAME --partitions 3 --replication-factor 3


Create a topic if it doesn't exist

/bin/kafka-topics.sh --zookeeper $ZK_HOSTS --create --topic $TOPIC_NAME --partitions 3 --replication-factor 3 --if-not-exists


List brokers

./usr/bin/kafka-topics --zookeeper zookeeper:2181 --list


Show Kafka topic details

./usr/bin/kafka-topics --zookeeper zookeeper:2181 --topic my-first-topic --describe


Increase partitions in the topic

./usr/bin/kafka-topics --zookeeper zookeeper:2181 --alter --topic my-first-topic --partitions 5



Get partition offset of a topic

./bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list localhost:9092 --topic $TOPIC_NAME

Format is: topicname:partition-id:offset


Show offset of a specific partition

/bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list localhost:9092 --topic $TOPIC_NAME --partitions partition-id, another-partition-id


Delete a topic

/bin/kafka-topics.sh — zookeeper $ZK_HOSTS --delete --topic $TOPIC_NAME


Produce messages from a file

/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic my-first-topic < topic-input.txt


Produce message in Kafka with key and value

/usr/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic $TOPIC_NAME --property parse.key=true --property key.separator=:

Example:
>key:value
>foo:bar
>anotherKey:another value

By default messages sent to a Kafka topic will result in messages with null keys. In this example, the separator between the key and the value is: :



Consume message from Kafka with key-value and timestamp

/bin/kafka-console-consumer --bootstrap-server localhost:9092 --topic some-topic --formatter kafka.tools.DefaultMessageFormatter --property print.timestamp=true --property print.key=true --property print.value=true



Consume message from the beginning

/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic my-first-topic --from-beginning

Comments

Post a Comment

Popular posts from this blog

Get first non-repeating Letter

import java.util.HashMap ; import java.util.LinkedHashMap ; import java.util.Map ; import java.util.HashMap ; import java.util.LinkedHashMap ; import java.util.Map ; public class Check { public static String firstNonRepeatingLetter ( String str) { String val= null ; char [] var =str.toCharArray(); LinkedHashMap < Character , Integer > map = new LinkedHashMap<>(); for ( int i= 0 ;i< var . length ;i++){ if ( map .containsKey( var [i])){ map .put( var [i], map .get( var [i])+ 1 );} else { map .put( var [i], 1 ); } } for ( Map . Entry < Character , Integer > entry : map .entrySet()){ if ( entry .getValue()== 1 ) { val = Character . toString ( entry .getKey()); break ; } } return val; } public static void main ( String [] args) { System . out .println( firstNonRepea...
Read more

Cypress run command

To run particular test spec file  node_modules/.bin/cypress run -s "cypress/integration/examples/Test1.js" To run all the test present under cypress folder node_modules/.bin/cypress run  To open cypress test runner UI node_modules/.bin/cypress open To execute cypress test in particular browser (by default cypress run in headless mode) node_modules/.bin/cypress run --browser {browserName}
Read more

Docker commands

List all images in docker-engine docker ps -a Delete image from the local image store docker image rm alpine:3.4 Run a container from the Alpine docker container run --name web -p 5000:80 alpine:3.9 Stop a running container through SIGTERM docker container stop web Stop a running container through SIGKILL docker container kill web List the running containers  docker container ls Print the last 100 lines of a container’s logs docker container logs --tail 100 web(container name) List the networks docker network ls   
Read more