Distributed Streaming platform
Think of it as:
👉 Producers (send messages) → Kafka Broker (stores/distributes them in Topics) → Consumers (read messages).
👉 Producers (send messages) → Kafka Broker (stores/distributes them in Topics) → Consumers (read messages).
Core Concepts
-
Broker – A Kafka server that stores and serves messages.
-
Topic – A logical category to which messages are published (like a folder).
-
Partition – A topic is split into partitions for scalability. Each partition is an ordered sequence of messages.
-
Producer – Application that sends messages to a topic.
-
Consumer – Application that reads messages from a topic.
-
Consumer Group – A group of consumers that share the load of reading messages from partitions.
To Understand what value is there in the partition.
Install KafkaTool and provide the details from tomcat\kafka-1.1.0.8\config\server.config -> listeners line
ClusterName - Kafka-1.1.0.8
Kafka Cluster Version - 1.1
ZookeperHost -> 192.168.4.21
ZookeperPort -> 9092
ChrootPath - > /
I have created a QP - ABCDEF which i can see it has created 6 partitions (0-6)
Each Partitions has Offset from start 0
Now simply queue three items to QP
The Queue items are exeuted and can see the partitions selected 1, 2, 3 and each ran once
I have created a QP - ABCDEF which i can see it has created 6 partitions (0-6)
Each Partitions has Offset from start 0
Now simply queue three items to QP
The Queue items are exeuted and can see the partitions selected 1, 2, 3 and each ran once
Post a Comment