Spread the loveKafka Topics List existing topics bin/kafka-topics.sh –zookeeper localhost:2181 –list Purge a topic bin/kafka-topics.sh –zookeeper localhost:2181 –alter –topic mytopic –config retention.ms=1000 … wait a minute … bin/kafka-topics.sh –zookeeper localhost:2181 –alter –topic mytopic –delete-config retention.ms
Why Coordination is Tough or Challenging in Distributed Environments.
Now you have an idea on what is Distributed system, let’s drill down deeper into why coordination in a distributed system is a hard problem.
Let’s take the example of doing coordination or configuration management for a distributed application that has many systems. Now, having a master node where the cluster data is stored and other worker nodes or slave nodes get the data from this master node is look like simple.
However, this solution suffers from a potential problem of the master node being a single point of failure.
Even if we assume that the master node is designed to be fault-tolerant, these changes should propagate to all the slave nodes and it is not easy.
Another coordination problem is, To increase availability when we add more servers to the system. In these situations coordination will be more difficult. It needs careful design and implementation of logic.