Patterns of Distributed Systems by Unmesh Joshi

Author:Unmesh Joshi
Language: eng
Format: epub, pdf
Publisher: Addison-Wesley Professional
Published: 2023-04-15T00:00:00+00:00

However, this method creates a problem when the cluster size changes. If two more nodes are added to the cluster, we will have five nodes. The mapping will then look like this:

The way almost all the keys are mapped changes. Even by adding only a few new cluster nodes, all the data needs to be moved. When the data size is large, this is undesirable.

Solution

A message broker like Kafka [bib-kafka] needs an ordering guarantee for the data per partition. With fixed partitions, the data per partition doesn’t change even when partitions are moved around the cluster nodes when new nodes are added.This maintains the ordering of data per partition.

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.