Skip to content

[Resharding] Expand list-based, range-based and lookup-based clusters #1455

Description

@levkk

Add the ability to add shards to existing list-based, range-based and lookup-based clusters. This can be done online because mappings are explicit and it's possible to spin up a shard without having it accept any reads or writes until the sharding map is updated.

Architecture

We should re-use our existing code and resharding pattern: add another cluster into pgdog.toml with the new config and copy data from source to destination clusters. However, since the two clusters have overlapping nodes, the nodes with data and an existing mapping should be ignored by schema and data syncs and logical replication should only be setup from nodes with data to nodes that don't have any.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions