Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Remote State Repositories] Introduce a new prefix for configuring remote publication repositories #16390

Open
rajiv-kv opened this issue Oct 19, 2024 · 1 comment
Labels
Cluster Manager enhancement Enhancement or improvement to existing feature or request

Comments

@rajiv-kv
Copy link
Contributor

Is your feature request related to a problem? Please describe

For remote clusters, that store segment and translog in remote, the repositories are configured as node attributes with attribute prefix remote_store. This causes limitation for clusters which want to store only metadata in remote. As the repositories for cluster-state and routing-table also use the same prefix remote_store, it causes cluster-manager to incorrectly assume that publication nodes as remote nodes.

Describe the solution you'd like

We can introduce a new attribute prefix remote_publication to configure publication repositories and make the prefix configurable via static setting. Since the attributes of remote_store and remote_publication configuration don’t overlap, the validation of repository attributes during NodeJoin would be evaluated only for the corresponding node types by cluster-manager.

Related component

Cluster Manager

Describe alternatives you've considered

No response

Additional context

No response

@rajiv-kv rajiv-kv added enhancement Enhancement or improvement to existing feature or request untriaged labels Oct 19, 2024
@rajiv-kv rajiv-kv changed the title [Remote State Repositories] <title> [Remote State Repositories] Introduce a new prefix for configuring remote publication repositories Oct 19, 2024
@rajiv-kv rajiv-kv moved this from 🆕 New to 🏗 In progress in Cluster Manager Project Board Oct 24, 2024
@dblock
Copy link
Member

dblock commented Nov 11, 2024

[Catch All Triage - 1, 2, 3, 4]

@dblock dblock removed the untriaged label Nov 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Cluster Manager enhancement Enhancement or improvement to existing feature or request
Projects
Status: 🏗 In progress
Development

No branches or pull requests

2 participants