Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Short-circuit async shard fetch batches to limit reroute execution time #14642

Open
Bukhtawar opened this issue Jul 4, 2024 · 0 comments
Labels
Cluster Manager enhancement Enhancement or improvement to existing feature or request ShardManagement:Performance

Comments

@Bukhtawar
Copy link
Collaborator

Is your feature request related to a problem? Please describe

As a part of assigning existing copies of shards we create async shard batches. Since batches run sequentially today, they can very well over-run causing high priority tasks to get timed out.

Describe the solution you'd like

While there are opportunities to optimise the loop further, it'd be good if we can time-bound batch executions. As in skip batch execution for shard assignment once certain time interval has elapsed.

Related component

ShardManagement:Performance

Describe alternatives you've considered

No response

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Cluster Manager enhancement Enhancement or improvement to existing feature or request ShardManagement:Performance
Projects
Status: 🆕 New
Status: 🆕 New
Development

No branches or pull requests

1 participant