Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hold minor compactions when tablets files exceed pause limit #5151

Open
keith-turner opened this issue Dec 7, 2024 · 1 comment · May be fixed by #5289
Open

Hold minor compactions when tablets files exceed pause limit #5151

keith-turner opened this issue Dec 7, 2024 · 1 comment · May be fixed by #5289
Assignees
@ArbaazKhan1
Labels
enhancement This issue describes a new feature, improvement, or optimization.
Milestone
4.0.0

Comments

@keith-turner
Copy link
Contributor

Is your feature request related to a problem? Please describe.

As part of the work on #5023 and #5104 a new property table.file.pause was added that causes bulk imports to pause when a tablets number of files exceeds this limit. Pausing was not implemented for minor compactions.

Describe the solution you'd like

When a tablets files exceeds the pause limit minor compactions will be held on the tablet server. This should cause back pressure for live writes when compactions are not keeping up.
@keith-turner keith-turner added the enhancement This issue describes a new feature, improvement, or optimization. label Dec 7, 2024
@keith-turner keith-turner added this to the 4.0.0 milestone Dec 7, 2024
@ArbaazKhan1
Copy link
Contributor

I can take a look at this

@kevinrr888 kevinrr888 linked a pull request Jan 28, 2025 that will close this issue
added Pause option into minor compactions #5289
Open
@dlmarion dlmarion linked a pull request Jan 29, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ArbaazKhan1 ArbaazKhan1

Labels
enhancement This issue describes a new feature, improvement, or optimization.
Projects
None yet
Milestone
4.0.0
Development

Successfully merging a pull request may close this issue.

added Pause option into minor compactions ArbaazKhan1/accumulo
2 participants
@keith-turner @ArbaazKhan1