Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Monitor the pending task count In netty worker thread pool #14980

Open
kkewwei opened this issue Jul 25, 2024 · 1 comment
Open
Labels
Cluster Manager enhancement Enhancement or improvement to existing feature or request

Comments

@kkewwei
Copy link
Contributor

kkewwei commented Jul 25, 2024

Is your feature request related to a problem? Please describe

We find the took in search response is smaller than the external statistics timeout in product, partial reason is that some threads of worker thread pool are relatively busy, the search requests are pending on the worker queue. Yet there is not available api, to get the statistics of worker queue, we have to add metrics and build the source code, If fact, There is a serious queuing in rarely case:
97, 64, 68, 108, 133, 61, 62, 123, 70, 66, 118, 110, 65, 52, 95, each number represents one of the worker threads's pending tasks, It is very difficult to troubleshoot when it happens.

Just as described in #639 and #13662 and #13741.

Describe the solution you'd like

If we could monitor the queue, add api to get those metrics, and print log in server log? I'm pleasure to implement it.

Related component

Cluster Manager

Describe alternatives you've considered

No response

Additional context

No response

@kkewwei kkewwei added enhancement Enhancement or improvement to existing feature or request untriaged labels Jul 25, 2024
@kkewwei kkewwei changed the title [Feature Request] Monitor the pending task count of netty worker thread pool [Feature Request] Monitor the pending task count In netty worker thread pool Jul 25, 2024
@dblock dblock removed the untriaged label Aug 12, 2024
@dblock
Copy link
Member

dblock commented Aug 12, 2024

[Catch All Triage - 1, 2, 3]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Cluster Manager enhancement Enhancement or improvement to existing feature or request
Projects
Status: 🆕 New
Development

No branches or pull requests

2 participants