Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: lots of warning logs for batch-processor-manager.lua removing batch processor stale object #11984

Open
cataglyphis opened this issue Feb 21, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@cataglyphis
Copy link

Current Behavior

A lot of warning logs for batch-process-manager at output logs of Apisix pod

Expected Behavior

No response

Error Logs

| 2025/02/21 01:08:20 [warn] 49#49: *4638532 [lua] batch-processor-manager.lua:60: removing batch processor stale object, conf: {"max_resp_body_bytes":524888,"name":"kafka-logger","cluster_name":1,"batch_max_size":1,"include_resp_body":true,"meta_format":"default","max_retry_count":0,"required_acks":-1,"kafka_topic":"test-apisix","timeout":6,"max_req_body_bytes":524288,"inactive_timeout":5,"meta_refresh_interval":30,"producer_max_buffering":50000,"buffer_duration":60,"producer_batch_size":1048576,"include_req_body":true,"producer_time_linger":1,"producer_type":"async","producer_batch_num":200,"retry_delay":1,"brokers":[{"host":"xxx1.c1.kafka.us-west-2.amazonaws.com","port":9092},{"host":"xxx2.c1.kafka.us-west-2.amazonaws.com","port":9092},{"host":"xxx3.c1.kafka.us-west-2.amazonaws.com","port":9092}]}, context: ngx.timer, client: 10.170.50.129, server: 0.0.0.0:9080 |

Steps to Reproduce

  1. run apisix in k8s env
  2. enable kafka logger plugin in global rules

Environment

  • APISIX version (run apisix version): 3.10.0
  • Operating system (run uname -a): debian
  • OpenResty / Nginx version (run openresty -V or nginx -V):
  • etcd version, if relevant (run curl http://127.0.0.1:9090/v1/server_info):
  • APISIX Dashboard version, if relevant:
  • Plugin runner version, for issues related to plugin runners:
  • LuaRocks version, for installation issues (run luarocks --version):
@dosubot dosubot bot added the bug Something isn't working label Feb 21, 2025
@bzp2010
Copy link
Contributor

bzp2010 commented Feb 22, 2025

This is usually related to the logger plugin not being able to handle log uploads correctly, such as network errors or authentication errors. When a data batch upload fails and the maximum number of retries is exceeded, it will be deleted.
Therefore, this is the result of an error, not the cause of the error, and you have to check the log for other errors related to this and fix it.

Please provide a more complete log, otherwise this issue is pointless.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: 📋 Backlog
Development

No branches or pull requests

2 participants