Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Query string query performance investigation #17385

Closed
bowenlan-amzn opened this issue Feb 18, 2025 · 2 comments
Closed

Query string query performance investigation #17385

bowenlan-amzn opened this issue Feb 18, 2025 · 2 comments
Assignees

Comments

@bowenlan-amzn
Copy link
Member

bowenlan-amzn commented Feb 18, 2025

There are 2 query string on message operation in big5 and we have been slower compared to ES. Based on this report https://blog.trailofbits.com/2025/03/06/benchmarking-opensearch-and-elasticsearch/
Big5 Text Querying section

Query Details

query-string-on-message OS 145 ES 3.5
https://github.com/opensearch-project/opensearch-benchmark-workloads/blob/main/big5/queries/query-string-on-message.json

{
  "query": {
    "query_string": {
      "query": "message: shield AND carp AND shark"
    }
  }
}

query-string-on-message-filtered OS 27 ES 10.4
https://github.com/opensearch-project/opensearch-benchmark-workloads/blob/main/big5/queries/query-string-on-message-filtered.json

{
  "query": {
    "bool": {
      "must": [
        {
          "range": {
            "@timestamp": {
              "gte": "2023-01-01T00:00:00",
              "lt": "2023-01-03T00:00:00"
            }
          }
        },
        {
          "query_string": {
            "query": "message: shield AND carp AND shark"
          }
        }
      ]
    }
  }
}

We suspect some problem in our implementation of match only text field and are investigating.

@bowenlan-amzn
Copy link
Member Author

Verified on OS 2.17.2 cluster this PR #16964 already fixed the issue.

@github-project-automation github-project-automation bot moved this from 🆕 New to ✅ Done in Search Project Board Feb 20, 2025
@github-project-automation github-project-automation bot moved this from Todo to Done in Performance Roadmap Feb 20, 2025
@bowenlan-amzn
Copy link
Member Author

Image

On Mar 10th, for 3.0.0-alpha1, p90 service time
query-string-on-message: ~13ms
query-string-on-message-filtered: ~6ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Status: Done
Development

No branches or pull requests

1 participant