Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor RemoteClusterStateService into smaller files. #5

Closed
wants to merge 75 commits into from

Conversation

shiv0408
Copy link
Owner

@shiv0408 shiv0408 commented Apr 8, 2024

Description

Refactor RemoteClusterStateService into smaller files.

Related Issues

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)
  • Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

ashking94 and others added 30 commits March 19, 2024 12:23
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
…12724)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
* Fixing ehcache flaky test

Signed-off-by: Sagar Upadhyaya <sagar.upadhyaya.121@gmail.com>

* Adding a ehcache issue reference for thread leak issue

Signed-off-by: Sagar Upadhyaya <sagar.upadhyaya.121@gmail.com>

* Updating comment

Signed-off-by: Sagar Upadhyaya <sagar.upadhyaya.121@gmail.com>

---------

Signed-off-by: Sagar Upadhyaya <sagar.upadhyaya.121@gmail.com>
…e API (opensearch-project#12657)

* Update supported version for adding primary_only parameter to force-merge API

Signed-off-by: Gao Binlong <gbinlong@amazon.com>

* Modify change log

Signed-off-by: Gao Binlong <gbinlong@amazon.com>

* Remove some unused code

Signed-off-by: Gao Binlong <gbinlong@amazon.com>

* Remove change log

Signed-off-by: Gao Binlong <gbinlong@amazon.com>

* Fix test issue

Signed-off-by: Gao Binlong <gbinlong@amazon.com>

---------

Signed-off-by: Gao Binlong <gbinlong@amazon.com>
…arch-project#12783)

Signed-off-by: Shweta Thareja <tharejas@amazon.com>
Co-authored-by: Shweta Thareja <tharejas@amazon.com>
…ene writer (opensearch-project#12710)

Signed-off-by: Prabhat Sharma <ptsharma@amazon.com>
Co-authored-by: Prabhat Sharma <ptsharma@amazon.com>
* [FEATURE] Built-in secure transports support

Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* Added more tests, addressing code review comments

Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* Address code review comments

Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* Address code review comments

Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* Address code review comments

Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

---------

Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
…pensearch-project#12753)

* Use cluster default remote store path type as fallback during snapshot restore

---------

Signed-off-by: Ashish Singh <ssashish@amazon.com>
…n /plugins/repository-hdfs (opensearch-project#12721)

* Bump org.apache.commons:commons-configuration2

Bumps org.apache.commons:commons-configuration2 from 2.9.0 to 2.10.0.

---
updated-dependencies:
- dependency-name: org.apache.commons:commons-configuration2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Updating SHAs

Signed-off-by: dependabot[bot] <support@github.com>

* Update changelog

Signed-off-by: dependabot[bot] <support@github.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
* Created new ReplicaShardBatchAllocator to be used instead of ReplicaShardAllocator for batch calls

Signed-off-by: Shivansh Arora <shivansh.arora@protonmail.com>
…azure (opensearch-project#12723)

* Bump com.azure:azure-json in /plugins/repository-azure

Bumps [com.azure:azure-json](https://github.com/Azure/azure-sdk-for-java) from 1.0.1 to 1.1.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-java/releases)
- [Commits](Azure/azure-sdk-for-java@azure-json_1.0.1...v1.1.0)

---
updated-dependencies:
- dependency-name: com.azure:azure-json
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Updating SHAs

Signed-off-by: dependabot[bot] <support@github.com>

* Update changelog

Signed-off-by: dependabot[bot] <support@github.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
…34.0 in /plugins/repository-gcs (opensearch-project#12365)

* Bump com.google.api.grpc:proto-google-common-protos

Bumps [com.google.api.grpc:proto-google-common-protos](https://github.com/googleapis/sdk-platform-java) from 2.33.0 to 2.34.0.
- [Release notes](https://github.com/googleapis/sdk-platform-java/releases)
- [Changelog](https://github.com/googleapis/sdk-platform-java/blob/main/CHANGELOG.md)
- [Commits](googleapis/sdk-platform-java@v2.33.0...v2.34.0)

---
updated-dependencies:
- dependency-name: com.google.api.grpc:proto-google-common-protos
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Updating SHAs

Signed-off-by: dependabot[bot] <support@github.com>

* Update changelog

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
…uster-state from remote (opensearch-project#12252)

Signed-off-by: Rajiv Kumar Vaidyanathan <rajivkv@amazon.com>
…pensearch-project#12494)

Changes for Primary Relocation during migration 

---------

Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>
…s. (opensearch-project#12496)

* Integrate with CPU admission controller for cluster-manager Read API's.
The admission control is enforced at the transport layer.

Signed-off-by: Rajiv Kumar Vaidyanathan <rajivkv@amazon.com>
…n&clone&shrink&split APIs (opensearch-project#12819)

Signed-off-by: Gao Binlong <gbinlong@amazon.com>
* Fix Flaky SimpleQueryStringIT Tests

Signed-off-by: kkewwei <kkewwei@163.com>

* add the comment to unit test

Signed-off-by: kkewwei <kkewwei@163.com>

---------

Signed-off-by: kkewwei <kkewwei@163.com>
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
Signed-off-by: Varun Bansal <bansvaru@amazon.com>
* Always return a task description even when it cannot be serialized.

Signed-off-by: dblock <dblock@amazon.com>

* Expect tasks to fail.

Signed-off-by: dblock <dblock@amazon.com>

* Only catch exceptions when getting description.

Signed-off-by: dblock <dblock@amazon.com>

* Added <error: ...> to mark error more clearly.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
The 2.13 release notes have been created.

Signed-off-by: Andrew Ross <andrross@amazon.com>
Signed-off-by: vikasvb90 <vikasvb@amazon.com>
…arch-project#12807)

* Add explicit dependency to PomValidation

Signed-off-by: Zelin Hao <zelinhao@amazon.com>

* Update CHANGELOG

Signed-off-by: Zelin Hao <zelinhao@amazon.com>

---------

Signed-off-by: Zelin Hao <zelinhao@amazon.com>
…e check at the build time (opensearch-project#12872)

* Added missed API visibility annotations for public APIs and enable the check at the build time

Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

* Address code review comments

Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

---------

Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
jed326 and others added 28 commits March 26, 2024 22:34
* Convert ingest processor supports ip type

Signed-off-by: Gao Binlong <gbinlong@amazon.com>

* Modify change log

Signed-off-by: Gao Binlong <gbinlong@amazon.com>

* Add comment

Signed-off-by: Gao Binlong <gbinlong@amazon.com>

---------

Signed-off-by: Gao Binlong <gbinlong@amazon.com>
…check for resize APIs (opensearch-project#12921)

Signed-off-by: Gao Binlong <gbinlong@amazon.com>
…vedFieldType (opensearch-project#12808)

Implementation for all supported types and DerivedFieldType. 

We support the following types so far:

boolean
date
geo_point
ip
keyword
long
double

---------

Signed-off-by: Rishabh Maurya <rishabhmaurya05@gmail.com>
…elated settings (opensearch-project#12838)

* Add RemoteStoreSettings class to handle remote store related settings
---------
Signed-off-by: Sachin Kale <kalsac@amazon.com>
Co-authored-by: Sachin Kale <kalsac@amazon.com>
…arch requests (opensearch-project#12954)

Signed-off-by: Jay Deng <jayd0104@gmail.com>
…ry-hdfs (opensearch-project#12996)

* Bump commons-io:commons-io in /plugins/repository-hdfs

Bumps commons-io:commons-io from 2.15.1 to 2.16.0.

---
updated-dependencies:
- dependency-name: commons-io:commons-io
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Updating SHAs

Signed-off-by: dependabot[bot] <support@github.com>

* Update changelog

Signed-off-by: dependabot[bot] <support@github.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Constant keyword fields behave similarly to regular keyword fields, except that they are 
defined only in the index mapping, and all documents in the index appear to have the same 
value for the constant keyword field.

---------

Signed-off-by: Mohammad Hasnain <hasnain2808@gmail.com>
…eld (opensearch-project#12048)

The "exists" query on an object field would fail when a "search_as_you_type" field is nested under that object.

It would also fail for a text field with prefixes enabled nested under the object, or any other field with a 
"hidden" subfield.

---------

Signed-off-by: Mrudhul Guda <gm13@iitbbs.ac.in>
We need to update our PR template to suggest that people add things to
"unreleased 2.x" unless they definitely want to leave things for 3.0.

Signed-off-by: Michael Froh <froh@amazon.com>
…arch-project#12994)

* Memoize isOnRemoteNode in index settings and rename it as well
---------
Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>
…cation during Remote Store Migration (opensearch-project#12821)

Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
…project#12938)

* Add more identifiers to gradle-check job webhook payload

Signed-off-by: Rishabh Singh <sngri@amazon.com>

* Update .github/workflows/gradle-check.yml

Co-authored-by: Peter Nied <peternied@hotmail.com>
Signed-off-by: Rishabh Singh <rishabhksingh@gmail.com>

* Add more identifiers to gradle-check job webhook payload

Signed-off-by: Rishabh Singh <sngri@amazon.com>

---------

Signed-off-by: Rishabh Singh <sngri@amazon.com>
Signed-off-by: Rishabh Singh <rishabhksingh@gmail.com>
Co-authored-by: Peter Nied <peternied@hotmail.com>
…-project#12569)

Adds a DerivedFieldMapper to support the Derived Fields feature enhancement as well as updating the mapper parsing logic to recognize and currently parse derived fields in the mappings.

---------

Signed-off-by: Mohammad Qureshi <qreshi@amazon.com>
Signed-off-by: Rishabh Maurya <rishabhmaurya05@gmail.com>
Co-authored-by: Rishabh Maurya <rishabhmaurya05@gmail.com>
…ttachment (opensearch-project#12998)

* Bump commons-io:commons-io in /plugins/ingest-attachment

Bumps commons-io:commons-io from 2.15.1 to 2.16.0.

---
updated-dependencies:
- dependency-name: commons-io:commons-io
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Updating SHAs

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
…y-azure-classic (opensearch-project#12999)

* Bump commons-io:commons-io in /plugins/discovery-azure-classic

Bumps commons-io:commons-io from 2.15.1 to 2.16.0.

---
updated-dependencies:
- dependency-name: commons-io:commons-io
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Updating SHAs

Signed-off-by: dependabot[bot] <support@github.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
…mic setting (opensearch-project#12704)

Signed-off-by: Sachin Kale <kalsac@amazon.com>
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408 shiv0408 requested a review from soosinha April 8, 2024 08:14
@shiv0408 shiv0408 closed this Apr 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.