Skip to content

Latest commit

 

History

History
154 lines (145 loc) · 20.2 KB

CHANGELOG.md

File metadata and controls

154 lines (145 loc) · 20.2 KB

CHANGELOG

All notable changes to this project are documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning. See the CONTRIBUTING guide for instructions on how to add changelog entries.

Unreleased 2.x

Added

  • [Admission control] Add Resource usage collector service and resource usage tracker (#10695)
  • [Admission control] Add enhancements to FS stats to include read/write time, queue size and IO time (#10696)
  • [Remote cluster state] Change file names for remote cluster state (#10557)
  • [Search Pipelines] Add request-scoped state shared between processors (and three new processors) (#9405)
  • Per request phase latency (#10351)
  • [Remote Store] Add repository stats for remote store(#10567)
  • [Remote cluster state] Upload global metadata in cluster state to remote store(#10404)
  • [Remote cluster state] Download functionality of global metadata from remote store (#10535)
  • [Remote cluster state] Restore global metadata from remote store when local state is lost after quorum loss (#10404)
  • [Remote cluster state] Make index and global metadata upload timeout dynamic cluster settings (#10814)
  • Add search query categorizor (#10255)
  • Per request phase latency (#10351)
  • Add cluster state stats (#10670)
  • Remove ingest processor supports excluding fields (#10967)
  • [Remote cluster state] Restore cluster state version during remote state auto restore (#10853)
  • Update the indexRandom function to create more segments for concurrent search tests (10247)
  • Add support for query profiler with concurrent aggregation (#9248)
  • Introduce ConcurrentQueryProfiler to profile query using concurrent segment search path and support concurrency during rewrite and create weight (10352)
  • Implement on behalf of token passing for extensions (#8679)
  • Provide service accounts tokens to extensions (#9618)
  • [Streaming Indexing] Introduce new experimental server HTTP transport based on Netty 4 and Project Reactor (Reactor Netty) (#9672)
  • Add back half_float BKD based sort query optimization (#11024)
  • Enable must_exist parameter for update aliases API (#11210)
  • Request level coordinator slow logs (#11246)
  • Add template snippets support for field and target_field in KV ingest processor (#10040)
  • Allowing pipeline processors to access index mapping info by passing ingest service ref as part of the processor factory parameters (#10307)
  • Add experimental SIMD implementation of B-tree to round down dates (#11194)
  • Make number of segment metadata files in remote segment store configurable (#11329)
  • Allow changing number of replicas of searchable snapshot index (#11317)
  • [BWC and API enforcement] Introduce checks for enforcing the API restrictions (#11175)
  • Maintainer approval check (#11378)
  • Create separate transport action for render search template action (#11170)
  • Add additional handling in SearchTemplateRequest when simulate is set to true (#11591)
  • Introduce cluster level setting cluster.index.restrict.replication.type to prevent replication type setting override during index creations(#11583)
  • Add match_only_text field that is optimized for storage by trading off positional queries performance (#6836)
  • Add copy ingest processor (#11870)
  • Introduce new feature flag "WRITEABLE_REMOTE_INDEX" to gate the writeable remote index functionality (#11717)
  • Bump OpenTelemetry from 1.32.0 to 1.34.1 (#11891)
  • Add org.opensearch.rest.MethodHandlers and RestController#getAllHandlers (11876)

Dependencies

  • Bumps jetty version to 9.4.52.v20230823 to fix GMS-2023-1857 (#9822)
  • Bump netty from 4.1.99.Final to 4.1.100.Final (#10564)
  • Bump Lucene from 9.7.0 to 9.8.0 (10276)
  • Bump commons-io:commons-io from 2.13.0 to 2.15.1 (#10294, #11001, #11002, #11446, #11554, #11560, #11796)
  • Bump com.google.api.grpc:proto-google-common-protos from 2.25.0 to 2.25.1 (#10298)
  • Bump com.netflix.nebula.ospackage-base from 11.4.0 to 11.6.0 (#10295, #11630)
  • Bump de.thetaphi:forbiddenapis from 3.5.1 to 3.6 (#10508)
  • Bump OpenTelemetry from 1.30.1 to 1.31.0 (#10617)
  • Bump org.codehaus.woodstox:stax2-api from 4.2.1 to 4.2.2 (#10639)
  • Bump org.bouncycastle:bc-fips from 1.0.2.3 to 1.0.2.4 (#10297)
  • Bump org.apache.logging.log4j:log4j-core from 2.20.0 to 2.21.1 (#10858, #11000)
  • Bump com.squareup.okio:okio from 3.5.0 to 3.7.0 (#10637, #11632)
  • Bump org.apache.logging.log4j:log4j-core from 2.20.0 to 2.22.1 (#10858, #11000, #11270, #11695)
  • Bump aws-actions/configure-aws-credentials from 2 to 4 (#10504)
  • Bump stefanzweifel/git-auto-commit-action from 4 to 5 (#11171)
  • Bump jackson and jackson_databind from 2.15.2 to 2.16.0 (#11273)
  • Bump netty from 4.1.100.Final to 4.1.104.Final (#11294, #11775)
  • Bump com.avast.gradle:gradle-docker-compose-plugin from 0.16.12 to 0.17.6 (#10163, #11692)
  • Bump OpenTelemetry from 1.31.0 to 1.32.0 and OpenTelemetry Semconv from 1.21.0-alpha to 1.23.1-alpha (#11305)
  • Bump com.squareup.okhttp3:okhttp from 4.11.0 to 4.12.0 (#10861)
  • Bump org.apache.commons:commons-text from 1.10.0 to 1.11.0 (#11344)
  • Bump reactor-netty-core from 1.1.12 to 1.1.13 (#11350)
  • Bump com.gradle.enterprise from 3.14.1 to 3.16.1 (#11339, #11629)
  • Bump actions/setup-java from 3 to 4 (#11447)
  • Bump org.apache.xmlbeans:xmlbeans from 5.1.1 to 5.2.0 (#11448)
  • Bump org.apache.maven:maven-model from 3.9.4 to 3.9.6 (#11445)
  • Bump commons-net:commons-net from 3.9.0 to 3.10.0 (#11450)
  • Bump org.apache.zookeeper:zookeeper from 3.9.0 to 3.9.1 (#10506)
  • Bump org.wiremock:wiremock-standalone from 3.1.0 to 3.3.1 (#11555)
  • Bump org.apache.commons:commons-compress from 1.24.0 to 1.25.0 (#11556)
  • Bump com.maxmind.db:maxmind-db from 3.0.0 to 3.1.0 (#11693)
  • Bump com.netflix.nebula:nebula-publishing-plugin from 20.3.0 to 21.0.0 (#11671)
  • Bump com.maxmind.geoip2:geoip2 from 4.1.0 to 4.2.0 (#11559)
  • Bump commons-cli:commons-cli from 1.5.0 to 1.6.0 (#10996)
  • Bump org.apache.commons:commons-lang3 from 3.13.0 to 3.14.0 (#11691)
  • Bump net.java.dev.jna:jna from 5.13.0 to 5.14.0 (#11798)
  • Bump lycheeverse/lychee-action from 1.8.0 to 1.9.1 (#11795, #11887)
  • Bump Lucene from 9.8.0 to 9.9.1 (#11421)
  • Bump com.networknt:json-schema-validator from 1.0.86 to 1.2.0 (#11886, #11963)
  • Bump com.google.api:gax-httpjson from 0.103.1 to 2.39.0 (#11794)
  • Bump com.google.oauth-client:google-oauth-client from 1.34.1 to 1.35.0 (#11960)
  • Bump com.diffplug.spotless from 6.23.2 to 6.24.0 (#11962)
  • Bump com.google.cloud:google-cloud-core from 2.5.10 to 2.30.0 (#11961)

Changed

  • Force merge with only_expunge_deletes honors max segment size (#10036)
  • Add the means to extract the contextual properties from HttpChannel, TcpCChannel and TrasportChannel without excessive typecasting (#10562), (#11751)
  • Backport the PR #9107 for updating CONCURRENT_SEGMENT_SEARCH_TARGET_MAX_SLICE_COUNT_KEY setting to a dynamic setting (#10606)
  • Search pipelines now support asynchronous request and response processors to avoid blocking on a transport thread (#10598)
  • [Remote Store] Add Remote Store backpressure rejection stats to _nodes/stats (#10524)
  • [BUG] Fix java.lang.SecurityException in repository-gcs plugin (#10642)
  • Add telemetry tracer/metric enable flag and integ test. (#10395)
  • Performance improvement for Datetime field caching (#4558)
  • Add instrumentation for indexing in transport bulk action and transport shard bulk action. (#10273)
  • Disallow removing some metadata fields by remove ingest processor (#10895, #11607)
  • Performance improvement for MultiTerm Queries on Keyword fields (#7057)
  • Refactor common parts from the Rounding class into a separate 'round' package (#11023)
  • Performance improvement for date histogram aggregations without sub-aggregations (#11083)
  • Disable concurrent aggs for Diversified Sampler and Sampler aggs (#11087)
  • Made leader/follower check timeout setting dynamic (#10528)
  • Improved performance of numeric exact-match queries (#11209)
  • Change error message when per shard document limit is breached (#11312)
  • Improve boolean parsing performance (#11308)
  • Interpret byte array as primitive using VarHandles (#11362)
  • Automatically add scheme to discovery.ec2.endpoint (#11512)
  • Restore support for Java 8 for RestClient (#11562)
  • Switched to more reliable OpenSearch Lucene snapshot location(#11728)
  • Add deleted doc count in _cat/shards (#11678)
  • Capture information for additional query types and aggregation types (#11582)
  • Use slice_size == shard_size heuristic in terms aggs for concurrent segment search and properly calculate the doc_count_error (#11732)
  • Ensure Jackson default maximums introduced in 2.16.0 do not conflict with OpenSearch settings (#11890)
  • Extract cluster management for integration tests into JUnit test rule out of OpenSearchIntegTestCase (#11877), (#12000)
  • Workaround for https://bugs.openjdk.org/browse/JDK-8323659 regression, introduced in JDK-21.0.2 (#11968)

Deprecated

Removed

  • Remove deprecated classes for Rounding (#10956)

Fixed

  • Fix failure in dissect ingest processor parsing empty brackets (#9225)
  • Fix class_cast_exception when passing int to _version and other metadata fields in ingest simulate API (#10101)
  • Fix passing wrong parameter when calling newConfigurationException() in DotExpanderProcessor (#10737)
  • Delegating CachingWeightWrapper#count to internal weight object (#10543)
  • Fix per request latency last phase not tracked (#10934)
  • Fix SuggestSearch.testSkipDuplicates by forcing refresh when indexing its test documents (#11068)
  • [BUG] Fix the thread context that is not properly cleared and messes up the traces (#10873)
  • Handle canMatchSearchAfter for frozen context scenario (#11249)
  • Fix the issue with DefaultSpanScope restoring wrong span in the TracerContextStorage upon detach (#11316)
  • Remove shadowJar from lang-painless module publication (#11369)
  • Fix remote shards balancer and remove unused variables (#11167)
  • Fix parsing of flat object fields with dots in keys (#11425)
  • Fix bug where replication lag grows post primary relocation (#11238)
  • Fix noop_update_total metric in indexing stats cannot be updated by bulk API (#11485,#11917)
  • Fix for stuck update action in a bulk with retry_on_conflict property (#11152)
  • Fix template setting override for replication type (#11417)
  • Fix Automatic addition of protocol broken in #11512 (#11609)
  • Fix issue when calling Delete PIT endpoint and no PITs exist (#11711)
  • Fix tracing context propagation for local transport instrumentation (#11490)
  • Fix parsing of single line comments in lang-painless (#11815)
  • Fix typo in API annotation check message (11836)
  • Fix memory leak issue in ReorganizingLongHash (#11953)

Security