All notable changes to this project are documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning. See the CONTRIBUTING guide for instructions on how to add changelog entries.
- [Admission control] Add Resource usage collector service and resource usage tracker (#10695)
- [Admission control] Add enhancements to FS stats to include read/write time, queue size and IO time (#10696)
- [Remote cluster state] Change file names for remote cluster state (#10557)
- [Search Pipelines] Add request-scoped state shared between processors (and three new processors) (#9405)
- Per request phase latency (#10351)
- [Remote Store] Add repository stats for remote store(#10567)
- [Remote cluster state] Upload global metadata in cluster state to remote store(#10404)
- [Remote cluster state] Download functionality of global metadata from remote store (#10535)
- [Remote cluster state] Restore global metadata from remote store when local state is lost after quorum loss (#10404)
- [Remote cluster state] Make index and global metadata upload timeout dynamic cluster settings (#10814)
- Add search query categorizor (#10255)
- Per request phase latency (#10351)
- Add cluster state stats (#10670)
- [Remote cluster state] Restore cluster state version during remote state auto restore (#10853)
- Update the indexRandom function to create more segments for concurrent search tests (10247)
- Add support for query profiler with concurrent aggregation (#9248)
- Introduce ConcurrentQueryProfiler to profile query using concurrent segment search path and support concurrency during rewrite and create weight (10352)
- Implement on behalf of token passing for extensions (#8679)
- Provide service accounts tokens to extensions (#9618)
- [Streaming Indexing] Introduce new experimental server HTTP transport based on Netty 4 and Project Reactor (Reactor Netty) (#9672)
- Add back half_float BKD based sort query optimization (#11024)
- Request level coordinator slow logs (#11246)
- Add template snippets support for field and target_field in KV ingest processor (#10040)
- Allowing pipeline processors to access index mapping info by passing ingest service ref as part of the processor factory parameters (#10307)
- Make number of segment metadata files in remote segment store configurable (#11329)
- Allow changing number of replicas of searchable snapshot index (#11317)
- [BWC and API enforcement] Introduce checks for enforcing the API restrictions (#11175)
- Maintainer approval check (#11378)
- Create separate transport action for render search template action (#11170)
- Add additional handling in SearchTemplateRequest when simulate is set to true (#11591)
- Introduce cluster level setting
cluster.index.restrict.replication.type
to prevent replication type setting override during index creations(#11583) - Add match_only_text field that is optimized for storage by trading off positional queries performance (#6836)
- Derived fields support to derive field values at query time without indexing (#12569)
- Bumps jetty version to 9.4.52.v20230823 to fix GMS-2023-1857 (#9822)
- Bump
netty
from 4.1.99.Final to 4.1.100.Final (#10564) - Bump Lucene from 9.7.0 to 9.8.0 (10276)
- Bump
commons-io:commons-io
from 2.13.0 to 2.15.1 (#10294, #11001, #11002, #11446, #11554, #11560) - Bump
com.google.api.grpc:proto-google-common-protos
from 2.25.0 to 2.25.1 (#10298) - Bump
com.netflix.nebula.ospackage-base
from 11.4.0 to 11.6.0 (#10295, #11630) - Bump
de.thetaphi:forbiddenapis
from 3.5.1 to 3.6 (#10508) - Bump OpenTelemetry from 1.30.1 to 1.31.0 (#10617)
- Bump
org.codehaus.woodstox:stax2-api
from 4.2.1 to 4.2.2 (#10639) - Bump
org.bouncycastle:bc-fips
from 1.0.2.3 to 1.0.2.4 (#10297) - Bump
org.apache.logging.log4j:log4j-core
from 2.20.0 to 2.21.1 (#10858, #11000) - Bump
com.squareup.okio:okio
from 3.5.0 to 3.7.0 (#10637, #11632) - Bump
org.apache.logging.log4j:log4j-core
from 2.20.0 to 2.22.1 (#10858, #11000, #11270, #11695) - Bump
aws-actions/configure-aws-credentials
from 2 to 4 (#10504) - Bump
stefanzweifel/git-auto-commit-action
from 4 to 5 (#11171) - Bump
jackson
andjackson_databind
from 2.15.2 to 2.16.0 (#11273) - Bump
netty
from 4.1.100.Final to 4.1.101.Final (#11294) - Bump
com.avast.gradle:gradle-docker-compose-plugin
from 0.16.12 to 0.17.6 (#10163, #11692) - Bump OpenTelemetry from 1.31.0 to 1.32.0 and OpenTelemetry Semconv from 1.21.0-alpha to 1.23.1-alpha (#11305)
- Bump
com.squareup.okhttp3:okhttp
from 4.11.0 to 4.12.0 (#10861) - Bump
org.apache.commons:commons-text
from 1.10.0 to 1.11.0 (#11344) - Bump
reactor-netty-core
from 1.1.12 to 1.1.13 (#11350) - Bump
com.gradle.enterprise
from 3.14.1 to 3.16.1 (#11339, #11629) - Bump
actions/setup-java
from 3 to 4 (#11447) - Bump
org.apache.xmlbeans:xmlbeans
from 5.1.1 to 5.2.0 (#11448) - Bump
org.apache.maven:maven-model
from 3.9.4 to 3.9.6 (#11445) - Bump
commons-net:commons-net
from 3.9.0 to 3.10.0 (#11450) - Bump
org.apache.zookeeper:zookeeper
from 3.9.0 to 3.9.1 (#10506) - Bump
org.wiremock:wiremock-standalone
from 3.1.0 to 3.3.1 (#11555) - Bump
org.apache.commons:commons-compress
from 1.24.0 to 1.25.0 (#11556) - Bump
com.maxmind.db:maxmind-db
from 3.0.0 to 3.1.0 (#11693) - Bump
com.netflix.nebula:nebula-publishing-plugin
from 20.3.0 to 21.0.0 (#11671)
- Force merge with
only_expunge_deletes
honors max segment size (#10036) - Add the means to extract the contextual properties from HttpChannel, TcpCChannel and TrasportChannel without excessive typecasting (#10562)
- Backport the PR #9107 for updating CONCURRENT_SEGMENT_SEARCH_TARGET_MAX_SLICE_COUNT_KEY setting to a dynamic setting (#10606)
- Search pipelines now support asynchronous request and response processors to avoid blocking on a transport thread (#10598)
- [Remote Store] Add Remote Store backpressure rejection stats to
_nodes/stats
(#10524) - [BUG] Fix java.lang.SecurityException in repository-gcs plugin (#10642)
- Add telemetry tracer/metric enable flag and integ test. (#10395)
- Performance improvement for Datetime field caching (#4558)
- Add instrumentation for indexing in transport bulk action and transport shard bulk action. (#10273)
- Disallow removing some metadata fields by remove ingest processor (#10895, #11607)
- Performance improvement for MultiTerm Queries on Keyword fields (#7057)
- Refactor common parts from the Rounding class into a separate 'round' package (#11023)
- Performance improvement for date histogram aggregations without sub-aggregations (#11083)
- Disable concurrent aggs for Diversified Sampler and Sampler aggs (#11087)
- Made leader/follower check timeout setting dynamic (#10528)
- Change error message when per shard document limit is breached (#11312)
- Improve boolean parsing performance (#11308)
- Interpret byte array as primitive using VarHandles (#11362)
- Automatically add scheme to discovery.ec2.endpoint (#11512)
- Restore support for Java 8 for RestClient (#11562)
- Switched to more reliable OpenSearch Lucene snapshot location(#11728)
- Remove deprecated classes for Rounding (#10956)
- Fix class_cast_exception when passing int to _version and other metadata fields in ingest simulate API (#10101)
- Fix passing wrong parameter when calling newConfigurationException() in DotExpanderProcessor (#10737)
- Delegating CachingWeightWrapper#count to internal weight object (#10543)
- Fix per request latency last phase not tracked (#10934)
- Fix SuggestSearch.testSkipDuplicates by forcing refresh when indexing its test documents (#11068)
- [BUG] Fix the thread context that is not properly cleared and messes up the traces (#10873)
- Handle canMatchSearchAfter for frozen context scenario (#11249)
- Fix the issue with DefaultSpanScope restoring wrong span in the TracerContextStorage upon detach (#11316)
- Remove shadowJar from
lang-painless
module publication (#11369) - Fix remote shards balancer and remove unused variables (#11167)
- Fix bug where replication lag grows post primary relocation (#11238)
- Fix for stuck update action in a bulk with
retry_on_conflict
property (#11152) - Fix template setting override for replication type (#11417)
- Fix Automatic addition of protocol broken in #11512 (#11609)
- Fix issue when calling Delete PIT endpoint and no PITs exist (#11711)