Skip to content

Update opensearchproject/opensearch Docker tag to v2.16.0

Renovate Bot requested to merge renovate/opensearchproject-opensearch-2.x into main

This MR contains the following updates:

Package Type Update Change
opensearchproject/opensearch final minor 2.13.0 -> 2.16.0

Release Notes

opensearch-project/OpenSearch (opensearchproject/opensearch)

v2.16.0

Compare Source

2024-07-24 Version 2.16.0 Release Notes

[2.16.0]

Added
  • Add fingerprint ingest processor (#​13724)
  • [Remote Store] Rate limiter for remote store low priority uploads (#​14374)
  • Apply the date histogram rewrite optimization to range aggregation (#​13865)
  • [Writable Warm] Add composite directory implementation and integrate it with FileCache (12782)
  • [Workload Management] Add QueryGroup schema (13669)
  • Add batching supported processor base type AbstractBatchingProcessor (#​14554)
  • Fix race condition while parsing derived fields from search definition (14445)
  • Add strict_allow_templates dynamic mapping option (#​14555)
  • Add allowlist setting for ingest-common and search-pipeline-common processors (#​14439)
  • [Workload Management] add queryGroupId header propagator across requests and nodes (#​14614)
  • Create SystemIndexRegistry with helper method matchesSystemIndex (#​14415)
  • Print reason why parent task was cancelled (#​14604)
  • Add matchesPluginSystemIndexPattern to SystemIndexRegistry (#​14750)
  • Add Plugin interface for loading application based configuration templates ((#​14659))
  • Refactor remote-routing-table service inline with remote state interfaces(#​14668)
  • Add shard-diff path to diff manifest to reduce number of read calls remote store ((#​14684))
  • Add SortResponseProcessor to Search Pipelines ((#​14785))
  • Add prefix mode verification setting for repository verification ((#​14790))
  • Add SplitResponseProcessor to Search Pipelines ((#​14800))
  • Optimize TransportNodesAction to not send DiscoveryNodes for NodeStats, NodesInfo and ClusterStats call (14749)
  • Reduce logging in DEBUG for MasterService:run (#​14795)
  • Refactor remote-routing-table service inline with remote state interfaces(#​14668)
  • Add rest, transport layer changes for hot to warm tiering - dedicated setup ((#​13980)
  • Enabling term version check on local state for all ClusterManager Read Transport Actions (#​14273)
  • Optimize Cluster Stats Indices to precomute node level stats (#​14426)
  • Create listener to refresh search thread resource usage (#​14832)
  • Add logic to create index templates (v2) using context field (#​14811)
Dependencies
  • Update to Apache Lucene 9.11.1 (#​14042, #​14576)
  • Bump netty from 4.1.110.Final to 4.1.111.Final (#​14356)
  • Bump org.wiremock:wiremock-standalone from 3.3.1 to 3.6.0 (#​14361)
  • Bump reactor from 3.5.17 to 3.5.19 (#​14395, #​14697)
  • Bump reactor-netty from 1.1.19 to 1.1.21 (#​14395, #​14697)
  • Bump commons-net:commons-net from 3.10.0 to 3.11.1 (#​14396)
  • Bump com.nimbusds:nimbus-jose-jwt from 9.37.3 to 9.40 (#​14398)
  • Bump org.apache.commons:commons-configuration2 from 2.10.1 to 2.11.0 (#​14399)
  • Bump com.gradle.develocity from 3.17.4 to 3.17.5 (#​14397)
  • Bump opentelemetry from 1.36.0 to 1.40.0 (#​14457, #​14674)
  • Bump opentelemetry-semconv from 1.25.0-alpha to 1.26.0-alpha (#​14674)
  • Bump azure-identity from 1.11.4 to 1.13.0, Bump msal4j from 1.14.3 to 1.15.1, Bump msal4j-persistence-extension from 1.2.0 to 1.3.0 (#​14506)
  • Bump com.azure:azure-storage-common from 12.21.2 to 12.25.1 (#​14517)
  • Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 (#​14610)
  • Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 (#​14672)
  • Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 (#​14673)
  • Bump jackson from 2.17.1 to 2.17.2 (#​14687)
  • Bump net.minidev:json-smart from 2.5.0 to 2.5.1 (#​14748)
Changed
  • [Tiered Caching] Move query recomputation logic outside write lock (#​14187)
  • unsignedLongRangeQuery now returns MatchNoDocsQuery if the lower bounds are greater than the upper bounds (#​14416)
  • Make the class CommunityIdProcessor final (#​14448)
  • Updated the indices.query.bool.max_clause_count setting from being static to dynamically updateable (#​13568)
  • Allow @​InternalApi annotation on classes not meant to be constructed outside of the OpenSearch core (#​14575)
  • Add @​InternalApi annotation to japicmp exclusions (#​14597)
  • Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (#​14635)
  • Make reroute iteration time-bound for large shard allocations (#​14848)
Deprecated
  • Deprecate batch_size parameter on bulk API (#​14725)
Removed
  • Remove query categorization changes (#​14759)
Fixed
  • Fix bug in SBP cancellation logic (#​13259)
  • Fix handling of Short and Byte data types in ScriptProcessor ingest pipeline (#​14379)
  • Switch to iterative version of WKT format parser (#​14086)
  • Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes (#​10959)
  • Fix the computed max shards of cluster to avoid int overflow (#​14155)
  • Fixed rest-high-level client searchTemplate & mtermVectors endpoints to have a leading slash (#​14465)
  • Write shard level metadata blob when snapshotting searchable snapshot indexes (#​13190)
  • Fix aggs result of NestedAggregator with sub NestedAggregator (#​13324)
  • Fix fs info reporting negative available size (#​11573)
  • Add ListPitInfo::getKeepAlive() getter (#​14495)
  • Fix FuzzyQuery in keyword field will use IndexOrDocValuesQuery when both of index and doc_value are true (#​14378)
  • Fix file cache initialization (#​14004)
  • Handle NPE in GetResult if "found" field is missing (#​14552)
  • Fix create or update alias API doesn't throw exception for unsupported parameters (#​14719)
  • Refactoring FilterPath.parse by using an iterative approach (#​14200)
  • Refactoring Grok.validatePatternBank by using an iterative approach (#​14206)
  • Fix NPE when creating index with index.number_of_replicas set to null (#​14812)
  • Update help output for _cat (#​14722)
  • Fix bulk upsert ignores the default_pipeline and final_pipeline when auto-created index matches the index template (#​12891)
  • Fix NPE in ReplicaShardAllocator (#​14385)
  • Use circuit breaker in InternalHistogram when adding empty buckets (#​14754)
  • Create new IndexInput for multi part upload (#​14888)
  • Fix searchable snapshot failure with scripted fields (#​14411)
  • Fix the visit of inner query for NestedQueryBuilder (#​14739)
  • Fix constant_keyword field type used when creating index (#​14807)

v2.15.0

Compare Source

2024-06-12 Version 2.15.0 Release Notes

[2.15.0]

Added
  • Add leader and follower check failure counter metrics (#​12439)
  • Add latency metrics for instrumenting critical clusterManager code paths (#​12333)
  • Add support for Azure Managed Identity in repository-azure (#​12423)
  • Add useCompoundFile index setting (#​13478)
  • Make outbound side of transport protocol dependent (#​13293)
  • [Remote Store] Upload translog checkpoint as object metadata to translog.tlog(#​13637)
  • [Remote Store] Add dynamic cluster settings to set timeout for segments upload to Remote Store (#​13679)
  • Add getMetadataFields to MapperService (#​13819)
  • Add "wildcard" field type that supports efficient wildcard, prefix, and regexp queries (#​13461)
  • Allow setting query parameters on requests (#​13776)
  • Add dynamic action retry timeout setting (#​14022)
  • Add capability to disable source recovery_source for an index (#​13590)
  • Add remote routing table for remote state publication with experimental feature flag (#​13304)
  • Add upload flow for writing routing table to remote store (#​13870)
  • Add dynamic action retry timeout setting (#​14022)
  • [Remote Store] Add support to disable flush based on translog reader count (#​14027)
  • Add recovery chunk size setting (#​13997)
  • [Query Insights] Add exporter support for top n queries (#​12982)
  • [Query Insights] Add X-Opaque-Id to search request metadata for top n queries (#​13374)
  • [Streaming Indexing] Enhance RestAction with request / response streaming support (#​13772)
  • Move Remote Store Migration from DocRep to GA and modify remote migration settings name (#​14100)
  • [Remote State] Add async remote state deletion task running on an interval, configurable by a setting (#​13995)
  • Add remote routing table for remote state publication with experimental feature flag (#​13304)
  • Add support for query level resource usage tracking (#​13172)
  • [Query Insights] Add cpu and memory metrics to top n queries (#​13739)
  • Derived field object type support (#​13720)
  • Support Dynamic Pruning in Cardinality Aggregation (#​13821)
Dependencies
  • Bump com.github.spullara.mustache.java:compiler from 0.9.10 to 0.9.13 (#​13329, #​13559)
  • Bump org.apache.commons:commons-text from 1.11.0 to 1.12.0 (#​13557)
  • Bump org.hdrhistogram:HdrHistogram from 2.1.12 to 2.2.2 (#​13556, #​13986)
  • Bump com.gradle.enterprise from 3.17.2 to 3.17.4 (#​13641, #​13753)
  • Bump org.apache.hadoop:hadoop-minicluster from 3.3.6 to 3.4.0 (#​13642)
  • Bump mockito from 5.11.0 to 5.12.0 (#​13665)
  • Bump com.google.code.gson:gson from 2.10.1 to 2.11.0 (#​13752)
  • Bump ch.qos.logback:logback-core from 1.5.3 to 1.5.6 (#​13756)
  • Bump netty from 4.1.109.Final to 4.1.110.Final (#​13802)
  • Bump jackson from 2.17.0 to 2.17.1 (#​13817)
  • Bump reactor from 3.5.15 to 3.5.17 (#​13825)
  • Bump reactor-netty from 1.1.17 to 1.1.19 (#​13825)
  • Bump commons-cli:commons-cli from 1.7.0 to 1.8.0 (#​13840)
  • Bump org.apache.xmlbeans:xmlbeans from 5.2.0 to 5.2.1 (#​13839)
  • Bump actions/checkout from 3 to 4 (#​13935)
  • Bump com.netflix.nebula.ospackage-base from 11.9.0 to 11.9.1 (#​13933)
  • Bump com.azure:azure-core-http-netty from 1.12.8 to 1.15.1 (#​14128)
  • Bump tim-actions/get-pr-commits from 1.1.0 to 1.3.1 (#​14126)
Changed
  • Add ability for Boolean and date field queries to run when only doc_values are enabled (#​11650)
  • Refactor implementations of query phase searcher, allow QueryCollectorContext to have zero collectors (#​13481)
  • Adds support to inject telemetry instances to plugins (#​13636)
  • Adds support to provide tags with value in Gauge metric. (#​13994)
  • Move cache removal notifications outside lru lock (#​14017)
Removed
  • Remove handling of index.mapper.dynamic in AutoCreateIndex(#​13067)
Fixed
  • Fix get field mapping API returns 404 error in mixed cluster with multiple versions (#​13624)
  • Allow clearing remote_store.compatibility_mode setting (#​13646)
  • Painless: ensure type "UnmodifiableMap" for params (#​13885)
  • Don't return negative scores from multi_match query with cross_fields type (#​13829)
  • Pass parent filter to inner hit query (#​13903)
  • Fix NPE on restore searchable snapshot (#​13911)
  • Fix double invocation of postCollection when MultiBucketCollector is present (#​14015)
  • Fix ReplicaShardBatchAllocator to batch shards without duplicates (#​13710)
  • Java high-level REST client bulk() is not respecting the bulkRequest.requireAlias(true) method call (#​14146)
  • Fix ShardNotFoundException during request cache clean up (#​14219)
  • Fix the rewrite method for MatchOnlyText field query (#​14248)
  • Fix Concurrent Modification Exception in Indices Request Cache(#​14032)

v2.14.0

Compare Source

2024-05-07 Version 2.14.0 Release Notes

[2.14.0]

Added
  • Add explicit dependency to validatePom and generatePom tasks (#​12909)
  • Constant Keyword Field (#​12285)
  • [Concurrent Segment Search] Perform buildAggregation concurrently and support Composite Aggregations (#​12697)
  • Convert ingest processor supports ip type (#​12818)
  • Allow setting KEYSTORE_PASSWORD through env variable (#​12865)
  • Add a counter to node stat (and _cat/shards) api to track shard going from idle to non-idle (#​12768)
  • [Concurrent Segment Search] Disable concurrent segment search for system indices and throttled requests (#​12954)
  • Rename ingest processor supports overriding target field if exists (#​12990)
  • [Tiered Caching] Make took time caching policy setting dynamic (#​13063)
  • Detect breaking changes on pull requests (#​9044)
  • Add cluster primary balance contraint for rebalancing with buffer (#​12656)
  • [Remote Store] Make translog transfer timeout configurable (#​12704)
  • Derived fields support to derive field values at query time without indexing (#​12569)
  • Add support for more than one protocol for transport (#​12967)
  • [Tiered Caching] Add dimension-based stats to ICache implementations. (#​12531)
  • Add changes for overriding remote store and replication settings during snapshot restore. (#​11868)
  • Reject Resize index requests (i.e, split, shrink and clone), While DocRep to SegRep migration is in progress.(#​12686)
  • Add an individual setting of rate limiter for segment replication (#​12959)
  • [Tiered Caching] Add dimension-based stats to TieredSpilloverCache (#​13236)
  • [Tiered Caching] Expose new cache stats API (#​13237)
  • [Streaming Indexing] Ensure support of the new transport by security plugin (#​13174)
  • Add cluster setting to dynamically configure the buckets for filter rewrite optimization. (#​13179)
  • [Tiered caching] Make Indices Request Cache Stale Key Mgmt Threshold setting dynamic (#​12941)
  • Make search query counters dynamic to support all query types (#​12601)
  • [Tiered Caching] Gate new stats logic behind FeatureFlags.PLUGGABLE_CACHE (#​13238)
  • [Tiered Caching] Add a dynamic setting to disable/enable disk cache. (#​13373)
  • Batch mode for async fetching shard information in GatewayAllocator for unassigned shards (#​8746)
  • [Remote Store] Add settings for remote path type and hash algorithm (#​13225)
  • [Remote Store] Upload remote paths during remote enabled index creation (#​13386)
  • [Search Pipeline] Handle default pipeline for multiple indices (#​13276)
  • [Batch Ingestion] Add batch_size to _bulk API. (#​12457)
  • [Remote Store] Add capability of doing refresh as determined by the translog (#​12992)
  • Support multi ranges traversal when doing date histogram rewrite optimization. (#​13317)
Dependencies
  • Bump org.apache.commons:commons-configuration2 from 2.10.0 to 2.10.1 (#​12896)
  • Bump asm from 9.6 to 9.7 (#​12908)
  • Bump net.minidev:json-smart from 2.5.0 to 2.5.1 (#​12893, #​13117)
  • Bump netty from 4.1.107.Final to 4.1.109.Final (#​12924, #​13233)
  • Bump commons-io:commons-io from 2.15.1 to 2.16.0 (#​12996, #​12998, #​12999)
  • Bump org.apache.commons:commons-compress from 1.24.0 to 1.26.1 (#​12627)
  • Bump org.apache.commons:commonscodec from 1.15 to 1.16.1 (#​12627)
  • Bump org.apache.commons:commonslang from 3.13.0 to 3.14.0 (#​12627)
  • Bump Apache Tika from 2.6.0 to 2.9.2 (#​12627)
  • Bump com.gradle.enterprise from 3.16.2 to 3.17.2 (#​13116, #​13191, #​13327)
  • Bump gradle/wrapper-validation-action from 2 to 3 (#​13192)
  • Bump joda from 2.12.2 to 2.12.7 (#​13193)
  • Bump bouncycastle from 1.77 to 1.78 (#​13243)
  • Update google dependencies in repository-gcs and discovery-gce (#​13213)
  • Bump com.google.apis:google-api-services-compute from v1-rev235-1.25.0 to v1-rev20240407-2.0.0 (#​13333)
  • Bump com.github.spullara.mustache.java:compiler from 0.9.10 to 0.9.11 (#​13329)
  • Bump commons-cli:commons-cli from 1.6.0 to 1.7.0 (#​13331)
  • Bump jakarta.enterprise:jakarta.enterprise.cdi-api from 4.0.1 to 4.1.0 (#​13328)
  • Bump com.google.api.grpc:proto-google-iam-v1 from 0.12.0 to 1.33.0 (#​13332)
  • Bump com.squareup.okio:okio from 3.8.0 to 3.9.0 (#​12997)
  • OpenJDK Update (April 2024 Patch releases), update to Eclipse Temurin 21.0.3+9 (#​13389)
  • Bump org.bouncycastle:bc-fips from 1.0.2.4 to 1.0.2.5 (#​13446)
  • Bump lycheeverse/lychee-action from 1.9.3 to 1.10.0 (#​13447)
  • Bump com.netflix.nebula.ospackage-base from 11.8.1 to 11.9.0 (#​13440)
Changed
  • [BWC and API enforcement] Enforcing the presence of API annotations at build time (#​12872)
  • Improve built-in secure transports support (#​12907)
  • Update links to documentation in rest-api-spec (#​13043)
  • Ignoring unavailable shards during search request execution with ignore_available parameter (#​13298)
  • Refactoring globMatch using simpleMatchWithNormalizedStrings from Regex (#​13104)
  • [BWC and API enforcement] Reconsider the breaking changes check policy to detect breaking changes against released versions (#​13292)
  • Switch to macos-13 runner for precommit and assemble github actions due to macos-latest is now arm64 (#​13412)
  • [Revert] Prevent unnecessary fetch sub phase processor initialization during fetch phase execution (#​12503)
Fixed
  • Fix bulk API ignores ingest pipeline for upsert (#​12883)
  • Fix issue with feature flags where default value may not be honored (#​12849)
  • Fix UOE While building Exists query for nested search_as_you_type field (#​12048)
  • Enabled mockTelemetryPlugin for IT and fixed OOM issues (#​13054)
  • Fix from and size parameter can be negative when searching (#​13047)
  • Fix implement mark() and markSupported() in class FilterStreamInput (#​13098)
  • Fix IndicesRequestCache Stale calculation (#​13070]
  • Fix snapshot _status API to return correct status for partial snapshots (#​12812)
  • Improve the error messages for _stats with closed indices (#​13012)
  • Ignore BaseRestHandler unconsumed content check as it's always consumed. (#​13290)
  • Fix mapper_parsing_exception when using flat_object fields with names longer than 11 characters (#​13259)
  • DATETIME_FORMATTER_CACHING_SETTING experimental feature should not default to 'true' (#​13532)
  • Fix negative RequestStats metric issue (#​13553)

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever MR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this MR and you won't be reminded about this update again.

  • If you want to rebase/retry this MR, check this box

This MR has been generated by Renovate Bot.

Edited by Renovate Bot

Merge request reports