Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

2.17 #1245

Closed
wants to merge 154 commits into from
Closed

2.17 #1245

wants to merge 154 commits into from

Conversation

vikasvb90
Copy link
Collaborator

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

opensearch-trigger-bot bot and others added 30 commits July 21, 2022 10:38
…situations (opensearch-project#419) (opensearch-project#421)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 76de976)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…search-project#418) (opensearch-project#427)

Signed-off-by: Mike Lee <mlee@dataminr.com>
(cherry picked from commit 8b476ca)
Signed-off-by: Clay Downs <89109232+downsrob@users.noreply.github.com>

Co-authored-by: linuxboyng <109381671+linuxboyng@users.noreply.github.com>
…ensearch-project#439) (opensearch-project#442)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 1f581dd)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
…ensearch-project#435) (opensearch-project#444)

* added support for mustache scripting of rollup.target_index field

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* defekt fixes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* tests

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* small refactor/improvements

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added wildcard check when creating rollup job; removed resolving targetIndex on Rollup init; added test for wildcards

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* lint fixes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* moved target_index validation in getRollup resp handler

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added using toMap()

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* removed catch block

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* exception fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* linter fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed IT fail

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added Exception catch block

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit e858ab2)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…opensearch-project#440) (opensearch-project#447)

* added support for searching multiple rollup indices with same mapping

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed failing rollupInterceptorIT  test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted old error messages

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted checking for matching jobs on whole set instead of job by job; Added picking rollup job deterministic

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

* fixed sorting

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

Co-authored-by: petar.dzepina <petar.dzepina@dev22.rs>
(cherry picked from commit b8a77d4)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
* Add 2.2 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Add 2.2 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>
)

* added support for searching multiple rollup indices with same mapping

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed failing rollupInterceptorIT  test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted old error messages

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted checking for matching jobs on whole set instead of job by job; Added picking rollup job deterministic

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

* fixed sorting

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

* added ITs for multi rollup index search

Signed-off-by: petardz <petar.dzepina@gmail.com>

* added ITs for multi rollup index search#2

Signed-off-by: petardz <petar.dzepina@gmail.com>

* detekt fixes

Signed-off-by: petardz <petar.dzepina@gmail.com>

* changed index names and rollup job

Signed-off-by: petardz <petar.dzepina@gmail.com>

* detekt fix

Signed-off-by: petardz <petar.dzepina@gmail.com>

* empty commit to trigger test pipeline

Signed-off-by: petardz <petar.dzepina@gmail.com>

Co-authored-by: petar.dzepina <petar.dzepina@dev22.rs>
(cherry picked from commit af5b366)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…ensearch-project#468)

* Version increment automation

Signed-off-by: pgodithi <pgodithi@amazon.com>

* Version increment automation: task rename updateVersion

Signed-off-by: pgodithi <pgodithi@amazon.com>
(cherry picked from commit 0f0ba16)
Signed-off-by: prudhvigodithi <pgodithi@amazon.com>

Signed-off-by: pgodithi <pgodithi@amazon.com>
Signed-off-by: prudhvigodithi <pgodithi@amazon.com>
Co-authored-by: Prudhvi Godithi <pgodithi@amazon.com>
…pensearch-project#429) (opensearch-project#463)

* bump version to 2.2 (opensearch-project#446)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>

* Replica Count validation when awareness replica balance is enabled

Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>

* Addressing PR comments

Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
(cherry picked from commit f64c0c7)

Co-authored-by: Gaurav Bafna <85113518+gbbafna@users.noreply.github.com>
opensearch-project#485) (opensearch-project#486)

* 483: Updated detekt plugin and snakeyaml dependency. Updated a code to reduce the number of issues after static analysis

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 483: Updated snakeyaml version to use the latest

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit ed6ed10)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
opensearch-project#461) (opensearch-project#464)

Signed-off-by: Khushboo Rajput <khushbr@amazon.com>

Signed-off-by: Khushboo Rajput <khushbr@amazon.com>
(cherry picked from commit 2f7d009)

Co-authored-by: Khushboo Rajput <59671881+khushbr@users.noreply.github.com>
…nsearch-project#487)

* Transform maxclauses fix (opensearch-project#477)

* transform maxClauses fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added bucket log to track processed buckets

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* various renames/changes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed detekt issues

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added comments to test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* removed debug logging

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* empty commit to trigger checks

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reduced pageSize to 1 in few ITs to avoid flaky tests; fixed bug where pagesProcessed was calculated incorrectly

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted pagesProcessed change; fixed few ITs

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 7475cfd)

* Update TransformRunnerIT.kt

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…earch-project#471) (opensearch-project#488)

(opensearch-project#107)

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>
(cherry picked from commit 39be4e3)

Co-authored-by: xluo-aws <109580118+xluo-aws@users.noreply.github.com>
…h-project#500)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit 50ac1e9)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
…roject#502)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit a9d04ec)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
* Increment version to 2.3.0-SNAPSHOT

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>

* bump mockito-core to 4.7.0, httpcore to 4.4.15

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

Signed-off-by: Angie Zhang <langelzh@amazon.com>
…ect#528) (opensearch-project#529)

* Revert Disable detekt: 50ac1e9

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Remove force choosing snakeyml 1.31

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Force snakeyaml 1.32

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Empty commit

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
(cherry picked from commit 943c32b)

Co-authored-by: Siddhant Deshmukh <deshsid@amazon.com>
opensearch-project#490) (opensearch-project#504)

* 64: Added rounding when using aggreagate script for avg metric. Added unit tests for checking average aggregations against the target rollup index

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 64: Rollup job renamed

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 64: Removed unrelevant metrics for the avg calculation test

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit fadc553)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
…ensearch-project#539)

* [207]: Added 5 min scheduled job for sweeping ISM plugin version in the case of version discrepancy

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* [207]: Created pluginVersionSweepCoordinator component responsible for scheduling the skip execution task. Annotated tests in order to prevent thread leak error during integrational tests

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* [207]: Increased retry period for background job that sets the skip flag up to 5 mins

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Empty-Commit

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
Co-authored-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 4d844fa)

Co-authored-by: Clay Downs <downsrob@amazon.com>
…-project#547)

* flaky transform test fix attempt

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>

* accidental paste fix

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>
Co-authored-by: Petar Dzepina <petar.dzepina@vroom.com>
(cherry picked from commit 5217af0)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…#559)

* Update jackson to 2.13.4

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Get jackson version from core

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
(cherry picked from commit fe8bf44)

Co-authored-by: Siddhant Deshmukh <deshsid@amazon.com>
…pensearch-project#558) (opensearch-project#568)

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit c908871)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
…h-project#572)

Signed-off-by: prudhvigodithi <pgodithi@amazon.com>

Signed-off-by: prudhvigodithi <pgodithi@amazon.com>
(cherry picked from commit 1dc713c)

Co-authored-by: Prudhvi Godithi <pgodithi@amazon.com>
…arch-project#574)

* 184: Code copied from Ravi's branch

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 184: Added security tests. Extended gradle file. Resolved 500 issue once opensearch status exception is raised

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 184: Refactored ISM rest test cases to consider forwarded client. Extended test cases and created reusable methods

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 184: Removed unused privileges

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 63984b2)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
…pensearch-project#576) (opensearch-project#580)

* 538: Adding timeout and retry to Transform '_search' API calls.
This code-fix also addresses the transform lock expiration.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 85cb1a5)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
) (opensearch-project#582)

The transform runner test completes the search in sub-millisecond, thus failing. This is specific to Ubuntu 17 & 11 distribution.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 1856295)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
…ch-project#586)

* added support for mustache scripting of rollup.target_index field (opensearch-project#435)
* tests
* small refactor/improvements
* added wildcard check when creating rollup job; removed resolving targetIndex on Rollup init; added test for wildcards
* lint fixes
* moved target_index validation in getRollup resp handler
* removed catch block
* fixed IT fail
* added Exception catch block

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 70cf4ea)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
opensearch-trigger-bot bot and others added 26 commits February 9, 2024 14:31
…ct#1105)

(cherry picked from commit 8530939)

Signed-off-by: Rohit Ashiwal <rashiwal@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…earch-project#1128)

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…nsearch-project#1138)

(cherry picked from commit a30e4b8)

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
…ct#1143)

* Add v2.13.0 Release Notes



* Correcting the filename and removing one extra line



* Adding documentation notes in release notes



---------


(cherry picked from commit 737659d)

Signed-off-by: Nishant Goel <nisgoel@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…ch-project#1147) (opensearch-project#1148)

(cherry picked from commit e5a13ff)

Signed-off-by: Craig Perkins <craig5008@gmail.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
…search-project#1166)

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
(cherry picked from commit 52f331f)

Signed-off-by: vikasvb90 <vikasvb@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
…h system index in integTests (opensearch-project#1222) (opensearch-project#1223)

* Use adminClient instead of client when interacting with system index in integTests (opensearch-project#1222)

(cherry picked from commit b7ddbb6)

* Switch to APPLICATION_JSON

Signed-off-by: Craig Perkins <craig5008@gmail.com>

---------

Signed-off-by: Craig Perkins <craig5008@gmail.com>
…h-project#1232)

* skipping execution based on cluster service (opensearch-project#1219)

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
(cherry picked from commit d6da55c)

* compile time fixes

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>

---------

Signed-off-by: Sarthak Aggarwal <sarthagg@amazon.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.