Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue37 #854

Closed
wants to merge 79 commits into from
Closed

Issue37 #854

wants to merge 79 commits into from

Conversation

ronnaksaxena
Copy link
Contributor

Issue 37

Checking if the rollover step was a transient failure or not

CheckList:

  • [ x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

opensearch-trigger-bot bot and others added 30 commits July 21, 2022 10:38
…situations (opensearch-project#419) (opensearch-project#421)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 76de976)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…search-project#418) (opensearch-project#427)

Signed-off-by: Mike Lee <mlee@dataminr.com>
(cherry picked from commit 8b476ca)
Signed-off-by: Clay Downs <89109232+downsrob@users.noreply.github.com>

Co-authored-by: linuxboyng <109381671+linuxboyng@users.noreply.github.com>
…ensearch-project#439) (opensearch-project#442)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 1f581dd)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
…ensearch-project#435) (opensearch-project#444)

* added support for mustache scripting of rollup.target_index field

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* defekt fixes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* tests

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* small refactor/improvements

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added wildcard check when creating rollup job; removed resolving targetIndex on Rollup init; added test for wildcards

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* lint fixes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* moved target_index validation in getRollup resp handler

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added using toMap()

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* removed catch block

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* exception fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* linter fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed IT fail

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added Exception catch block

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit e858ab2)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…opensearch-project#440) (opensearch-project#447)

* added support for searching multiple rollup indices with same mapping

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed failing rollupInterceptorIT  test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted old error messages

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted checking for matching jobs on whole set instead of job by job; Added picking rollup job deterministic

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

* fixed sorting

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

Co-authored-by: petar.dzepina <petar.dzepina@dev22.rs>
(cherry picked from commit b8a77d4)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
* Add 2.2 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Add 2.2 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>
)

* added support for searching multiple rollup indices with same mapping

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed failing rollupInterceptorIT  test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted old error messages

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted checking for matching jobs on whole set instead of job by job; Added picking rollup job deterministic

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

* fixed sorting

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

* added ITs for multi rollup index search

Signed-off-by: petardz <petar.dzepina@gmail.com>

* added ITs for multi rollup index search#2

Signed-off-by: petardz <petar.dzepina@gmail.com>

* detekt fixes

Signed-off-by: petardz <petar.dzepina@gmail.com>

* changed index names and rollup job

Signed-off-by: petardz <petar.dzepina@gmail.com>

* detekt fix

Signed-off-by: petardz <petar.dzepina@gmail.com>

* empty commit to trigger test pipeline

Signed-off-by: petardz <petar.dzepina@gmail.com>

Co-authored-by: petar.dzepina <petar.dzepina@dev22.rs>
(cherry picked from commit af5b366)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…ensearch-project#468)

* Version increment automation

Signed-off-by: pgodithi <pgodithi@amazon.com>

* Version increment automation: task rename updateVersion

Signed-off-by: pgodithi <pgodithi@amazon.com>
(cherry picked from commit 0f0ba16)
Signed-off-by: prudhvigodithi <pgodithi@amazon.com>

Signed-off-by: pgodithi <pgodithi@amazon.com>
Signed-off-by: prudhvigodithi <pgodithi@amazon.com>
Co-authored-by: Prudhvi Godithi <pgodithi@amazon.com>
…pensearch-project#429) (opensearch-project#463)

* bump version to 2.2 (opensearch-project#446)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>

* Replica Count validation when awareness replica balance is enabled

Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>

* Addressing PR comments

Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
(cherry picked from commit f64c0c7)

Co-authored-by: Gaurav Bafna <85113518+gbbafna@users.noreply.github.com>
opensearch-project#485) (opensearch-project#486)

* 483: Updated detekt plugin and snakeyaml dependency. Updated a code to reduce the number of issues after static analysis

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 483: Updated snakeyaml version to use the latest

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit ed6ed10)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
opensearch-project#461) (opensearch-project#464)

Signed-off-by: Khushboo Rajput <khushbr@amazon.com>

Signed-off-by: Khushboo Rajput <khushbr@amazon.com>
(cherry picked from commit 2f7d009)

Co-authored-by: Khushboo Rajput <59671881+khushbr@users.noreply.github.com>
…nsearch-project#487)

* Transform maxclauses fix (opensearch-project#477)

* transform maxClauses fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added bucket log to track processed buckets

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* various renames/changes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed detekt issues

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added comments to test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* removed debug logging

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* empty commit to trigger checks

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reduced pageSize to 1 in few ITs to avoid flaky tests; fixed bug where pagesProcessed was calculated incorrectly

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted pagesProcessed change; fixed few ITs

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 7475cfd)

* Update TransformRunnerIT.kt

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…earch-project#471) (opensearch-project#488)

(opensearch-project#107)

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>
(cherry picked from commit 39be4e3)

Co-authored-by: xluo-aws <109580118+xluo-aws@users.noreply.github.com>
…h-project#500)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit 50ac1e9)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
…roject#502)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit a9d04ec)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
* Increment version to 2.3.0-SNAPSHOT

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>

* bump mockito-core to 4.7.0, httpcore to 4.4.15

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

Signed-off-by: Angie Zhang <langelzh@amazon.com>
…ect#528) (opensearch-project#529)

* Revert Disable detekt: 50ac1e9

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Remove force choosing snakeyml 1.31

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Force snakeyaml 1.32

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Empty commit

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
(cherry picked from commit 943c32b)

Co-authored-by: Siddhant Deshmukh <deshsid@amazon.com>
opensearch-project#490) (opensearch-project#504)

* 64: Added rounding when using aggreagate script for avg metric. Added unit tests for checking average aggregations against the target rollup index

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 64: Rollup job renamed

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 64: Removed unrelevant metrics for the avg calculation test

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit fadc553)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
…ensearch-project#539)

* [207]: Added 5 min scheduled job for sweeping ISM plugin version in the case of version discrepancy

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* [207]: Created pluginVersionSweepCoordinator component responsible for scheduling the skip execution task. Annotated tests in order to prevent thread leak error during integrational tests

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* [207]: Increased retry period for background job that sets the skip flag up to 5 mins

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Empty-Commit

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
Co-authored-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 4d844fa)

Co-authored-by: Clay Downs <downsrob@amazon.com>
…-project#547)

* flaky transform test fix attempt

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>

* accidental paste fix

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>
Co-authored-by: Petar Dzepina <petar.dzepina@vroom.com>
(cherry picked from commit 5217af0)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…#559)

* Update jackson to 2.13.4

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Get jackson version from core

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
(cherry picked from commit fe8bf44)

Co-authored-by: Siddhant Deshmukh <deshsid@amazon.com>
…pensearch-project#558) (opensearch-project#568)

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit c908871)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
…h-project#572)

Signed-off-by: prudhvigodithi <pgodithi@amazon.com>

Signed-off-by: prudhvigodithi <pgodithi@amazon.com>
(cherry picked from commit 1dc713c)

Co-authored-by: Prudhvi Godithi <pgodithi@amazon.com>
…arch-project#574)

* 184: Code copied from Ravi's branch

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 184: Added security tests. Extended gradle file. Resolved 500 issue once opensearch status exception is raised

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 184: Refactored ISM rest test cases to consider forwarded client. Extended test cases and created reusable methods

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 184: Removed unused privileges

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 63984b2)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
…pensearch-project#576) (opensearch-project#580)

* 538: Adding timeout and retry to Transform '_search' API calls.
This code-fix also addresses the transform lock expiration.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 85cb1a5)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
) (opensearch-project#582)

The transform runner test completes the search in sub-millisecond, thus failing. This is specific to Ubuntu 17 & 11 distribution.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 1856295)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
…ch-project#586)

* added support for mustache scripting of rollup.target_index field (opensearch-project#435)
* tests
* small refactor/improvements
* added wildcard check when creating rollup job; removed resolving targetIndex on Rollup init; added test for wildcards
* lint fixes
* moved target_index validation in getRollup resp handler
* removed catch block
* fixed IT fail
* added Exception catch block

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 70cf4ea)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
zhichao-aws and others added 17 commits May 25, 2023 17:29
opensearch-project#791)

* CRUD api for long running operation notification config (opensearch-project#722)

* notification crud api

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* changes based on comments; add tests

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* changes for comment

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* change behavior for get action index not exists, fix test cases

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix weak password for changes in security plugin

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

---------

Signed-off-by: zhichao-aws <zhichaog@amazon.com>
(cherry picked from commit 96f7380)

* fix test code apache http package version

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

---------

Signed-off-by: zhichao-aws <zhichaog@amazon.com>
…ct#793)

* Feature/index operation notification (opensearch-project#712)

* Feature/index operation notification (opensearch-project#707)

* task completion listener for long running task

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* task completion listener for long running task

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove unused import

Signed-off-by: Hailong Cui <ihailong@amazon.com>

---------

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* index action, no validation&test

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

get action. no validation&test

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

index and get action (draft)

changes for rebase main

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

index and get, no validation&test

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* refactor on package name

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* +delete, change index

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Implement notification with ActionFilter

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Query notification channel

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Notification message update

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* new version of crud

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* validate task id and action name; unitfy taskId

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Add unit test case

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* refactor on response parser

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* fix unit test case

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* modify code structure, change ID to Id

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add some test, delete message template

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Add integration test

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Add integration test for action listener

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove refresh policy in request

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add some tests, fix actionfilter refresh parameter

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Remove duplicate errors for reindex

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* add UT and IT

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix some code style

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* enable com.sun.net.httpserver.* for test

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* change index name, fix bug

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* modifications after meeting

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* don't continue wait for shard to be started for async mode

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* handle IndexNotFoundException for sending notification

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* add security test case

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add security test case

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* refactor on file names

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* add success/failure condition

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* filter channels by conditions

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Remove unused field enable for index .opensearch-admin-panel

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* add more integration testcase

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* change admin panel to control center

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Update mock server address to localhost for docker env

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove unused field in response

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* update integ test

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove default for all

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Remove default for all

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove filter by backend roles

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix build

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* optimize constructor code

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add request doc id validation

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* merge get and search

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* remove get before delete

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add node id validation

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* auto create doc for update

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix test case

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* delete restUpdateAction, fix test

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add dry run option

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix bug, add test case

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add xcontent tests

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* notification crud api

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* changes based on comments; add tests

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* changes for comment

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* change behavior for get action index not exists, fix test cases

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix merge

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* delay 5s for sending runtime notification

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* update log message

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* delay 5s for runtime notification policy

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Update notification message

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* filter duplicate channel

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* exception handling

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Add cluster name into title

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* fix UT for failure messagee

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* include cluster name into notification messag

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* fix UT failures

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* fix detekt issue

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* fix NPE

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* force merge message

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove duplicate error of reindex

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* notification message rewording

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* notification message wording change and unit test case

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* update block write wording

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Add more unit test case

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Add more logs

Signed-off-by: Hailong Cui <ihailong@amazon.com>

---------

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: zhichao-aws <zhichaog@amazon.com>
Co-authored-by: zhichao-aws <zhichaog@amazon.com>
(cherry picked from commit 89bd6de)

* Fix backport failure

Signed-off-by: Hailong Cui <ihailong@amazon.com>

---------

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
* Add 2.8 release notes

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>
(cherry picked from commit d921f0b)

Co-authored-by: Xuesong Luo <lxuesong@amazon.com>
opensearch-project#797)

* Use original PR numbers in 2.8 release notes.

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>

---------

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>
(cherry picked from commit 104c4b8)

Co-authored-by: Xuesong Luo <lxuesong@amazon.com>
* Support for system index interface

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Handle rejected execution exception as retryable in retry block

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Fix tests

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Fix tests

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
opensearch-project#803)

* 202: Added format property when specifying the date histogram

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 202: Added component responsible for building the target index mapping once the transform is being triggered.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 202: date_histogram considered in the case of the creating the target index for the date fields when transform is executed

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 202: Enabled target index date field mappings if those fields are used in aggregations or as a term aggregation for defining the buckets

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Updated code according to comments. Added targetIndexMapping when transform preview action is triggered

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Updated schema versions

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Addressed the comments

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Refactored transform tests related with aggregation based on a date field.
Updated transform preview action to consider target index mapping when using a date field. Kept formatting of the date field in target index.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* detekt fix

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Added zone in IT

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Added function for creating target index mapping that considers transform mapping json. Target date field mappings are generated after transform validation when running transform. Removed target index date field values formatting. emoved default format for date_histogram because of the rollup. Updated schema version in test.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

---------

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 42833b1)

Co-authored-by: Stevan Buzejic <buzejic.stevan@gmail.com>
…pensearch-project#811)

* Added myself to the repo.



* Added myself to the repo.



* Added maintainers to the repo.



* Update MAINTAINERS.md





* Update MAINTAINERS.md



---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Sayali Gaikawad <61760125+gaiksaya@users.noreply.github.com>
Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
* Metadata members from ImmutableOpenMap to j.u.Map

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* add field remoteStoreIndexShallowCopy in SM TestUtils (opensearch-project#825)

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix NPE for transform aggregations (opensearch-project#830)

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Fix detekt

Signed-off-by: Hailong Cui <ihailong@amazon.com>

---------

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: zhichao-aws <zhichaog@amazon.com>
Co-authored-by: zhichao-aws <zhichaog@amazon.com>
…project#831) (opensearch-project#842)

* fix LRON unwrap exception and some IT

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* remove useless log

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

---------

Signed-off-by: zhichao-aws <zhichaog@amazon.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
(cherry picked from commit f07fa2b)

Co-authored-by: zhichao-aws <zhichaog@amazon.com>
…arch-project#843)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
(cherry picked from commit 2a9bcd6)

Co-authored-by: Hailong Cui <ihailong@amazon.com>
…arch-project#847) (opensearch-project#848)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit 77e8fd0)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
…ch-project#786) (opensearch-project#845)

(cherry picked from commit 30e16d9)
Signed-off-by: Hailong Cui <ihailong@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

10 participants