…situations (opensearch-project#419) (opensearch-project#421)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 76de976)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>

…search-project#418) (opensearch-project#427)

Signed-off-by: Mike Lee <mlee@dataminr.com>
(cherry picked from commit 8b476ca)
Signed-off-by: Clay Downs <89109232+downsrob@users.noreply.github.com>

Co-authored-by: linuxboyng <109381671+linuxboyng@users.noreply.github.com>

…ensearch-project#439) (opensearch-project#442)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 1f581dd)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>

…ensearch-project#435) (opensearch-project#444)

* added support for mustache scripting of rollup.target_index field

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* defekt fixes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* tests

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* small refactor/improvements

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added wildcard check when creating rollup job; removed resolving targetIndex on Rollup init; added test for wildcards

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* lint fixes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* moved target_index validation in getRollup resp handler

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added using toMap()

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* removed catch block

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* exception fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* linter fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed IT fail

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added Exception catch block

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit e858ab2)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>

…opensearch-project#440) (opensearch-project#447)

* added support for searching multiple rollup indices with same mapping

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed failing rollupInterceptorIT  test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted old error messages

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted checking for matching jobs on whole set instead of job by job; Added picking rollup job deterministic

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

* fixed sorting

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

Co-authored-by: petar.dzepina <petar.dzepina@dev22.rs>
(cherry picked from commit b8a77d4)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>

* Add 2.2 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Add 2.2 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

)

* added support for searching multiple rollup indices with same mapping

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed failing rollupInterceptorIT  test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted old error messages

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted checking for matching jobs on whole set instead of job by job; Added picking rollup job deterministic

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

* fixed sorting

Signed-off-by: petar.dzepina <petar.dzepina@dev22.rs>

* added ITs for multi rollup index search

Signed-off-by: petardz <petar.dzepina@gmail.com>

* added ITs for multi rollup index search#2

Signed-off-by: petardz <petar.dzepina@gmail.com>

* detekt fixes

Signed-off-by: petardz <petar.dzepina@gmail.com>

* changed index names and rollup job

Signed-off-by: petardz <petar.dzepina@gmail.com>

* detekt fix

Signed-off-by: petardz <petar.dzepina@gmail.com>

* empty commit to trigger test pipeline

Signed-off-by: petardz <petar.dzepina@gmail.com>

Co-authored-by: petar.dzepina <petar.dzepina@dev22.rs>
(cherry picked from commit af5b366)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>

…ensearch-project#468)

* Version increment automation

Signed-off-by: pgodithi <pgodithi@amazon.com>

* Version increment automation: task rename updateVersion

Signed-off-by: pgodithi <pgodithi@amazon.com>
(cherry picked from commit 0f0ba16)
Signed-off-by: prudhvigodithi <pgodithi@amazon.com>

Signed-off-by: pgodithi <pgodithi@amazon.com>
Signed-off-by: prudhvigodithi <pgodithi@amazon.com>
Co-authored-by: Prudhvi Godithi <pgodithi@amazon.com>

…pensearch-project#429) (opensearch-project#463)

* bump version to 2.2 (opensearch-project#446)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>

* Replica Count validation when awareness replica balance is enabled

Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>

* Addressing PR comments

Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Gaurav Bafna <gbbafna@amazon.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
(cherry picked from commit f64c0c7)

Co-authored-by: Gaurav Bafna <85113518+gbbafna@users.noreply.github.com>

opensearch-project#485) (opensearch-project#486)

* 483: Updated detekt plugin and snakeyaml dependency. Updated a code to reduce the number of issues after static analysis

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 483: Updated snakeyaml version to use the latest

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit ed6ed10)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>

opensearch-project#461) (opensearch-project#464)

Signed-off-by: Khushboo Rajput <khushbr@amazon.com>

Signed-off-by: Khushboo Rajput <khushbr@amazon.com>
(cherry picked from commit 2f7d009)

Co-authored-by: Khushboo Rajput <59671881+khushbr@users.noreply.github.com>

…nsearch-project#487)

* Transform maxclauses fix (opensearch-project#477)

* transform maxClauses fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added bucket log to track processed buckets

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* various renames/changes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed detekt issues

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added comments to test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* removed debug logging

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* empty commit to trigger checks

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reduced pageSize to 1 in few ITs to avoid flaky tests; fixed bug where pagesProcessed was calculated incorrectly

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted pagesProcessed change; fixed few ITs

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 7475cfd)

* Update TransformRunnerIT.kt

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>

…earch-project#471) (opensearch-project#488)

(opensearch-project#107)

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>
(cherry picked from commit 39be4e3)

Co-authored-by: xluo-aws <109580118+xluo-aws@users.noreply.github.com>

…h-project#500)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit 50ac1e9)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

…roject#502)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit a9d04ec)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

* Increment version to 2.3.0-SNAPSHOT

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>

* bump mockito-core to 4.7.0, httpcore to 4.4.15

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update 2.3 release note

Signed-off-by: Angie Zhang <langelzh@amazon.com>

Signed-off-by: Angie Zhang <langelzh@amazon.com>

…ect#528) (opensearch-project#529)

* Revert Disable detekt: 50ac1e9

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Remove force choosing snakeyml 1.31

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Force snakeyaml 1.32

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Empty commit

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
(cherry picked from commit 943c32b)

Co-authored-by: Siddhant Deshmukh <deshsid@amazon.com>

opensearch-project#490) (opensearch-project#504)

* 64: Added rounding when using aggreagate script for avg metric. Added unit tests for checking average aggregations against the target rollup index

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 64: Rollup job renamed

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 64: Removed unrelevant metrics for the avg calculation test

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit fadc553)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>

…ensearch-project#539)

* [207]: Added 5 min scheduled job for sweeping ISM plugin version in the case of version discrepancy

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* [207]: Created pluginVersionSweepCoordinator component responsible for scheduling the skip execution task. Annotated tests in order to prevent thread leak error during integrational tests

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* [207]: Increased retry period for background job that sets the skip flag up to 5 mins

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Empty-Commit

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
Co-authored-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 4d844fa)

Co-authored-by: Clay Downs <downsrob@amazon.com>

…-project#547)

* flaky transform test fix attempt

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>

* accidental paste fix

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>
Co-authored-by: Petar Dzepina <petar.dzepina@vroom.com>
(cherry picked from commit 5217af0)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>

…#559)

* Update jackson to 2.13.4

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

* Get jackson version from core

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>

Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
(cherry picked from commit fe8bf44)

Co-authored-by: Siddhant Deshmukh <deshsid@amazon.com>

…pensearch-project#558) (opensearch-project#568)

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit c908871)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>

…h-project#572)

Signed-off-by: prudhvigodithi <pgodithi@amazon.com>

Signed-off-by: prudhvigodithi <pgodithi@amazon.com>
(cherry picked from commit 1dc713c)

Co-authored-by: Prudhvi Godithi <pgodithi@amazon.com>

…arch-project#574)

* 184: Code copied from Ravi's branch

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 184: Added security tests. Extended gradle file. Resolved 500 issue once opensearch status exception is raised

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 184: Refactored ISM rest test cases to consider forwarded client. Extended test cases and created reusable methods

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 184: Removed unused privileges

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 63984b2)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>

…pensearch-project#576) (opensearch-project#580)

* 538: Adding timeout and retry to Transform '_search' API calls.
This code-fix also addresses the transform lock expiration.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 85cb1a5)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>

) (opensearch-project#582)

The transform runner test completes the search in sub-millisecond, thus failing. This is specific to Ubuntu 17 & 11 distribution.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 1856295)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>

…ch-project#586)

* added support for mustache scripting of rollup.target_index field (opensearch-project#435)
* tests
* small refactor/improvements
* added wildcard check when creating rollup job; removed resolving targetIndex on Rollup init; added test for wildcards
* lint fixes
* moved target_index validation in getRollup resp handler
* removed catch block
* fixed IT fail
* added Exception catch block

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 70cf4ea)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>

…opensearch-project#589)

* Adds an alias action (opensearch-project#35)

Signed-off-by: Megha Goyal <goyamegh@amazon.com>

Co-authored-by: Megha Goyal <56077967+goyamegh@users.noreply.github.com>

…#591)

* Error prevention stage 1
* Removed recursion from Explain Action to avoid stackoverflow in some situations (opensearch-project#419)
* enabled by default integrated
* Fix Test cases
* Fix comments; set validation disabled by default
* Rename validation_service to action_validation; Fix some detekt issues

Signed-off-by: Joanne Wang <jowg@amazon.com>
Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
Signed-off-by: Angie Zhang <langelzh@amazon.com>

Co-authored-by: Joanne Wang <jowg@amazon.com>
Co-authored-by: Petar <petar.dzepina@gmail.com>
Co-authored-by: Angie Zhang <langelzh@amazon.com>

…ch-project#595) (opensearch-project#596)

Addresses the breaking change in the OS_2.4 AwarenessReplicaBalance.validate()

opensearch-project#593

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit 04fce19)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

…ensearch-project#601)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

* Fix all the compile warnings and detekt issues (opensearch-project#603)

* Fix all the compile warnings and detekt issues

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Fix time capture is 0

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Unify test clean logic (opensearch-project#609)

* Unify wipe indices logic after tests

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Enhance wipeAllIndices function

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Customize cleanup for multi node test

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Unify wipe indices logic after tests

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Enhance wipeAllIndices function

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* security workflow setup

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* add more settings

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Rewrite SecureRestClientBuilder

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* For now, use local cluster

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit f2a9fa6)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit 5d388f2)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

opensearch-project#654)

* added support for QueryStringQuery in rollups

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* detekt fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* compile fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* IT fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 3de566e)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>

* Add option for bwc tests in bundle level

Signed-off-by: Zelin Hao <zelinhao@amazon.com>

* Fix bug for security

Signed-off-by: Zelin Hao <zelinhao@amazon.com>

Signed-off-by: Zelin Hao <zelinhao@amazon.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit 76d530f)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

…#690) (opensearch-project#692)

* Added Publish snapshots to maven via GHA workflow

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Added Publish snapshots to maven via GHA workflow

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fixed CVE-2022-1471

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fixed review comments

Signed-off-by: Angie Zhang <langelzh@amazon.com>

---------

Signed-off-by: Angie Zhang <langelzh@amazon.com>
(cherry picked from commit 9cdcffd)

Co-authored-by: Angie Zhang <langelzh@amazon.com>

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
(cherry picked from commit ae0b6ae)

Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit 9ed4016)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

…a.util references (opensearch-project#717) (opensearch-project#719)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
(cherry picked from commit 8fe17c7)

Co-authored-by: Hailong Cui <ihailong@amazon.com>

…#721)

* Fixed xContent dependencies due to OSCore changes

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* 1.Bump version of 2.x to 2.7; 2.Update gradle.build; 3.Fix xContent dependencies change.

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Add bwcBundleTest back

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Add bwcBundleTest back

Signed-off-by: Angie Zhang <langelzh@amazon.com>

---------

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fixed issues of shrink action

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fixed node lock release error: request should use value of "_id" instead of "job_id"

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fix review comments

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fix build error

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Update getShrinkLockID

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Added debug logs for Shard Moving Decisions

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fix detekt error

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fix failed test cases due to renew lock error

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fix failed test cases due to lock job id error

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fix review comments

Signed-off-by: Angie Zhang <langelzh@amazon.com>

---------

Signed-off-by: Angie Zhang <langelzh@amazon.com>

Signed-off-by: Angie Zhang <langelzh@amazon.com>

Signed-off-by: Angie Zhang <langelzh@amazon.com>

…pensearch-project#747)

* Error Prevention: Add index priority action

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Error Prevention: Add index priority action

Signed-off-by: Angie Zhang <langelzh@amazon.com>

---------

Signed-off-by: Angie Zhang <langelzh@amazon.com>
(cherry picked from commit 30d3dfc)

Co-authored-by: Angie Zhang <langelzh@amazon.com>

…as validate nothing. (opensearch-project#732) (opensearch-project#748)

Signed-off-by: Angie Zhang <langelzh@amazon.com>
(cherry picked from commit f9d57b1)

Co-authored-by: Angie Zhang <langelzh@amazon.com>

…ch-project#749)

* Error Prevention: Add close action

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Error Prevention: Add close action

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Error Prevention: Add close action

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Error Prevention: Add close action

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fixed comments for close action validation.

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Added return false for validIndex method

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Updated test case name

Signed-off-by: Angie Zhang <langelzh@amazon.com>

---------

Signed-off-by: Angie Zhang <langelzh@amazon.com>
(cherry picked from commit 363086f)

Co-authored-by: Angie Zhang <langelzh@amazon.com>

…nsearch-project#751)

* Error Prevention: Add transition action

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fixed detekt

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Added return false

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Fixed detekt

Signed-off-by: Angie Zhang <langelzh@amazon.com>

---------

Signed-off-by: Angie Zhang <langelzh@amazon.com>
(cherry picked from commit 3cf8668)

Co-authored-by: Angie Zhang <langelzh@amazon.com>

…earch-project#752)

* Error Prevention: Add snapshot action

Signed-off-by: Angie Zhang <langelzh@amazon.com>

* Added return false

Signed-off-by: Angie Zhang <langelzh@amazon.com>

---------

Signed-off-by: Angie Zhang <langelzh@amazon.com>
(cherry picked from commit 76272ee)

Co-authored-by: Angie Zhang <langelzh@amazon.com>

…#756)

* Added 2.7 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

* Added 2.7 release notes.

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>

---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
(cherry picked from commit 19fc44b)

Co-authored-by: AWSHurneyt <hurneyt@amazon.com>

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>

* upgrade to gradle 8.1.1

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* upgrade gradle wrapper

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* Fix flaky test: test history shard settings

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

---------

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* initial commit

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* initial commit

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted pkgbuild.gradle

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* ec

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* rework

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* ec

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* ec

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* ec

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed tests

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* changed rollup id in test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

---------

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 7ed6299)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>

…ject#773) (opensearch-project#781)

* Rollup Interceptor sourceIndex NPE fix (opensearch-project#773)

* initial commit

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* detekt fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* few fixes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* detekt override

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* Added test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

---------

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 4c60abd)

* compile fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

---------

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

…rch-project#785)

* recursion removal from AddPolicy Action

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added test

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* debug logging

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* removed single node testcase

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* added security test; fixed index permission check

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* test fix

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* addressing comments

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* test cleanup

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* reverted security inject changes

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* fixed weak password error when creating test user

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

* test tweak

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

---------

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 45b1476)

opensearch-project#791)

* CRUD api for long running operation notification config (opensearch-project#722)

* notification crud api

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* changes based on comments; add tests

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* changes for comment

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* change behavior for get action index not exists, fix test cases

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix weak password for changes in security plugin

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

---------

Signed-off-by: zhichao-aws <zhichaog@amazon.com>
(cherry picked from commit 96f7380)

* fix test code apache http package version

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

---------

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

…ct#793)

* Feature/index operation notification (opensearch-project#712)

* Feature/index operation notification (opensearch-project#707)

* task completion listener for long running task

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* task completion listener for long running task

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove unused import

Signed-off-by: Hailong Cui <ihailong@amazon.com>

---------

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* index action, no validation&test

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

get action. no validation&test

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

index and get action (draft)

changes for rebase main

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

index and get, no validation&test

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* refactor on package name

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* +delete, change index

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Implement notification with ActionFilter

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Query notification channel

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Notification message update

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* new version of crud

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* validate task id and action name; unitfy taskId

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Add unit test case

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* refactor on response parser

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* fix unit test case

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* modify code structure, change ID to Id

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add some test, delete message template

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Add integration test

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Add integration test for action listener

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove refresh policy in request

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add some tests, fix actionfilter refresh parameter

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Remove duplicate errors for reindex

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* add UT and IT

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix some code style

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* enable com.sun.net.httpserver.* for test

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* change index name, fix bug

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* modifications after meeting

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* don't continue wait for shard to be started for async mode

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* handle IndexNotFoundException for sending notification

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* add security test case

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add security test case

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* refactor on file names

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* add success/failure condition

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* filter channels by conditions

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Remove unused field enable for index .opensearch-admin-panel

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* add more integration testcase

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* change admin panel to control center

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Update mock server address to localhost for docker env

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove unused field in response

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* update integ test

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove default for all

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* Remove default for all

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove filter by backend roles

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix build

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* optimize constructor code

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add request doc id validation

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* merge get and search

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* remove get before delete

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add node id validation

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* auto create doc for update

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix test case

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* delete restUpdateAction, fix test

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add dry run option

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix bug, add test case

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* add xcontent tests

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* notification crud api

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* changes based on comments; add tests

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* changes for comment

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* change behavior for get action index not exists, fix test cases

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix merge

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* delay 5s for sending runtime notification

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* update log message

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* delay 5s for runtime notification policy

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Update notification message

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* filter duplicate channel

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* exception handling

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Add cluster name into title

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* fix UT for failure messagee

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* include cluster name into notification messag

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* fix UT failures

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* fix detekt issue

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* fix NPE

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* force merge message

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* remove duplicate error of reindex

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* notification message rewording

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* notification message wording change and unit test case

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* update block write wording

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Add more unit test case

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Add more logs

Signed-off-by: Hailong Cui <ihailong@amazon.com>

---------

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: zhichao-aws <zhichaog@amazon.com>
Co-authored-by: zhichao-aws <zhichaog@amazon.com>
(cherry picked from commit 89bd6de)

* Fix backport failure

Signed-off-by: Hailong Cui <ihailong@amazon.com>

---------

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>

* Add 2.8 release notes

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>
(cherry picked from commit d921f0b)

Co-authored-by: Xuesong Luo <lxuesong@amazon.com>

opensearch-project#797)

* Use original PR numbers in 2.8 release notes.

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>

---------

Signed-off-by: Xuesong Luo <lxuesong@amazon.com>
(cherry picked from commit 104c4b8)

Co-authored-by: Xuesong Luo <lxuesong@amazon.com>

* Support for system index interface

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Handle rejected execution exception as retryable in retry block

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Fix tests

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

* Fix tests

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

---------

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>

opensearch-project#803)

* 202: Added format property when specifying the date histogram

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 202: Added component responsible for building the target index mapping once the transform is being triggered.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 202: date_histogram considered in the case of the creating the target index for the date fields when transform is executed

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* 202: Enabled target index date field mappings if those fields are used in aggregations or as a term aggregation for defining the buckets

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Updated code according to comments. Added targetIndexMapping when transform preview action is triggered

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Updated schema versions

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Addressed the comments

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Refactored transform tests related with aggregation based on a date field.
Updated transform preview action to consider target index mapping when using a date field. Kept formatting of the date field in target index.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* detekt fix

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Added zone in IT

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

* Added function for creating target index mapping that considers transform mapping json. Target date field mappings are generated after transform validation when running transform. Removed target index date field values formatting. emoved default format for date_histogram because of the rollup. Updated schema version in test.

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>

---------

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
(cherry picked from commit 42833b1)

Co-authored-by: Stevan Buzejic <buzejic.stevan@gmail.com>

…pensearch-project#811)

* Added myself to the repo.



* Added myself to the repo.



* Added maintainers to the repo.



* Update MAINTAINERS.md





* Update MAINTAINERS.md



---------

Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>
Co-authored-by: Sayali Gaikawad <61760125+gaiksaya@users.noreply.github.com>

Signed-off-by: opensearch-ci-bot <opensearch-infra@amazon.com>
Co-authored-by: opensearch-ci-bot <opensearch-infra@amazon.com>

* Metadata members from ImmutableOpenMap to j.u.Map

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* add field remoteStoreIndexShallowCopy in SM TestUtils (opensearch-project#825)

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* fix NPE for transform aggregations (opensearch-project#830)

Signed-off-by: Hailong Cui <ihailong@amazon.com>

* Fix detekt

Signed-off-by: Hailong Cui <ihailong@amazon.com>

---------

Signed-off-by: Hailong Cui <ihailong@amazon.com>
Signed-off-by: zhichao-aws <zhichaog@amazon.com>
Co-authored-by: zhichao-aws <zhichaog@amazon.com>

…project#831) (opensearch-project#842)

* fix LRON unwrap exception and some IT

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

* remove useless log

Signed-off-by: zhichao-aws <zhichaog@amazon.com>

---------

Signed-off-by: zhichao-aws <zhichaog@amazon.com>
Co-authored-by: Hailong Cui <ihailong@amazon.com>
(cherry picked from commit f07fa2b)

Co-authored-by: zhichao-aws <zhichaog@amazon.com>

…arch-project#843)

Signed-off-by: Hailong Cui <ihailong@amazon.com>
(cherry picked from commit 2a9bcd6)

Co-authored-by: Hailong Cui <ihailong@amazon.com>

…arch-project#847) (opensearch-project#848)

Signed-off-by: bowenlan-amzn <bowenlan23@gmail.com>
(cherry picked from commit 77e8fd0)

Co-authored-by: bowenlan-amzn <bowenlan23@gmail.com>

…ch-project#786) (opensearch-project#845)

(cherry picked from commit 30e16d9)
Signed-off-by: Hailong Cui <ihailong@amazon.com>