-
Notifications
You must be signed in to change notification settings - Fork 8.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint #205106
[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint #205106
Conversation
d95ae9a
to
3653215
Compare
Pinging @elastic/security-detections-response (Team:Detections and Resp) |
Pinging @elastic/security-solution (Team: SecuritySolution) |
Pinging @elastic/security-detection-rule-management (Team:Detection Rule Management) |
💚 Build Succeeded
Metrics [docs]
cc @banderror |
Flaky Test Runner Stats🎉 All tests passed! - kibana-flaky-test-suite-runner#7633[✅] x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/configs/serverless.config.ts: 100/100 tests passed. |
Flaky Test Runner Stats🎉 All tests passed! - kibana-flaky-test-suite-runner#7632[✅] x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/configs/ess.config.ts: 190/190 tests passed. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@banderror Thanks for simplifying the test logic and adding logging! I hope this will resolve the flakiness for good. The changes look good to me.
Starting backport for target branches: 8.16, 8.17, 8.x |
💔 All backports failed
Manual backportTo create the backport manually run:
Questions ?Please refer to the Backport tool documentation |
…point (elastic#205106) **Fixes: elastic#197108 **Fixes: elastic#202037 **Fixes: elastic#203632 ## Summary Builds on top of elastic#203799 and: - simplifies the package deletion code (1 [API call](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion) instead of 2, per package) - adds retry logic - refactors the testing utils a bit Flaky test runs: - [ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632) - 190 runs - [Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633) - 100 runs ## Details Here's how the test logs look like: ``` info Starting tests └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management" └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function" └-> should install fleet packages required for detection engine to function └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function" └-> "before each" hook for "should install fleet packages required for detection engine to function" │ debg Deleting security_detection_engine package │ debg Deleted security_detection_engine package (was not installed) { │ statusCode: 400, │ error: 'Bad Request', │ message: 'security_detection_engine is not installed' │ } │ debg Deleting endpoint package │ debg Deleted endpoint package (was not installed) { │ statusCode: 400, │ error: 'Bad Request', │ message: 'endpoint is not installed' │ } └- ✓ pass (21.6s) └-> should skip installing fleet packages if they are already installed └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed" └-> "before each" hook for "should skip installing fleet packages if they are already installed" │ debg Deleting security_detection_engine package │ debg Deleted security_detection_engine package (was installed) │ debg Deleting endpoint package │ debg Deleted endpoint package (was installed) └- ✓ pass (22.4s) └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed" └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management" 2 passing (1.0m) ``` ### Checklist - [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios - [x] [Flaky Test Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was used on any tests changed (cherry picked from commit 71144ed) # Conflicts: # x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_endpoint_fleet_package.ts # x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_prebuilt_rules_fleet_package.ts
…point (elastic#205106) **Fixes: elastic#197108 **Fixes: elastic#202037 **Fixes: elastic#203632 ## Summary Builds on top of elastic#203799 and: - simplifies the package deletion code (1 [API call](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion) instead of 2, per package) - adds retry logic - refactors the testing utils a bit Flaky test runs: - [ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632) - 190 runs - [Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633) - 100 runs ## Details Here's how the test logs look like: ``` info Starting tests └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management" └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function" └-> should install fleet packages required for detection engine to function └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function" └-> "before each" hook for "should install fleet packages required for detection engine to function" │ debg Deleting security_detection_engine package │ debg Deleted security_detection_engine package (was not installed) { │ statusCode: 400, │ error: 'Bad Request', │ message: 'security_detection_engine is not installed' │ } │ debg Deleting endpoint package │ debg Deleted endpoint package (was not installed) { │ statusCode: 400, │ error: 'Bad Request', │ message: 'endpoint is not installed' │ } └- ✓ pass (21.6s) └-> should skip installing fleet packages if they are already installed └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed" └-> "before each" hook for "should skip installing fleet packages if they are already installed" │ debg Deleting security_detection_engine package │ debg Deleted security_detection_engine package (was installed) │ debg Deleting endpoint package │ debg Deleted endpoint package (was installed) └- ✓ pass (22.4s) └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed" └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management" 2 passing (1.0m) ``` ### Checklist - [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios - [x] [Flaky Test Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was used on any tests changed (cherry picked from commit 71144ed) # Conflicts: # x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/bootstrap_prebuilt_rules.ts # x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_endpoint_fleet_package.ts # x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_prebuilt_rules_fleet_package.ts
…point (elastic#205106) **Fixes: elastic#197108 **Fixes: elastic#202037 **Fixes: elastic#203632 ## Summary Builds on top of elastic#203799 and: - simplifies the package deletion code (1 [API call](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion) instead of 2, per package) - adds retry logic - refactors the testing utils a bit Flaky test runs: - [ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632) - 190 runs - [Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633) - 100 runs ## Details Here's how the test logs look like: ``` info Starting tests └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management" └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function" └-> should install fleet packages required for detection engine to function └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function" └-> "before each" hook for "should install fleet packages required for detection engine to function" │ debg Deleting security_detection_engine package │ debg Deleted security_detection_engine package (was not installed) { │ statusCode: 400, │ error: 'Bad Request', │ message: 'security_detection_engine is not installed' │ } │ debg Deleting endpoint package │ debg Deleted endpoint package (was not installed) { │ statusCode: 400, │ error: 'Bad Request', │ message: 'endpoint is not installed' │ } └- ✓ pass (21.6s) └-> should skip installing fleet packages if they are already installed └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed" └-> "before each" hook for "should skip installing fleet packages if they are already installed" │ debg Deleting security_detection_engine package │ debg Deleted security_detection_engine package (was installed) │ debg Deleting endpoint package │ debg Deleted endpoint package (was installed) └- ✓ pass (22.4s) └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed" └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management" 2 passing (1.0m) ``` ### Checklist - [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios - [x] [Flaky Test Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was used on any tests changed (cherry picked from commit 71144ed) # Conflicts: # x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_endpoint_fleet_package.ts # x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_prebuilt_rules_fleet_package.ts
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
…rap endpoint (#205106) (#205134) # Backport This will backport the following commits from `main` to `8.17`: - [[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)](#205106) <!--- Backport version: 8.9.8 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Georgii Gorbachev","email":"georgii.gorbachev@elastic.co"},"sourceCommit":{"committedDate":"2024-12-24T09:58:37Z","message":"[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)\n\n**Fixes: https://github.com/elastic/kibana/issues/197108**\r\n**Fixes: https://github.com/elastic/kibana/issues/202037**\r\n**Fixes: https://github.com/elastic/kibana/issues/203632**\r\n\r\n## Summary\r\n\r\nBuilds on top of #203799 and:\r\n\r\n- simplifies the package deletion code (1 [API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead of 2, per package)\r\n- adds retry logic\r\n- refactors the testing utils a bit\r\n\r\nFlaky test runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n- 190 runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n- 100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook: beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\" hook: beforeTestSuite.trigger for \"should install fleet packages required for detection engine to function\"\r\n └-> should install fleet packages required for detection engine to function\r\n └-> \"before each\" hook: global before each for \"should install fleet packages required for detection engine to function\"\r\n └-> \"before each\" hook for \"should install fleet packages required for detection engine to function\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should skip installing fleet packages if they are already installed\r\n └-> \"before each\" hook: global before each for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"before each\" hook for \"should skip installing fleet packages if they are already installed\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was installed)\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook: afterTestSuite.trigger for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"after all\" hook: afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere updated or added to match the most common scenarios\r\n- [x] [Flaky Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was\r\nused on any tests changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections and Resp","Team: SecuritySolution","Team:Detection Rule Management","Feature:Prebuilt Detection Rules","backport:version","v8.18.0","v8.16.3","v8.17.1"],"number":205106,"url":"https://github.com/elastic/kibana/pull/205106","mergeCommit":{"message":"[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)\n\n**Fixes: https://github.com/elastic/kibana/issues/197108**\r\n**Fixes: https://github.com/elastic/kibana/issues/202037**\r\n**Fixes: https://github.com/elastic/kibana/issues/203632**\r\n\r\n## Summary\r\n\r\nBuilds on top of #203799 and:\r\n\r\n- simplifies the package deletion code (1 [API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead of 2, per package)\r\n- adds retry logic\r\n- refactors the testing utils a bit\r\n\r\nFlaky test runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n- 190 runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n- 100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook: beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\" hook: beforeTestSuite.trigger for \"should install fleet packages required for detection engine to function\"\r\n └-> should install fleet packages required for detection engine to function\r\n └-> \"before each\" hook: global before each for \"should install fleet packages required for detection engine to function\"\r\n └-> \"before each\" hook for \"should install fleet packages required for detection engine to function\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should skip installing fleet packages if they are already installed\r\n └-> \"before each\" hook: global before each for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"before each\" hook for \"should skip installing fleet packages if they are already installed\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was installed)\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook: afterTestSuite.trigger for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"after all\" hook: afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere updated or added to match the most common scenarios\r\n- [x] [Flaky Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was\r\nused on any tests changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16","8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","labelRegex":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/205106","number":205106,"mergeCommit":{"message":"[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)\n\n**Fixes: https://github.com/elastic/kibana/issues/197108**\r\n**Fixes: https://github.com/elastic/kibana/issues/202037**\r\n**Fixes: https://github.com/elastic/kibana/issues/203632**\r\n\r\n## Summary\r\n\r\nBuilds on top of #203799 and:\r\n\r\n- simplifies the package deletion code (1 [API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead of 2, per package)\r\n- adds retry logic\r\n- refactors the testing utils a bit\r\n\r\nFlaky test runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n- 190 runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n- 100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook: beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\" hook: beforeTestSuite.trigger for \"should install fleet packages required for detection engine to function\"\r\n └-> should install fleet packages required for detection engine to function\r\n └-> \"before each\" hook: global before each for \"should install fleet packages required for detection engine to function\"\r\n └-> \"before each\" hook for \"should install fleet packages required for detection engine to function\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should skip installing fleet packages if they are already installed\r\n └-> \"before each\" hook: global before each for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"before each\" hook for \"should skip installing fleet packages if they are already installed\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was installed)\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook: afterTestSuite.trigger for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"after all\" hook: afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere updated or added to match the most common scenarios\r\n- [x] [Flaky Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was\r\nused on any tests changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},{"branch":"8.x","label":"v8.18.0","labelRegex":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.3","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.17","label":"v8.17.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT-->
…ap endpoint (#205106) (#205133) # Backport This will backport the following commits from `main` to `8.x`: - [[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)](#205106) <!--- Backport version: 8.9.8 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Georgii Gorbachev","email":"georgii.gorbachev@elastic.co"},"sourceCommit":{"committedDate":"2024-12-24T09:58:37Z","message":"[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)\n\n**Fixes: https://github.com/elastic/kibana/issues/197108**\r\n**Fixes: https://github.com/elastic/kibana/issues/202037**\r\n**Fixes: https://github.com/elastic/kibana/issues/203632**\r\n\r\n## Summary\r\n\r\nBuilds on top of #203799 and:\r\n\r\n- simplifies the package deletion code (1 [API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead of 2, per package)\r\n- adds retry logic\r\n- refactors the testing utils a bit\r\n\r\nFlaky test runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n- 190 runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n- 100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook: beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\" hook: beforeTestSuite.trigger for \"should install fleet packages required for detection engine to function\"\r\n └-> should install fleet packages required for detection engine to function\r\n └-> \"before each\" hook: global before each for \"should install fleet packages required for detection engine to function\"\r\n └-> \"before each\" hook for \"should install fleet packages required for detection engine to function\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should skip installing fleet packages if they are already installed\r\n └-> \"before each\" hook: global before each for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"before each\" hook for \"should skip installing fleet packages if they are already installed\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was installed)\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook: afterTestSuite.trigger for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"after all\" hook: afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere updated or added to match the most common scenarios\r\n- [x] [Flaky Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was\r\nused on any tests changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections and Resp","Team: SecuritySolution","Team:Detection Rule Management","Feature:Prebuilt Detection Rules","backport:version","v8.18.0","v8.16.3","v8.17.1"],"number":205106,"url":"https://github.com/elastic/kibana/pull/205106","mergeCommit":{"message":"[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)\n\n**Fixes: https://github.com/elastic/kibana/issues/197108**\r\n**Fixes: https://github.com/elastic/kibana/issues/202037**\r\n**Fixes: https://github.com/elastic/kibana/issues/203632**\r\n\r\n## Summary\r\n\r\nBuilds on top of #203799 and:\r\n\r\n- simplifies the package deletion code (1 [API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead of 2, per package)\r\n- adds retry logic\r\n- refactors the testing utils a bit\r\n\r\nFlaky test runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n- 190 runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n- 100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook: beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\" hook: beforeTestSuite.trigger for \"should install fleet packages required for detection engine to function\"\r\n └-> should install fleet packages required for detection engine to function\r\n └-> \"before each\" hook: global before each for \"should install fleet packages required for detection engine to function\"\r\n └-> \"before each\" hook for \"should install fleet packages required for detection engine to function\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should skip installing fleet packages if they are already installed\r\n └-> \"before each\" hook: global before each for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"before each\" hook for \"should skip installing fleet packages if they are already installed\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was installed)\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook: afterTestSuite.trigger for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"after all\" hook: afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere updated or added to match the most common scenarios\r\n- [x] [Flaky Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was\r\nused on any tests changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16","8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","labelRegex":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/205106","number":205106,"mergeCommit":{"message":"[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)\n\n**Fixes: https://github.com/elastic/kibana/issues/197108**\r\n**Fixes: https://github.com/elastic/kibana/issues/202037**\r\n**Fixes: https://github.com/elastic/kibana/issues/203632**\r\n\r\n## Summary\r\n\r\nBuilds on top of #203799 and:\r\n\r\n- simplifies the package deletion code (1 [API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead of 2, per package)\r\n- adds retry logic\r\n- refactors the testing utils a bit\r\n\r\nFlaky test runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n- 190 runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n- 100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook: beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\" hook: beforeTestSuite.trigger for \"should install fleet packages required for detection engine to function\"\r\n └-> should install fleet packages required for detection engine to function\r\n └-> \"before each\" hook: global before each for \"should install fleet packages required for detection engine to function\"\r\n └-> \"before each\" hook for \"should install fleet packages required for detection engine to function\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should skip installing fleet packages if they are already installed\r\n └-> \"before each\" hook: global before each for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"before each\" hook for \"should skip installing fleet packages if they are already installed\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was installed)\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook: afterTestSuite.trigger for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"after all\" hook: afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere updated or added to match the most common scenarios\r\n- [x] [Flaky Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was\r\nused on any tests changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},{"branch":"8.x","label":"v8.18.0","labelRegex":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.3","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.17","label":"v8.17.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT-->
…rap endpoint (#205106) (#205135) # Backport This will backport the following commits from `main` to `8.16`: - [[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)](#205106) <!--- Backport version: 8.9.8 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Georgii Gorbachev","email":"georgii.gorbachev@elastic.co"},"sourceCommit":{"committedDate":"2024-12-24T09:58:37Z","message":"[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)\n\n**Fixes: https://github.com/elastic/kibana/issues/197108**\r\n**Fixes: https://github.com/elastic/kibana/issues/202037**\r\n**Fixes: https://github.com/elastic/kibana/issues/203632**\r\n\r\n## Summary\r\n\r\nBuilds on top of #203799 and:\r\n\r\n- simplifies the package deletion code (1 [API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead of 2, per package)\r\n- adds retry logic\r\n- refactors the testing utils a bit\r\n\r\nFlaky test runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n- 190 runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n- 100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook: beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\" hook: beforeTestSuite.trigger for \"should install fleet packages required for detection engine to function\"\r\n └-> should install fleet packages required for detection engine to function\r\n └-> \"before each\" hook: global before each for \"should install fleet packages required for detection engine to function\"\r\n └-> \"before each\" hook for \"should install fleet packages required for detection engine to function\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should skip installing fleet packages if they are already installed\r\n └-> \"before each\" hook: global before each for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"before each\" hook for \"should skip installing fleet packages if they are already installed\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was installed)\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook: afterTestSuite.trigger for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"after all\" hook: afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere updated or added to match the most common scenarios\r\n- [x] [Flaky Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was\r\nused on any tests changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections and Resp","Team: SecuritySolution","Team:Detection Rule Management","Feature:Prebuilt Detection Rules","backport:version","v8.18.0","v8.16.3","v8.17.1"],"number":205106,"url":"https://github.com/elastic/kibana/pull/205106","mergeCommit":{"message":"[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)\n\n**Fixes: https://github.com/elastic/kibana/issues/197108**\r\n**Fixes: https://github.com/elastic/kibana/issues/202037**\r\n**Fixes: https://github.com/elastic/kibana/issues/203632**\r\n\r\n## Summary\r\n\r\nBuilds on top of #203799 and:\r\n\r\n- simplifies the package deletion code (1 [API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead of 2, per package)\r\n- adds retry logic\r\n- refactors the testing utils a bit\r\n\r\nFlaky test runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n- 190 runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n- 100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook: beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\" hook: beforeTestSuite.trigger for \"should install fleet packages required for detection engine to function\"\r\n └-> should install fleet packages required for detection engine to function\r\n └-> \"before each\" hook: global before each for \"should install fleet packages required for detection engine to function\"\r\n └-> \"before each\" hook for \"should install fleet packages required for detection engine to function\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should skip installing fleet packages if they are already installed\r\n └-> \"before each\" hook: global before each for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"before each\" hook for \"should skip installing fleet packages if they are already installed\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was installed)\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook: afterTestSuite.trigger for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"after all\" hook: afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere updated or added to match the most common scenarios\r\n- [x] [Flaky Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was\r\nused on any tests changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16","8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","labelRegex":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/205106","number":205106,"mergeCommit":{"message":"[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint (#205106)\n\n**Fixes: https://github.com/elastic/kibana/issues/197108**\r\n**Fixes: https://github.com/elastic/kibana/issues/202037**\r\n**Fixes: https://github.com/elastic/kibana/issues/203632**\r\n\r\n## Summary\r\n\r\nBuilds on top of #203799 and:\r\n\r\n- simplifies the package deletion code (1 [API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead of 2, per package)\r\n- adds retry logic\r\n- refactors the testing utils a bit\r\n\r\nFlaky test runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n- 190 runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n- 100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook: beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\" hook: beforeTestSuite.trigger for \"should install fleet packages required for detection engine to function\"\r\n └-> should install fleet packages required for detection engine to function\r\n └-> \"before each\" hook: global before each for \"should install fleet packages required for detection engine to function\"\r\n └-> \"before each\" hook for \"should install fleet packages required for detection engine to function\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was not installed) {\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message: 'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should skip installing fleet packages if they are already installed\r\n └-> \"before each\" hook: global before each for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"before each\" hook for \"should skip installing fleet packages if they are already installed\"\r\n │ debg Deleting security_detection_engine package\r\n │ debg Deleted security_detection_engine package (was installed)\r\n │ debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook: afterTestSuite.trigger for \"should skip installing fleet packages if they are already installed\"\r\n └-> \"after all\" hook: afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n### Checklist\r\n\r\n- [x] [Unit or functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere updated or added to match the most common scenarios\r\n- [x] [Flaky Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was\r\nused on any tests changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},{"branch":"8.x","label":"v8.18.0","labelRegex":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.3","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.17","label":"v8.17.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT-->
Fixes: #197108
Fixes: #202037
Fixes: #203632
Summary
Builds on top of #203799 and:
Flaky test runs:
Details
Here's how the test logs look like:
Checklist