Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security Solution] Unskip tests for the prebuilt rules bootstrap endpoint #205106

Conversation

banderror
Copy link
Contributor

@banderror banderror commented Dec 23, 2024

Fixes: #197108
Fixes: #202037
Fixes: #203632

Summary

Builds on top of #203799 and:

  • simplifies the package deletion code (1 API call instead of 2, per package)
  • adds retry logic
  • refactors the testing utils a bit

Flaky test runs:

Details

Here's how the test logs look like:

 info Starting tests

 └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management
   └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"
   └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules
     └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function"
     └-> should install fleet packages required for detection engine to function
       └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function"
       └-> "before each" hook for "should install fleet packages required for detection engine to function"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'security_detection_engine is not installed'
         │      }
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'endpoint is not installed'
         │      }
       └- ✓ pass  (21.6s)
     └-> should skip installing fleet packages if they are already installed
       └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed"
       └-> "before each" hook for "should skip installing fleet packages if they are already installed"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was installed)
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was installed)
       └- ✓ pass  (22.4s)
     └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed"
   └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"

2 passing (1.0m)

Checklist

@banderror banderror added test release_note:skip Skip the PR/issue when compiling release notes v9.0.0 Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Detection Rule Management Security Detection Rule Management Team Feature:Prebuilt Detection Rules Security Solution Prebuilt Detection Rules area backport:version Backport to applied version labels v8.18.0 v8.16.3 v8.17.1 labels Dec 23, 2024
@banderror banderror self-assigned this Dec 23, 2024
@banderror banderror force-pushed the unskip-tests-for-prebuilt-rules-bootstrap-endpoint branch from d95ae9a to 3653215 Compare December 23, 2024 17:44
@banderror banderror marked this pull request as ready for review December 23, 2024 17:45
@banderror banderror requested review from a team as code owners December 23, 2024 17:45
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detections-response (Team:Detections and Resp)

@elasticmachine
Copy link
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detection-rule-management (Team:Detection Rule Management)

@elasticmachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

cc @banderror

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#7633

[✅] x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/configs/serverless.config.ts: 100/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#7632

[✅] x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/configs/ess.config.ts: 190/190 tests passed.

see run history

Copy link
Contributor

@nikitaindik nikitaindik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@banderror Thanks for simplifying the test logic and adding logging! I hope this will resolve the flakiness for good. The changes look good to me.

@banderror banderror merged commit 71144ed into elastic:main Dec 24, 2024
8 checks passed
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 8.16, 8.17, 8.x

https://github.com/elastic/kibana/actions/runs/12480139427

@kibanamachine
Copy link
Contributor

💔 All backports failed

Status Branch Result
8.16 Backport failed because of merge conflicts

You might need to backport the following PRs to 8.16:
- Update docker.elastic.co/wolfi/chainguard-base:latest Docker digest to 3a6e913 (main) (#205067)
8.17 Backport failed because of merge conflicts
8.x Backport failed because of merge conflicts

You might need to backport the following PRs to 8.x:
- Sustainable Kibana Architecture: Move modules owned by @elastic/logstash (#202756)
- 🌊 Refactor APIs to follow Elasticsearch conventions (#204671)
- [ML][UX]: Consistent Layout and UI Enhancements for ML Pages (#203813)

Manual backport

To create the backport manually run:

node scripts/backport --pr 205106

Questions ?

Please refer to the Backport tool documentation

banderror added a commit to banderror/kibana that referenced this pull request Dec 24, 2024
…point (elastic#205106)

**Fixes: elastic#197108
**Fixes: elastic#202037
**Fixes: elastic#203632

## Summary

Builds on top of elastic#203799 and:

- simplifies the package deletion code (1 [API
call](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)
instead of 2, per package)
- adds retry logic
- refactors the testing utils a bit

Flaky test runs:

-
[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)
- 190 runs
-
[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)
- 100 runs

## Details

Here's how the test logs look like:

```
 info Starting tests

 └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management
   └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"
   └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules
     └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function"
     └-> should install fleet packages required for detection engine to function
       └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function"
       └-> "before each" hook for "should install fleet packages required for detection engine to function"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'security_detection_engine is not installed'
         │      }
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'endpoint is not installed'
         │      }
       └- ✓ pass  (21.6s)
     └-> should skip installing fleet packages if they are already installed
       └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed"
       └-> "before each" hook for "should skip installing fleet packages if they are already installed"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was installed)
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was installed)
       └- ✓ pass  (22.4s)
     └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed"
   └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"

2 passing (1.0m)
```

### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

(cherry picked from commit 71144ed)

# Conflicts:
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_endpoint_fleet_package.ts
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_prebuilt_rules_fleet_package.ts
banderror added a commit to banderror/kibana that referenced this pull request Dec 24, 2024
…point (elastic#205106)

**Fixes: elastic#197108
**Fixes: elastic#202037
**Fixes: elastic#203632

## Summary

Builds on top of elastic#203799 and:

- simplifies the package deletion code (1 [API
call](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)
instead of 2, per package)
- adds retry logic
- refactors the testing utils a bit

Flaky test runs:

-
[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)
- 190 runs
-
[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)
- 100 runs

## Details

Here's how the test logs look like:

```
 info Starting tests

 └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management
   └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"
   └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules
     └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function"
     └-> should install fleet packages required for detection engine to function
       └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function"
       └-> "before each" hook for "should install fleet packages required for detection engine to function"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'security_detection_engine is not installed'
         │      }
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'endpoint is not installed'
         │      }
       └- ✓ pass  (21.6s)
     └-> should skip installing fleet packages if they are already installed
       └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed"
       └-> "before each" hook for "should skip installing fleet packages if they are already installed"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was installed)
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was installed)
       └- ✓ pass  (22.4s)
     └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed"
   └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"

2 passing (1.0m)
```

### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

(cherry picked from commit 71144ed)

# Conflicts:
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/bootstrap_prebuilt_rules.ts
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_endpoint_fleet_package.ts
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_prebuilt_rules_fleet_package.ts
banderror added a commit to banderror/kibana that referenced this pull request Dec 24, 2024
…point (elastic#205106)

**Fixes: elastic#197108
**Fixes: elastic#202037
**Fixes: elastic#203632

## Summary

Builds on top of elastic#203799 and:

- simplifies the package deletion code (1 [API
call](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)
instead of 2, per package)
- adds retry logic
- refactors the testing utils a bit

Flaky test runs:

-
[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)
- 190 runs
-
[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)
- 100 runs

## Details

Here's how the test logs look like:

```
 info Starting tests

 └-: Rules Management - Prebuilt Rules - Prebuilt Rules Management
   └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"
   └-: @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules
     └-> "before all" hook: beforeTestSuite.trigger for "should install fleet packages required for detection engine to function"
     └-> should install fleet packages required for detection engine to function
       └-> "before each" hook: global before each for "should install fleet packages required for detection engine to function"
       └-> "before each" hook for "should install fleet packages required for detection engine to function"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'security_detection_engine is not installed'
         │      }
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was not installed) {
         │        statusCode: 400,
         │        error: 'Bad Request',
         │        message: 'endpoint is not installed'
         │      }
       └- ✓ pass  (21.6s)
     └-> should skip installing fleet packages if they are already installed
       └-> "before each" hook: global before each for "should skip installing fleet packages if they are already installed"
       └-> "before each" hook for "should skip installing fleet packages if they are already installed"
         │ debg Deleting security_detection_engine package
         │ debg Deleted security_detection_engine package (was installed)
         │ debg Deleting endpoint package
         │ debg Deleted endpoint package (was installed)
       └- ✓ pass  (22.4s)
     └-> "after all" hook: afterTestSuite.trigger for "should skip installing fleet packages if they are already installed"
   └-> "after all" hook: afterTestSuite.trigger in "Rules Management - Prebuilt Rules - Prebuilt Rules Management"

2 passing (1.0m)
```

### Checklist

- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

(cherry picked from commit 71144ed)

# Conflicts:
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_endpoint_fleet_package.ts
#	x-pack/test/security_solution_api_integration/test_suites/detections_response/utils/rules/prebuilt_rules/delete_prebuilt_rules_fleet_package.ts
@banderror
Copy link
Contributor Author

💚 All backports created successfully

Status Branch Result
8.x
8.17
8.16

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

@banderror banderror deleted the unskip-tests-for-prebuilt-rules-bootstrap-endpoint branch December 24, 2024 10:23
banderror added a commit that referenced this pull request Dec 24, 2024
…rap endpoint (#205106) (#205134)

# Backport

This will backport the following commits from `main` to `8.17`:
- [[Security Solution] Unskip tests for the prebuilt rules bootstrap
endpoint (#205106)](#205106)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Georgii
Gorbachev","email":"georgii.gorbachev@elastic.co"},"sourceCommit":{"committedDate":"2024-12-24T09:58:37Z","message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.18.0","v8.16.3","v8.17.1"],"number":205106,"url":"https://github.com/elastic/kibana/pull/205106","mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16","8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","labelRegex":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/205106","number":205106,"mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},{"branch":"8.x","label":"v8.18.0","labelRegex":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.3","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.17","label":"v8.17.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
banderror added a commit that referenced this pull request Dec 24, 2024
…ap endpoint (#205106) (#205133)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[Security Solution] Unskip tests for the prebuilt rules bootstrap
endpoint (#205106)](#205106)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Georgii
Gorbachev","email":"georgii.gorbachev@elastic.co"},"sourceCommit":{"committedDate":"2024-12-24T09:58:37Z","message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.18.0","v8.16.3","v8.17.1"],"number":205106,"url":"https://github.com/elastic/kibana/pull/205106","mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16","8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","labelRegex":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/205106","number":205106,"mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},{"branch":"8.x","label":"v8.18.0","labelRegex":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.3","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.17","label":"v8.17.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
banderror added a commit that referenced this pull request Dec 24, 2024
…rap endpoint (#205106) (#205135)

# Backport

This will backport the following commits from `main` to `8.16`:
- [[Security Solution] Unskip tests for the prebuilt rules bootstrap
endpoint (#205106)](#205106)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Georgii
Gorbachev","email":"georgii.gorbachev@elastic.co"},"sourceCommit":{"committedDate":"2024-12-24T09:58:37Z","message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.18.0","v8.16.3","v8.17.1"],"number":205106,"url":"https://github.com/elastic/kibana/pull/205106","mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16","8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","labelRegex":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/205106","number":205106,"mergeCommit":{"message":"[Security
Solution] Unskip tests for the prebuilt rules bootstrap endpoint
(#205106)\n\n**Fixes:
https://github.com/elastic/kibana/issues/197108**\r\n**Fixes:
https://github.com/elastic/kibana/issues/202037**\r\n**Fixes:
https://github.com/elastic/kibana/issues/203632**\r\n\r\n##
Summary\r\n\r\nBuilds on top of
#203799 and:\r\n\r\n- simplifies
the package deletion code (1
[API\r\ncall](https://www.elastic.co/docs/api/doc/kibana/operation/operation-delete-fleet-epm-packages-pkgname-pkgversion)\r\ninstead
of 2, per package)\r\n- adds retry logic\r\n- refactors the testing
utils a bit\r\n\r\nFlaky test
runs:\r\n\r\n-\r\n[ESS](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7632)\r\n-
190
runs\r\n-\r\n[Serverless](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7633)\r\n-
100 runs\r\n\r\n## Details\r\n\r\nHere's how the test logs look
like:\r\n\r\n```\r\n info Starting tests\r\n\r\n └-: Rules Management -
Prebuilt Rules - Prebuilt Rules Management\r\n └-> \"before all\" hook:
beforeTestSuite.trigger in \"Rules Management - Prebuilt Rules -
Prebuilt Rules Management\"\r\n └-: @ess @serverless
@skipInServerlessMKI Bootstrap Prebuilt Rules\r\n └-> \"before all\"
hook: beforeTestSuite.trigger for \"should install fleet packages
required for detection engine to function\"\r\n └-> should install fleet
packages required for detection engine to function\r\n └-> \"before
each\" hook: global before each for \"should install fleet packages
required for detection engine to function\"\r\n └-> \"before each\" hook
for \"should install fleet packages required for detection engine to
function\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was not installed) {\r\n
│ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'security_detection_engine is not installed'\r\n │ }\r\n │ debg Deleting
endpoint package\r\n │ debg Deleted endpoint package (was not installed)
{\r\n │ statusCode: 400,\r\n │ error: 'Bad Request',\r\n │ message:
'endpoint is not installed'\r\n │ }\r\n └- ✓ pass (21.6s)\r\n └-> should
skip installing fleet packages if they are already installed\r\n └->
\"before each\" hook: global before each for \"should skip installing
fleet packages if they are already installed\"\r\n └-> \"before each\"
hook for \"should skip installing fleet packages if they are already
installed\"\r\n │ debg Deleting security_detection_engine package\r\n │
debg Deleted security_detection_engine package (was installed)\r\n │
debg Deleting endpoint package\r\n │ debg Deleted endpoint package (was
installed)\r\n └- ✓ pass (22.4s)\r\n └-> \"after all\" hook:
afterTestSuite.trigger for \"should skip installing fleet packages if
they are already installed\"\r\n └-> \"after all\" hook:
afterTestSuite.trigger in \"Rules Management - Prebuilt Rules - Prebuilt
Rules Management\"\r\n\r\n2 passing (1.0m)\r\n```\r\n\r\n###
Checklist\r\n\r\n- [x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"71144eded7f56705e54c768c3741e5fcf1b62f9a"}},{"branch":"8.x","label":"v8.18.0","labelRegex":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.3","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.17","label":"v8.17.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:version Backport to applied version labels Feature:Prebuilt Detection Rules Security Solution Prebuilt Detection Rules area release_note:skip Skip the PR/issue when compiling release notes Team:Detection Rule Management Security Detection Rule Management Team Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. test v8.16.3 v8.17.1 v8.18.0 v9.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Failing test: Rules Management - Prebuilt Rules Management Integration Tests - ESS Env - Trial License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/bootstrap_prebuilt_rules·ts - Rules Management - Prebuilt Rules - Prebuilt Rules Management @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules should install fleet packages required for detection engine to function Failing test: Rules Management - Prebuilt Rules Management Integration Tests - Serverless Env - Complete License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/bootstrap_prebuilt_rules·ts - Rules Management - Prebuilt Rules - Prebuilt Rules Management @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules should skip installing fleet packages if they are already installed Failing test: Rules Management - Prebuilt Rules Management Integration Tests - ESS Env - Trial License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/management/trial_license_complete_tier/bootstrap_prebuilt_rules·ts - Rules Management - Prebuilt Rules - Prebuilt Rules Management @ess @serverless @skipInServerlessMKI Bootstrap Prebuilt Rules should skip installing fleet packages if they are already installed
4 participants