Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AUTOCUT] Integration Test failed for security: 2.12.0 tar distribution #3876

Closed
Tracked by #4115
opensearch-ci-bot opened this issue Dec 20, 2023 · 101 comments
Closed
Tracked by #4115
Assignees
Labels
autocut integ-test-failure Integration test failures v2.12.0 Items targeting 2.12.0

Comments

@opensearch-ci-bot
Copy link
Collaborator

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6700/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9061/linux/arm64/tar/test-results/6700/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot opensearch-ci-bot added autocut integ-test-failure Integration test failures untriaged Require the attention of the repository maintainers and may need to be prioritized v2.12.0 Items targeting 2.12.0 labels Dec 20, 2023
@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6701/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9061/linux/x64/tar/test-results/6701/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6709/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9066/linux/x64/tar/test-results/6709/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6710/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9066/linux/arm64/tar/test-results/6710/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6711/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9066/linux/arm64/tar/test-results/6711/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6712/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9066/linux/x64/tar/test-results/6712/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6721/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9071/linux/x64/tar/test-results/6721/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6722/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9071/linux/arm64/tar/test-results/6722/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6723/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9071/linux/arm64/tar/test-results/6723/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6724/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9071/linux/x64/tar/test-results/6724/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6733/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9076/linux/x64/tar/test-results/6733/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6734/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9076/linux/arm64/tar/test-results/6734/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6735/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9076/linux/arm64/tar/test-results/6735/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6736/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9076/linux/x64/tar/test-results/6736/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6745/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9081/linux/x64/tar/test-results/6745/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6746/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9081/linux/arm64/tar/test-results/6746/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6747/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9081/linux/arm64/tar/test-results/6747/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6748/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9081/linux/x64/tar/test-results/6748/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6757/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9086/linux/x64/tar/test-results/6757/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6758/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9086/linux/arm64/tar/test-results/6758/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6759/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9086/linux/arm64/tar/test-results/6759/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6760/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9086/linux/x64/tar/test-results/6760/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6770/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9091/linux/arm64/tar/test-results/6770/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6769/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9091/linux/x64/tar/test-results/6769/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6771/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9086/linux/arm64/tar/test-results/6771/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6772/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9086/linux/x64/tar/test-results/6772/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6781/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9096/linux/x64/tar/test-results/6781/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6900/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9147/linux/arm64/tar/test-results/6900/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6901/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9147/linux/arm64/tar/test-results/6901/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6902/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9147/linux/x64/tar/test-results/6902/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6911/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9152/linux/x64/tar/test-results/6911/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6912/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9152/linux/arm64/tar/test-results/6912/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6913/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9152/linux/arm64/tar/test-results/6913/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6914/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9152/linux/x64/tar/test-results/6914/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6923/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9157/linux/x64/tar/test-results/6923/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6924/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9157/linux/arm64/tar/test-results/6924/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6925/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9157/linux/arm64/tar/test-results/6925/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6926/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9157/linux/x64/tar/test-results/6926/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@derek-ho
Copy link
Collaborator

derek-ho commented Jan 8, 2024

@peternied I've seen these issues happen due to the new demo configuration script changes. Let me look into this/how to fix it.

@derek-ho
Copy link
Collaborator

derek-ho commented Jan 8, 2024

@peternied it seems like these test failures are caused by security plugin in 2.12.0-SNAPSHOT images:

$ docker run opensearchstaging/opensearch:2.12.0


Caused by: java.lang.reflect.InvocationTargetException
	at java.base/jdk.internal.reflect.DirectConstructorHandleAccessor.newInstance(DirectConstructorHandleAccessor.java:74) ~[?:?]
	at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:502) ~[?:?]
	at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:486) ~[?:?]
	at org.opensearch.plugins.PluginsService.loadPlugin(PluginsService.java:782) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.plugins.PluginsService.loadBundle(PluginsService.java:731) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.plugins.PluginsService.loadBundles(PluginsService.java:533) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.plugins.PluginsService.<init>(PluginsService.java:195) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.node.Node.<init>(Node.java:482) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.node.Node.<init>(Node.java:409) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:242) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.bootstrap.Bootstrap.setup(Bootstrap.java:242) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:404) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:180) ~[opensearch-2.12.0.jar:2.12.0]
	... 6 more
Caused by: org.opensearch.OpenSearchException: plugins.security.ssl.transport.keystore_filepath or plugins.security.ssl.transport.server.pemcert_filepath and plugins.security.ssl.transport.client.pemcert_filepath must be set if transport ssl is requested.
	at org.opensearch.security.ssl.DefaultSecurityKeyStore.initTransportSSLConfig(DefaultSecurityKeyStore.java:487) ~[?:?]
	at org.opensearch.security.ssl.DefaultSecurityKeyStore.initSSLConfig(DefaultSecurityKeyStore.java:298) ~[?:?]
	at org.opensearch.security.ssl.DefaultSecurityKeyStore.<init>(DefaultSecurityKeyStore.java:204) ~[?:?]
	at org.opensearch.security.ssl.OpenSearchSecuritySSLPlugin.<init>(OpenSearchSecuritySSLPlugin.java:235) ~[?:?]
	at org.opensearch.security.OpenSearchSecurityPlugin.<init>(OpenSearchSecurityPlugin.java:294) ~[?:?]
	at java.base/jdk.internal.reflect.DirectConstructorHandleAccessor.newInstance(DirectConstructorHandleAccessor.java:62) ~[?:?]
	at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:502) ~[?:?]
	at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:486) ~[?:?]
	at org.opensearch.plugins.PluginsService.loadPlugin(PluginsService.java:782) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.plugins.PluginsService.loadBundle(PluginsService.java:731) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.plugins.PluginsService.loadBundles(PluginsService.java:533) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.plugins.PluginsService.<init>(PluginsService.java:195) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.node.Node.<init>(Node.java:482) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.node.Node.<init>(Node.java:409) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:242) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.bootstrap.Bootstrap.setup(Bootstrap.java:242) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:404) ~[opensearch-2.12.0.jar:2.12.0]
	at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:180) ~[opensearch-2.12.0.jar:2.12.0]
	... 6 more
uncaught exception in thread [main]
java.lang.IllegalStateException: failed to load plugin class [org.opensearch.security.OpenSearchSecurityPlugin]
Likely root cause: OpenSearchException[plugins.security.ssl.transport.keystore_filepath or plugins.security.ssl.transport.server.pemcert_filepath and plugins.security.ssl.transport.client.pemcert_filepath must be set if transport ssl is requested.]
	at org.opensearch.security.ssl.DefaultSecurityKeyStore.initTransportSSLConfig(DefaultSecurityKeyStore.java:487)
	at org.opensearch.security.ssl.DefaultSecurityKeyStore.initSSLConfig(DefaultSecurityKeyStore.java:298)
	at org.opensearch.security.ssl.DefaultSecurityKeyStore.<init>(DefaultSecurityKeyStore.java:204)
	at org.opensearch.security.ssl.OpenSearchSecuritySSLPlugin.<init>(OpenSearchSecuritySSLPlugin.java:235)
	at org.opensearch.security.OpenSearchSecurityPlugin.<init>(OpenSearchSecurityPlugin.java:294)
	at java.base/jdk.internal.reflect.DirectConstructorHandleAccessor.newInstance(DirectConstructorHandleAccessor.java:62)
	at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:502)
	at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:486)
	at org.opensearch.plugins.PluginsService.loadPlugin(PluginsService.java:782)
	at org.opensearch.plugins.PluginsService.loadBundle(PluginsService.java:731)
	at org.opensearch.plugins.PluginsService.loadBundles(PluginsService.java:533)
	at org.opensearch.plugins.PluginsService.<init>(PluginsService.java:195)
	at org.opensearch.node.Node.<init>(Node.java:482)
	at org.opensearch.node.Node.<init>(Node.java:409)
	at org.opensearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:242)
	at org.opensearch.bootstrap.Bootstrap.setup(Bootstrap.java:242)
	at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:404)
	at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:180)
	at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:171)
	at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104)
	at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138)
	at org.opensearch.cli.Command.main(Command.java:101)
	at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:137)
	at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:103)
For complete error details, refer to the log at /usr/share/opensearch/logs/docker-cluster.log

@reta for this one, you have to now pass in the OPENSEARCH_INITIAL_ADMIN_PASSWORD= strong password. Then it should work. Pending merging of this PR: opensearch-project/opensearch-build#4274, the error message will be more clear.

@DarshitChanpura
Copy link
Member

DarshitChanpura commented Jan 8, 2024

@reta The docker compose file has changed a bit to adapt to the new password changes. 2.12 now requires admin password to be passed in order to spin up cluster. The opensearch-project/opensearch-build#4274 address the changes required to spin-up docker cluster. An easy option to pass custom password is by creating a .env file and the line OPENSEARCH_INITIAL_ADMIN_PASSWORD=<some-strong-password> to it and then spin up cluster.

I agree with @derek-ho 's suggestion to pass the custom password by setting the variable in order to fix the problem.

Expand to see logs:
➜  ~ docker run -e OPENSEARCH_INITIAL_ADMIN_PASSWORD=admin opensearchstaging/opensearch:2.12.0
Enabling execution of install_demo_configuration.sh for OpenSearch Security Plugin
### OpenSearch Security Demo Installer
### ** Warning: Do not use on production or public reachable systems **
OpenSearch install type: rpm/deb on Linux 6.5.11-linuxkit aarch64
OpenSearch config dir: /usr/share/opensearch/config/
OpenSearch config file: /usr/share/opensearch/config/opensearch.yml
OpenSearch bin dir: /usr/share/opensearch/bin/
OpenSearch plugins dir: /usr/share/opensearch/plugins/
OpenSearch lib dir: /usr/share/opensearch/lib/
Detected OpenSearch Version: 2.12.0
Detected OpenSearch Security Version: 2.12.0.0
Password admin is weak. Please re-try with a stronger password.
.
.
(cut out for clarity)
.
.
➜  ~ docker run -e OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123! opensearchstaging/opensearch:2.12.0
Enabling execution of install_demo_configuration.sh for OpenSearch Security Plugin
### OpenSearch Security Demo Installer
### ** Warning: Do not use on production or public reachable systems **
OpenSearch install type: rpm/deb on Linux 6.5.11-linuxkit aarch64
OpenSearch config dir: /usr/share/opensearch/config/
OpenSearch config file: /usr/share/opensearch/config/opensearch.yml
OpenSearch bin dir: /usr/share/opensearch/bin/
OpenSearch plugins dir: /usr/share/opensearch/plugins/
OpenSearch lib dir: /usr/share/opensearch/lib/
Detected OpenSearch Version: 2.12.0
Detected OpenSearch Security Version: 2.12.0.0
Admin password set successfully.
.
.
(cut out for clarity)
.
.

@reta
Copy link
Collaborator

reta commented Jan 8, 2024

I agree with @derek-ho 's suggestion to pass the custom password by setting the variable in order to fix the problem.

@derek-ho @DarshitChanpura We need to update the Docker image guidelines (both on Docker Hub and in the documentation) since the containers could not be used out of the box anymore. It also affects projects that use Docker based integration testing (Testcontainers or opensearch-testcontainers).

@stephen-crawford
Copy link
Contributor

[Triage] This issue is related to the admin:admin changes being partially supported at the moment causing the early distributions to fail some tests. This will be addressed with the remaining admin:admin tasks.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6935/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9162/linux/x64/tar/test-results/6935/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6936/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9162/linux/arm64/tar/test-results/6936/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6937/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9162/linux/arm64/tar/test-results/6937/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6938/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9162/linux/x64/tar/test-results/6938/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6947/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9167/linux/x64/tar/test-results/6947/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6948/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9167/linux/arm64/tar/test-results/6948/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: arm64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6949/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9167/linux/arm64/tar/test-results/6949/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@opensearch-ci-bot
Copy link
Collaborator Author

The integration test failed at distribution level for component security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6950/display/redirect

* Test-report manifest:*
- https://ci.opensearch.org/ci/dbc/integ-test/2.12.0/9167/linux/x64/tar/test-results/6950/integ-test/test-report.yml

Note: Steps to reproduce, additional logs and other files can be found within the above test-report manifest.
Instructions of this test-report manifest can be found here.

@peternied
Copy link
Member

@derek-ho I looked at the failed test run 6947 [1]. The server error [2] has:

Exception in thread "main" SettingsException[Failed to load settings from [opensearch.yml]]; nested: JsonParseException[Duplicate field 'node.name'
 at [Source: (sun.nio.ch.ChannelInputStream); line: 163, column: 10]];

Hacky way to get this log

  1. Get the integ-test run number
  2. Go to https://build.ci.opensearch.org/job/integ-test/{TEST_RUN_NUMBER}, link.
  3. View the full log for the run, link.
  4. Find what artifacts were uploaded for our component by searching for integ-test/security/,
Finished: Uploading to ****/integ-test/2.12.0/9167/linux/x64/tar/test-results/6947/integ-test/security/with-security/local-cluster-logs/id-0/stdout.txt
Finished: Uploading to ****/integ-test/2.12.0/9167/linux/x64/tar/test-results/6947/integ-test/security/with-security/local-cluster-logs/id-0/opensearch-service-logs/gc.log.00
Finished: Uploading to ****/integ-test/2.12.0/9167/linux/x64/tar/test-results/6947/integ-test/security/with-security/local-cluster-logs/id-0/opensearch-service-logs/gc.log
Finished: Uploading to ****/integ-test/2.12.0/9167/linux/x64/tar/test-results/6947/integ-test/security/with-security/local-cluster-logs/id-0/stderr.txt
  1. From the associated test report manifest copy out the public base url - everything before integ-test/2.12.0/9167/ in this case https://ci.opensearch.org/ci/dbc.
  2. Replace the **** in the above path with the and the public base url and open it in your browser, link.

@DarshitChanpura
Copy link
Member

DarshitChanpura commented Jan 10, 2024

@peternied The scenario presented in error logs would happen when opensearch.yml already has node.name but doesn't have network.host and the demo configuration setup has option -c (cluster_mode) setting passed.

See this blob which writes the setting to opensearch.yml:

  1. Post admin changes: https://github.com/opensearch-project/security/blob/main/src/main/java/org/opensearch/security/tools/democonfig/SecuritySettingsConfigurer.java#L268-L295

  2. Pre admin changes: https://github.com/opensearch-project/security/blob/2.11/tools/install_demo_configuration.sh#L390-L400

Do you know if there is a way we can check the pre and post state of opensearch.yml when executing demo config install script.

@opensearch-ci-bot
Copy link
Collaborator Author

Closing the issue as the Integration Test passed for security
Version: 2.12.0
Distribution: tar
Architecture: x64
Platform: linux

Please check the logs: https://build.ci.opensearch.org/job/integ-test/6959/display/redirect

*

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
autocut integ-test-failure Integration test failures v2.12.0 Items targeting 2.12.0
Projects
None yet
Development

No branches or pull requests

7 participants