Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Open search dashboard setup failing in local using MAC #4799

Closed
gltestenv opened this issue Aug 23, 2023 · 5 comments
Closed

[BUG] Open search dashboard setup failing in local using MAC #4799

gltestenv opened this issue Aug 23, 2023 · 5 comments
Assignees
Labels
bug Something isn't working

Comments

@gltestenv
Copy link

gltestenv commented Aug 23, 2023

Describe the bug

Using the developer guid, I am trying to configure the open search dashboard in my local but getting the error
https://github.com/opensearch-project/OpenSearch-Dashboards/blob/main/DEVELOPER_GUIDE.md#prerequisites
When running the command yarn opensearch snapshot getting below error.

yarn opensearch snapshot yarn run v1.22.19 $ scripts/use_node scripts/opensearch snapshot info Installing from snapshot │ info version: 3.0.0 │ info install path: /Users/xxxx/Documents/xxxxx/Code/OpenSerachCode/OpenSearch-Dashboards/.opensearch/3.0.0 │ info license: oss │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Daily general-availability snapshot URL not found for current version, falling back to release-candidate snapshot URL. │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc5/opensearch-3.0.0-rc5-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc4/opensearch-3.0.0-rc4-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc3/opensearch-3.0.0-rc3-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc2/opensearch-3.0.0-rc2-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc1/opensearch-3.0.0-rc1-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc0/opensearch-3.0.0-rc0-SNAPSHOT-darwin-arm64-latest.tar.gz │ERROR Snapshots for 3.0.0 are not available error Command failed with exit code 1. info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

Please provide help on this. Thanks in advance

@gltestenv gltestenv added bug Something isn't working untriaged labels Aug 23, 2023
@gltestenv gltestenv changed the title [BUG] Open serach dashboard setup failing [BUG] Open serach dashboard setup failing in local using MAC Aug 23, 2023
@ashwin-pc
Copy link
Member

@kavilla This issue should work based on #2944. Do you know more?

@kavilla
Copy link
Member

kavilla commented Aug 29, 2023

@kavilla This issue should work based on #2944. Do you know more?

Will need to check on my Mac, pontentially this could be an original time out with the bucket containing the artifacts needed to be updated.

Will still check, @gltestenv to be sure, would you be willing to share more information about your local machine. Are you running it through a VPN?

Are you able to download the snapshot link the error message first provides?

Thank you!

@ArielGMachado
Copy link

ArielGMachado commented Jun 8, 2024

I am also currently having the same problem with my Mac with Apple Silicon processors.
Looks like the snapshot artifact recipe was updated by @kavilla at that time via #3537 to support Darwin, but probably tested for x64 architecture only. This assumption is because in the build CI Jenkins there are only MacOS x64 (not arm64 Apple Silicon) nodes available as workers https://build.ci.opensearch.org/computer/
So this Jenkins CI does not generates native arm64 binaries.
When running yarn opensearch snapshot it is trying to download an artifact for darwin-arm64 architecture opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz as detected for our Apple Silicon processor, artifacts that naturally do not exist in this artifactory.

That explains why the link to download snapshot for Darwin arm64 fails : https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz

But the link to download the snapshot for Darwin x64 works:
https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-x64-latest.tar.gz

@MrSparc
Copy link

MrSparc commented Jul 30, 2024

@kavilla in the meanwhile the CI build pipeline was updated to support aarch64 by opensearch-project/opensearch-build#4670
Snapshots for Apple Silicon architecture are being built and available for download (the link in the previous comment for darwin-arm64 already works now), so this issue can be closed as fixed:

 % yarn opensearch snapshot
yarn run v1.22.19
$ scripts/use_node scripts/opensearch snapshot
 info Installing from snapshot
   │ info version: 3.0.0
   │ info install path: /Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0
   │ info license: oss
   │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz
   │ info downloading artifact from https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz
   │ info downloading artifact checksum from https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz.sha512
   │ info checksum verified
   │ info extracting /Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/cache/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz
   │ info extracted to /Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0
   │ info created /Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0/OPENSEARCH_TMPDIR
 info Starting
   │ debg bin/opensearch 
   │ERROR WARNING: Using incubator modules: jdk.incubator.vector
   │      
   │ERROR WARNING: A terminally deprecated method in java.lang.System has been called
   │      WARNING: System::setSecurityManager has been called by 
   │ERROR org.opensearch.bootstrap.OpenSearch (file:/Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0/lib/opensearch-3.0.0-SNAPSHOT.jar)
   │      WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
   │      WARNING: System::setSecurityManager will be removed in a future release
   │      
   │ERROR WARNING: A terminally deprecated method in java.lang.System has been called
   │      WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.Security (file:/Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0/lib/opensearch-3.0.0-SNAPSHOT.jar)
   │ERROR 
   │      WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.Security
   │      WARNING: System::setSecurityManager will be removed in a future release
   │      
   │ info [o.o.n.Node] [MBP-de-Ariel.Home] version[3.0.0-SNAPSHOT], pid[14744], build[tar/0cde7baf438e6ab994114b71dd9fadcacac4e443/2024-07-30T01:33:14.820725Z], OS[Mac OS X/14.5/aarch64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/21.0.4/21.0.4+7-LTS]
   │ info [o.o.n.Node] [MBP-de-Ariel.Home] JVM home [/Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0/jdk.app/Contents/Home], using bundled JDK/JRE [true]
   │ info [o.o.n.Node] [MBP-de-Ariel.Home] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.security.manager=allow, -Djava.locale.providers=SPI,CLDR, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/var/folders/kx/d_cwn3gn5ts90n6b_bn0fzgr0000gn/T/opensearch-2104154294385342477, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.security.manager=allow, --add-modules=jdk.incubator.vector, -Djava.util.concurrent.ForkJoinPool.common.threadFactory=org.opensearch.secure_sm.SecuredForkJoinWorkerThreadFactory, -Xms1g, -Xmx1g, -XX:MaxDirectMemorySize=536870912, -Dopensearch.path.home=/Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0, -Dopensearch.path.conf=/Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0/config, -Dopensearch.distribution.type=tar, -Dopensearch.bundled_jdk=true]
   │ info [o.o.n.Node] [MBP-de-Ariel.Home] version [3.0.0-SNAPSHOT] is a pre-release version of OpenSearch and is not suitable for production
   │ info [o.a.l.i.v.PanamaVectorizationProvider] [MBP-de-Ariel.Home] Java vector incubator API enabled; uses preferredBitSize=128

@peterzhuamazon peterzhuamazon changed the title [BUG] Open serach dashboard setup failing in local using MAC [BUG] Open search dashboard setup failing in local using MAC Aug 12, 2024
@peterzhuamazon
Copy link
Member

Seems like this is fixed now per @MrSparc comments.
Glad the new snapshots helped here.

Closing now. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

7 participants