Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to use the provided SVE GEMM code? #1142

Open
yohuna77777 opened this issue Sep 29, 2024 · 1 comment
Open

How to use the provided SVE GEMM code? #1142

yohuna77777 opened this issue Sep 29, 2024 · 1 comment

Comments

@yohuna77777
Copy link

Hello, I am considering using the SVE instruction set to optimize GEMM operators. I found that although the repository has relevant codes, there is no example telling me how to call these gemm based on the SVE instruction set. Can you provide a relevant usage example?I am looking forward to your reply!

@morgolock
Copy link

Hi @yohuna77777

The library will take care of this for you, there is no need to do anything different when calling the operators. At runtime, the library will check if the cpu supports SVE and if this is the case choose the best SVE kernel for the given workload.

When you build the library just make sure that you use the option multi_isa=1. The prebuilt binaries we publish for Linux or Android they are both multi_isa.

Please see the sgemm example included in the library.

Hope this helps.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants