Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Snippets][CPU] Enabled dynamic INT8|BF16 MHA tokenization on non AMX-platforms #26547

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

a-sidorova
Copy link
Contributor

@a-sidorova a-sidorova commented Sep 12, 2024

Details:

  • Refactored CPU MHA tests - added more dynamic tests for INT8/BF16
  • Enabled dynamic INT8|BF16 MHA tokenization on non AMX-platforms

Tickets:

  • 150840

Prerequisites:

@a-sidorova a-sidorova added this to the 2024.5 milestone Sep 12, 2024
@github-actions github-actions bot added category: IE Tests OpenVINO Test: plugins and common category: CPU OpenVINO CPU plugin labels Sep 12, 2024
@a-sidorova a-sidorova force-pushed the feature/snippets/dynamism/dynamic_i8_bf16_mha_token branch 2 times, most recently from 9cc4fc7 to 800109d Compare September 24, 2024 06:50
@a-sidorova a-sidorova marked this pull request as ready for review September 24, 2024 06:53
@a-sidorova a-sidorova requested review from a team as code owners September 24, 2024 06:53
@a-sidorova a-sidorova force-pushed the feature/snippets/dynamism/dynamic_i8_bf16_mha_token branch from 800109d to f1ac0e8 Compare October 2, 2024 04:20
@a-sidorova
Copy link
Contributor Author

@IvanNovoselov @v-Golubev Hi guys! May I ask you to take a look at these changes please? Thank you in advance!

@a-sidorova a-sidorova force-pushed the feature/snippets/dynamism/dynamic_i8_bf16_mha_token branch from f1ac0e8 to 0b8650a Compare October 2, 2024 04:31
…platforms

[Snippets][CPU][Tests] Added tests for dynamic BF16/INT8 MHA

[Snippets][CPU] Removed check from callback
@a-sidorova a-sidorova force-pushed the feature/snippets/dynamism/dynamic_i8_bf16_mha_token branch from 0b8650a to dec88a9 Compare October 4, 2024 05:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: CPU OpenVINO CPU plugin category: IE Tests OpenVINO Test: plugins and common
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants