Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[NPUW] extend DQ & PMM processing and make reduceSum not to keep axis #26779

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

[NPUW] extend DQ & PMM processing and make reduceSum not to keep axis #26779

wants to merge 4 commits into from
+10 −5

Conversation

shaojun-yao
Copy link

@shaojun-yao shaojun-yao commented Sep 25, 2024 •
edited
Loading

Details:

  • extend DQ and PMM to support more patterns. e.g. fp16 matmuls
  • Make reduceSum not to keep axis because then it will convert to poolings in compiler. Otherwise reduceSum will convert to the convolution which is less efficient than poolings.

Tickets:

  • E-140570

@shaojun-yao shaojun-yao requested review from a team as code owners September 25, 2024 07:49
@github-actions github-actions bot added category: NPU OpenVINO NPU plugin category: NPUW NPUW plugin labels Sep 25, 2024
@sys-openvino-ci sys-openvino-ci added the ExternalIntelPR External contributor from Intel label Sep 25, 2024
@shaojun-yao shaojun-yao changed the title [draft] Sj/extend d qand pmm [NPUW] extend DQ & PMM processing and make reduceSum not to keep axis Sep 25, 2024
@dmatveev dmatveev self-assigned this Sep 25, 2024
@dmatveev dmatveev added this to the 2024.5 milestone Sep 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dmatveev dmatveev dmatveev approved these changes

@smirnov-alexey smirnov-alexey smirnov-alexey approved these changes

Assignees

@dmatveev dmatveev

Labels
category: NPU OpenVINO NPU plugin category: NPUW NPUW plugin ExternalIntelPR External contributor from Intel
Projects
None yet
Milestone
2024.5
Development

Successfully merging this pull request may close these issues.
4 participants
@shaojun-yao @dmatveev @smirnov-alexey @sys-openvino-ci