Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initial WebGPU EP checkin #22318

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Conversation

fs-eire
Copy link
Contributor

@fs-eire fs-eire commented Oct 4, 2024

Description

This change introduces the WebGPU EP into ONNX Runtime.

To make the PR as simple as possible, this PR excluded the following:

  • C API changes for WebGPU EP
  • actual implementation of WebGPU EP. Currently in this PR, WebGPU is a stub implementation that does not register any kernel.
  • Python IO Binding update
  • Node.js IO Binding update

This PR now contains only 43 file changes (while the working branch contains 130+) and hopefully this makes it easier to review.

There is going to be separated PRs for each mentioned above.

Current working branch: #21904

@fs-eire fs-eire force-pushed the fs-eire/webgpu-ep-first-checkin branch from 6d7bb5b to 4ef2b61 Compare October 4, 2024 23:59
@fs-eire fs-eire force-pushed the fs-eire/webgpu-ep-first-checkin branch from 5ab391b to 5346b07 Compare October 5, 2024 05:18
} else if (provider_name_ == onnxruntime::kWebGpuExecutionProvider) {
#ifdef USE_WEBGPU
session_options.AppendExecutionProvider(
"WebGPU", {{"intra_op_num_threads", std::to_string(performance_test_config.run_config.intra_op_num_threads)}});
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Out of interest why is this specified separately for WebGPU vs passing through and using the SessionOptions value (which is what we do with the xnnpack EP)?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants