Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for int64_t indices and offsets in TBE inference [7B/N] #3189

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

q10
Copy link
Contributor

@q10 q10 commented Sep 28, 2024

Summary: - Fix index_remapping in pruned_array_lookup to be int64_t always, since it is set up before we are provided indices and offsets

Differential Revision: D63567553

Copy link

netlify bot commented Sep 28, 2024

Deploy Preview for pytorch-fbgemm-docs ready!

Name Link
🔨 Latest commit 5984c26
🔍 Latest deploy log https://app.netlify.com/sites/pytorch-fbgemm-docs/deploys/66fb40c3e9c75d0008b4a585
😎 Deploy Preview https://deploy-preview-3189--pytorch-fbgemm-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D63567553

q10 added a commit to q10/FBGEMM that referenced this pull request Sep 28, 2024
…ytorch#3189)

Summary:
Pull Request resolved: pytorch#3189

- Fix `index_remapping` in `pruned_array_lookup` to be `int64_t` always, since it is set up before we are provided `indices` and `offsets`

Differential Revision: D63567553
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D63567553

1 similar comment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D63567553

q10 added a commit to q10/FBGEMM that referenced this pull request Sep 28, 2024
…ytorch#3189)

Summary:
X-link: facebookresearch/FBGEMM#284

Pull Request resolved: pytorch#3189

- Fix `index_remapping` in `pruned_array_lookup` to be `int64_t` always, since it is set up before we are provided `indices` and `offsets`

Differential Revision: D63567553
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D63567553

Benson Ma added 6 commits September 30, 2024 15:06
Summary: - Add support for int64_t indices in TBE inference [1/N]

Differential Revision: D61813383
Summary:
- Add support for int64_t indices in TBE inference [2/N]

- Convert `pruned_array_lookup_cuda` to use index_t

Differential Revision: D62271409
Summary: - Convert `pruned_hashmap_lookup_cuda` to use index_t

Differential Revision: D62277673
Summary: - Convert `pruned_array_lookup_cpu` to use `index_t`

Differential Revision: D62470736
Summary: - Convert `pruned_hashmap_lookup_cpu` to use `index_t`

Differential Revision: D62472965
Summary: - Convert `PrunedMapCPU::lookup` to use `index_t`

Differential Revision: D62602764
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D63567553

q10 added a commit to q10/FBGEMM that referenced this pull request Oct 1, 2024
…ytorch#3189)

Summary:
X-link: facebookresearch/FBGEMM#284

Pull Request resolved: pytorch#3189

- Fix `index_remapping` in `pruned_array_lookup` to be `int64_t` always, since it is set up before we are provided `indices` and `offsets`

Differential Revision: D63567553
…ytorch#3189)

Summary:
X-link: facebookresearch/FBGEMM#284

Pull Request resolved: pytorch#3189

- Fix `index_remapping` in `pruned_array_lookup` to be `int64_t` always, since it is set up before we are provided `indices` and `offsets`

Differential Revision: D63567553
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D63567553

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants