Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for int64_t indices and offsets in TBE inference [7B/N] #3189

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Commits on Sep 30, 2024

  1. Add support for int64_t indices in TBE inference [1/N]

    Summary: - Add support for int64_t indices in TBE inference [1/N]
    
    Differential Revision: D61813383
    Benson Ma authored and facebook-github-bot committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    55431bd View commit details
    Browse the repository at this point in the history
  2. Add support for int64_t indices in TBE inference [2/N]

    Summary:
    - Add support for int64_t indices in TBE inference [2/N]
    
    - Convert `pruned_array_lookup_cuda` to use index_t
    
    Differential Revision: D62271409
    Benson Ma authored and facebook-github-bot committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    b57f0ee View commit details
    Browse the repository at this point in the history
  3. Add support for int64_t indices and offsets in TBE inference [3/N]

    Summary: - Convert `pruned_hashmap_lookup_cuda` to use index_t
    
    Differential Revision: D62277673
    Benson Ma authored and facebook-github-bot committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    848ba70 View commit details
    Browse the repository at this point in the history
  4. Add support for int64_t indices and offsets in TBE inference [4/N]

    Summary: - Convert `pruned_array_lookup_cpu` to use `index_t`
    
    Differential Revision: D62470736
    Benson Ma authored and facebook-github-bot committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    cfcaa56 View commit details
    Browse the repository at this point in the history
  5. Add support for int64_t indices and offsets in TBE inference [5/N]

    Summary: - Convert `pruned_hashmap_lookup_cpu` to use `index_t`
    
    Differential Revision: D62472965
    Benson Ma authored and facebook-github-bot committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    61e73ea View commit details
    Browse the repository at this point in the history
  6. Add support for int64_t indices and offsets in TBE inference [6/N]

    Summary: - Convert `PrunedMapCPU::lookup` to use `index_t`
    
    Differential Revision: D62602764
    Benson Ma authored and facebook-github-bot committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    4a8b5d0 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. Add support for int64_t indices and offsets in TBE inference [7B/N] (p…

    …ytorch#3189)
    
    Summary:
    X-link: facebookresearch/FBGEMM#284
    
    Pull Request resolved: pytorch#3189
    
    - Fix `index_remapping` in `pruned_array_lookup` to be `int64_t` always, since it is set up before we are provided `indices` and `offsets`
    
    Differential Revision: D63567553
    q10 authored and facebook-github-bot committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    5984c26 View commit details
    Browse the repository at this point in the history