Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support Group attention (Llama 2) #883

Merged
merged 28 commits into from
Aug 3, 2023
Merged

support Group attention (Llama 2) #883

merged 28 commits into from
Aug 3, 2023

Commits on Jul 20, 2023

  1. n_kv_heads in inc_mha

    @xinhaoc
    xinhaoc committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    986a778 View commit details
    Browse the repository at this point in the history

  2. .

    @xinhaoc
    xinhaoc committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    6dd7c90 View commit details
    Browse the repository at this point in the history

  3. .

    @xinhaoc
    xinhaoc committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    87cc843 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2023

  1. .

    @xinhaoc
    xinhaoc committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    c268e9e View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2023

  1. .

    @xinhaoc
    xinhaoc committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    55927a3 View commit details
    Browse the repository at this point in the history

  2. .

    @xinhaoc
    xinhaoc committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    ccf9bac View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. fix

    @xinhaoc
    xinhaoc committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    9cfd688 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. fix

    @xinhaoc
    xinhaoc committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    d8a3a2d View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2023

  1. tensor parallelism

    @xinhaoc
    xinhaoc committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    d7fd24b View commit details
    Browse the repository at this point in the history

  2. change weight layout

    @xinhaoc
    xinhaoc committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    c27657f View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. tensor parallelism

    @xinhaoc
    xinhaoc committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    e788184 View commit details
    Browse the repository at this point in the history

  2. merge multiquery attention into inc_mha

    @xinhaoc
    xinhaoc committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    6466990 View commit details
    Browse the repository at this point in the history

  3. llama2 70B config

    @xinhaoc
    xinhaoc committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    09d8cee View commit details
    Browse the repository at this point in the history

  4. spec infer change 1

    @xinhaoc
    xinhaoc committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    cf6a4ff View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. fix.

    @xinhaoc
    xinhaoc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    562b998 View commit details
    Browse the repository at this point in the history

  2. spec infer.

    @xinhaoc
    xinhaoc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    e40881c View commit details
    Browse the repository at this point in the history

  3. falcon spec infer.

    @xinhaoc
    xinhaoc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    2938ffb View commit details
    Browse the repository at this point in the history

  4. fix llama 70B

    @xinhaoc
    xinhaoc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    261ebdd View commit details
    Browse the repository at this point in the history

  5. fix

    @xinhaoc
    xinhaoc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    6e946b0 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'inference' into llama_2

    @xinhaoc
    xinhaoc authored Aug 1, 2023
    Configuration menu
    Copy the full SHA
    70c76a9 View commit details
    Browse the repository at this point in the history

  7. fix & cleanup

    @xinhaoc
    xinhaoc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    f55459c View commit details
    Browse the repository at this point in the history

  8. fix

    @xinhaoc
    xinhaoc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    0192eb9 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. hip rocm

    @xinhaoc
    xinhaoc committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    2c1a402 View commit details
    Browse the repository at this point in the history

  2. issue 908

    @xinhaoc
    xinhaoc committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    486fb7b View commit details
    Browse the repository at this point in the history

  3. clean debug code.

    @xinhaoc
    xinhaoc committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    b0a630b View commit details
    Browse the repository at this point in the history

  4. Merge branch 'inference' into llama_2

    @goliaro
    goliaro committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    a707063 View commit details
    Browse the repository at this point in the history

  5. format.

    @xinhaoc
    xinhaoc committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    809e3ac View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. remove multiquery. remove warning, fix python.

    @xinhaoc
    xinhaoc committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    09492de View commit details
    Browse the repository at this point in the history