Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add performace metrics into phi3 C example. #928

Merged
merged 1 commit into from
Sep 26, 2024
Merged

Add performace metrics into phi3 C example. #928

merged 1 commit into from
Sep 26, 2024

Commits on Sep 26, 2024

  1. Add performance metrics into Phi-3 C example 

    This PR adds performance measurement capabilities mirroring the
`--timings` flag of `phi3-qa.py`.

The output is shown below:
-------------
Prompt length: 21, New tokens: 85, Time to first: 2.62s, Prompt tokens
per second: 8.02 tps, New tokens per second: 5.09 tps
-------------

Signed-off-by: Jianhui Dai <jianhui.j.dai@intel.com>
    @daijh
    daijh committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    fe04587 View commit details
    Browse the repository at this point in the history