Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add whisper quadlet, move whisper model-service, update docs #83

Merged
merged 6 commits into from
Mar 22, 2024

Conversation

sallyom
Copy link
Collaborator

@sallyom sallyom commented Mar 18, 2024

@MichaelClifford ptal

  • Whisper documentation updates (READMEs)
  • Add quadlet for audio-to-text
  • rename whisper-playground -> audio-to-text
  • move whisper model-server to model_servers/whispercpp

@sallyom sallyom force-pushed the actions-new-images branch 2 times, most recently from 61c2020 to 4619249 Compare March 22, 2024 16:53
@sallyom sallyom changed the title gh-actions and docs add whisper quadlet, move whisper model-service, update docs Mar 22, 2024
@sallyom
Copy link
Collaborator Author

sallyom commented Mar 22, 2024

@MichaelClifford registry outage rn so tests are failing but ready for review (this PR isn't building any images)

audio-to-text applications. It consists of two main components; the Model Service and the AI Application.

There are a few options today for local Model Serving, but this recipe will use [`whisper-cpp`](https://github.com/ggerganov/whisper.cpp.git)
and their OpenAI compatible Model Service. There is a Containerfile provided that can be used to build this Model Service within the repo,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this model uses an OpenAI compatible API.
https://platform.openai.com/docs/api-reference/audio/createTranscription?lang=curl

We can probably just say, "and their included model server"

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

audio-to-text/README.md Outdated Show resolved Hide resolved
audio-to-text/README.md Outdated Show resolved Hide resolved
audio-to-text/README.md Outdated Show resolved Hide resolved
audio-to-text/README.md Outdated Show resolved Hide resolved
audio-to-text/README.md Outdated Show resolved Hide resolved
sallyom and others added 5 commits March 22, 2024 14:49
Co-authored-by: Michael Clifford <mcliffor@redhat.com>
Co-authored-by: Michael Clifford <mcliffor@redhat.com>
Co-authored-by: Michael Clifford <mcliffor@redhat.com>
Co-authored-by: Michael Clifford <mcliffor@redhat.com>
@MichaelClifford MichaelClifford self-requested a review March 22, 2024 20:10
@MichaelClifford
Copy link
Collaborator

Thanks @sallyom

@MichaelClifford MichaelClifford merged commit 00cd386 into containers:main Mar 22, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants