Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[$200 bounty] Voice entry demo #30884

Closed
adeebshihadeh opened this issue Jan 2, 2024 · 3 comments
Closed

[$200 bounty] Voice entry demo #30884

adeebshihadeh opened this issue Jan 2, 2024 · 3 comments
Labels
bounty enhancement good first issue Feasible for new contributers

Comments

@adeebshihadeh
Copy link
Contributor

We want to use voice entry for setting nav destinations and more. The goal of this is to get a small, self-contained demo working of detecting a phrase like "Hey comma, navigate home". The script will run forever: detect start of speech, detect end of speech, do speech to text, then print it out.

Requirements:

  • wake word detection needs to be local and fast
  • speech to text can use an API
  • must be low latency (<1s)
  • new dependencies must be used only when necessary
  • doesn't use any GPU; CPU and DSP are available though
  • has to work reliably in the expected use case
    • mounted on the windshield and speaking
    • while openpilot is onroad (everything running)
    • can't make the rest of openpilot lag

See how we're running other models on the device: https://github.com/commaai/openpilot/tree/master/selfdrive/modeld

@singh13apoorv
Copy link

Can you explain this part? ""The goal of this is to get a small, self-contained demo working of detecting a phrase like "Hey comma, navigate home"."
Do you want standalone script with demo or do you want the script to be in the repo but work separately for a demo?

@meirdev
Copy link
Contributor

meirdev commented Jan 2, 2024

https://github.com/meirdev/commaai-assistant (with Whisper)

@jakethesnake420
Copy link
Contributor

#31010

@adeebshihadeh adeebshihadeh moved this from Open to Locked in openpilot bounties Jan 15, 2024
@jnewb1 jnewb1 linked a pull request Jan 15, 2024 that will close this issue
@jnewb1 jnewb1 closed this as completed Jan 22, 2024
@github-project-automation github-project-automation bot moved this from Locked to Done in openpilot bounties Jan 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bounty enhancement good first issue Feasible for new contributers
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

5 participants