You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi @BrettlyCD , thanks for the really instructive repo. I am having a hard time getting a local model to run this application.
Have you tried a version that utilizes a local model ?
The text was updated successfully, but these errors were encountered:
I've done a little bit of testing with some other projects on local models. My laptop doesn't have a ton of processing power, so I didn't have a ton of luck.
I'm finding the model restriction to really be the challenge here - using HuggingFace you are limited to the amount of input tokens. Using a local model you are restricted to just not having the best model due to size.
I have been prioritizing some other projects recently, but would love to get back into this and do some more exploring. Thank you for the question!
Hi @BrettlyCD , thanks for the really instructive repo. I am having a hard time getting a local model to run this application.
Have you tried a version that utilizes a local model ?
The text was updated successfully, but these errors were encountered: