Can i use it on linux with nvidia gpu

[alexbespik]

GPU 1650
prime drivers
Linux Manjaro KDE

[cooperdk]

Pretty sure this one does not support GPU.

[EnzoDeg40]

Alpaca.cpp is a fork of llama.cpp, I think you will get more answer here ggerganov#914

[cooperdk]

It is easy to reply to though.
Neither alpaca.cpp nor llama.cpp support gpu. They are both CPU only applications.
It's even ready to check: there are no calls to any CUDA libraries.
To use it with GPU, the model must be covered to a CUDA supported format and used in an application that supports GPU, for example oogabooga.

But honestly, both alpaca and llama are subpar compared to other models. Among other issues, their responses are incredibly short for 2048-token models.

[EnzoDeg40]

@cooperdk My question is a bit off topic. but f alpaca and llama are subpar compared to other models, why is there so much hype around this models ? What are the most powerful "open" models ?